-- Logs begin at Wed 2022-07-27 08:19:50 UTC, end at Wed 2022-07-27 09:22:50 UTC. -- Jul 27 08:49:00.310640 dv-cinder-797608-64-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 27 08:49:00.318026 dv-cinder-797608-64-smb devstack@keystone.service[80141]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 27 08:49:00.320081 dv-cinder-797608-64-smb devstack@keystone.service[80141]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 08:49:00 2022] *** Jul 27 08:49:00.320081 dv-cinder-797608-64-smb devstack@keystone.service[80141]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 08:49:00.320081 dv-cinder-797608-64-smb devstack@keystone.service[80141]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 08:49:00.320081 dv-cinder-797608-64-smb devstack@keystone.service[80141]: nodename: dv-cinder-797608-64-smb Jul 27 08:49:00.320081 dv-cinder-797608-64-smb devstack@keystone.service[80141]: machine: x86_64 Jul 27 08:49:00.320081 dv-cinder-797608-64-smb devstack@keystone.service[80141]: clock source: unix Jul 27 08:49:00.320081 dv-cinder-797608-64-smb devstack@keystone.service[80141]: pcre jit disabled Jul 27 08:49:00.320081 dv-cinder-797608-64-smb devstack@keystone.service[80141]: detected number of CPU cores: 4 Jul 27 08:49:00.321226 dv-cinder-797608-64-smb devstack@keystone.service[80141]: current working directory: / Jul 27 08:49:00.321226 dv-cinder-797608-64-smb devstack@keystone.service[80141]: detected binary path: /usr/bin/uwsgi-core Jul 27 08:49:00.321226 dv-cinder-797608-64-smb devstack@keystone.service[80141]: your processes number limit is 47680 Jul 27 08:49:00.321226 dv-cinder-797608-64-smb devstack@keystone.service[80141]: your memory page size is 4096 bytes Jul 27 08:49:00.321226 dv-cinder-797608-64-smb devstack@keystone.service[80141]: detected max file descriptor number: 2048 Jul 27 08:49:00.321226 dv-cinder-797608-64-smb devstack@keystone.service[80141]: lock engine: pthread robust mutexes Jul 27 08:49:00.321226 dv-cinder-797608-64-smb devstack@keystone.service[80141]: thunder lock: enabled Jul 27 08:49:00.321226 dv-cinder-797608-64-smb devstack@keystone.service[80141]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 27 08:49:00.321916 dv-cinder-797608-64-smb devstack@keystone.service[80141]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 08:49:00.361154 dv-cinder-797608-64-smb devstack@keystone.service[80141]: Python main interpreter initialized at 0x5608f5fdf9c0 Jul 27 08:49:00.361154 dv-cinder-797608-64-smb devstack@keystone.service[80141]: python threads support enabled Jul 27 08:49:00.361154 dv-cinder-797608-64-smb devstack@keystone.service[80141]: your server socket listen backlog is limited to 100 connections Jul 27 08:49:00.361154 dv-cinder-797608-64-smb devstack@keystone.service[80141]: your mercy for graceful operations on workers is 90 seconds Jul 27 08:49:00.361521 dv-cinder-797608-64-smb devstack@keystone.service[80141]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 08:49:00.361613 dv-cinder-797608-64-smb devstack@keystone.service[80141]: *** Operational MODE: preforking *** Jul 27 08:49:00.361896 dv-cinder-797608-64-smb devstack@keystone.service[80141]: *** uWSGI is running in multiple interpreter mode *** Jul 27 08:49:00.361896 dv-cinder-797608-64-smb devstack@keystone.service[80141]: spawned uWSGI master process (pid: 80141) Jul 27 08:49:00.362107 dv-cinder-797608-64-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 27 08:49:00.363192 dv-cinder-797608-64-smb devstack@keystone.service[80141]: spawned uWSGI worker 1 (pid: 80152, cores: 1) Jul 27 08:49:00.363525 dv-cinder-797608-64-smb devstack@keystone.service[80141]: spawned uWSGI worker 2 (pid: 80153, cores: 1) Jul 27 08:49:00.363683 dv-cinder-797608-64-smb devstack@keystone.service[80141]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 08:49:06.055538 dv-cinder-797608-64-smb devstack@keystone.service[80152]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 08:49:06.055538 dv-cinder-797608-64-smb devstack@keystone.service[80152]: from cryptography.utils import int_from_bytes Jul 27 08:49:06.056358 dv-cinder-797608-64-smb devstack@keystone.service[80152]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 08:49:06.056358 dv-cinder-797608-64-smb devstack@keystone.service[80152]: from cryptography.utils import int_from_bytes Jul 27 08:49:06.056784 dv-cinder-797608-64-smb devstack@keystone.service[80153]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 08:49:06.056784 dv-cinder-797608-64-smb devstack@keystone.service[80153]: from cryptography.utils import int_from_bytes Jul 27 08:49:06.057252 dv-cinder-797608-64-smb devstack@keystone.service[80153]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 08:49:06.057252 dv-cinder-797608-64-smb devstack@keystone.service[80153]: from cryptography.utils import int_from_bytes Jul 27 08:49:06.107218 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 08:49:06.107396 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 08:49:06.107591 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] command line args: [] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 08:49:06.107853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 08:49:06.108030 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ================================================================================ {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 08:49:06.108262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 08:49:06.108351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] admin_token = **** {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.108471 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 08:49:06.108551 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] config_dir = [] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.108670 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] command line args: [] {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 08:49:06.108749 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.108855 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] config_source = [] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.108932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 08:49:06.109036 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] debug = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.109120 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ================================================================================ {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 08:49:06.109234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.109496 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] admin_token = **** {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.109621 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] config_dir = [] {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.109695 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.109755 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.109818 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.109961 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] config_source = [] {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.110046 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.110149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] debug = True {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.110230 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.110380 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.110499 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] list_limit = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.110624 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.110703 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] log_config_append = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.110805 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.110885 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.110984 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] log_dir = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.111063 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.111162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] log_file = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.111299 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.111378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.111536 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] list_limit = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.111620 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.111736 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] log_config_append = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.111847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.111927 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.112071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.112180 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] log_dir = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.112255 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.112363 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] log_file = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.112433 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.112512 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.112646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.112744 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.112888 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.112993 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.113119 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.113211 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.113392 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.113500 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.113570 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.113641 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.113849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.113954 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.114023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.114088 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.114285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.114540 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.114731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.114919 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.115111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.115111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.115567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.115802 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.115995 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] publish_errors = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.116193 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.116430 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.116430 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.116771 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.116961 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.116961 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.117333 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.117567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.118569 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] publish_errors = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.118707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] standard_threads = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.118882 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.119030 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.119177 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.119312 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.119477 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.119665 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.119797 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.119944 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] use_journal = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.120082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.120211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] use_json = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.120337 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] standard_threads = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.120475 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] use_stderr = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.120604 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.120734 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] use_syslog = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.120891 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.121029 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.121178 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.121317 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.121445 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] use_journal = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.121572 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.121699 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] use_json = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.121699 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] use_stderr = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.121948 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.122083 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] use_syslog = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.122211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.122356 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 08:49:06.122491 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.122627 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.122770 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.122908 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.123062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.123191 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.123325 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.123488 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.123661 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.123802 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.123932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.124059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.124187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.124314 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.124450 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.124579 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.124706 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.124850 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.124986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.124986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.125252 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.125383 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.125512 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.125645 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.125773 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.125906 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.126116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.126248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.126443 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.126574 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.126710 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.126855 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.126991 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.127121 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.127254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.127383 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.127510 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.127638 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.127773 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.127908 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.128036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.128164 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.128297 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.128426 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.128570 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.128700 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.128828 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.128961 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.129089 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.129218 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.129353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.129483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.129610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.129737 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.129865 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.130003 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.130132 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.130270 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.130428 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.130559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.130687 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.130822 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.130952 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.131085 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.131215 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.131342 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.131470 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.131605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.131605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.131847 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.131984 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.132128 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.132264 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.132473 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.132610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.132745 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.133407 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.133591 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.133800 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.134044 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.134219 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.134413 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.134555 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.134686 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.134833 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.134973 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.135103 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.135240 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.135369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.135499 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.135627 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.135763 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.135893 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.136026 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.136155 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.136282 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.136410 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.136546 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.137162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.137247 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.137312 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.137373 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.137468 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.137596 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.137675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.137736 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.137799 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.137859 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.137923 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.137990 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.138049 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.138115 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.138207 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.138281 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.138376 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.138459 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.138541 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.138614 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.138687 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.138759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.138824 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.138889 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.138954 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.138954 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.139073 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.139137 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.139201 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.139270 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.139347 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.139414 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.139486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.139555 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.139613 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.139671 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.139729 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.139797 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.139858 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.139915 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.139972 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.140035 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.140093 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.140159 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.140218 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.140282 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.140341 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.140398 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.140463 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.140523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.140580 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.140643 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.140703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.140760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.140824 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.140884 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.140941 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.140998 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.141055 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.141126 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.141193 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.141253 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.141310 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.141367 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.141433 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.141503 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.141572 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.141633 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.141690 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.141747 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.141804 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.141861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.141996 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.142058 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.142058 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.142161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.142223 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.142286 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.142386 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.142459 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.142529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.142590 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.142648 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.142706 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.142763 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.142820 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.142885 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.142944 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.143001 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.143063 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.143122 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.143179 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.143244 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.143303 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.143360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.143417 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.143482 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.143560 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.143626 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] auth.external = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.143685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.143743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.143807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.143807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.143910 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.143910 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.144021 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.144079 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] auth.password = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.144137 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.144198 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] auth.token = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.144264 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.144323 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.144410 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.144481 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.144541 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.144600 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.144663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] auth.external = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.144722 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.144780 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.144847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.144908 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.144974 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.145167 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.145393 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.145514 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] auth.password = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.145582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] credential.caching = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.145643 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] auth.token = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.145703 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.145762 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.145821 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.146003 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.146125 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.146254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.146365 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.146515 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.146596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.146756 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.146838 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.147006 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.147085 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.147243 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.147323 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.147483 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] credential.caching = True {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.147565 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.147730 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.147809 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.147981 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.148358 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.148562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.149150 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.149328 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.149451 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.149577 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.149659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.149835 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.150070 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.150152 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] federation.caching = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.150304 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.150418 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.150569 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.150674 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.150820 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.150973 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.151112 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.151253 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.151381 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.151517 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.151644 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.151775 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.151897 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.152026 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.152152 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.152286 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.152410 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.152538 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.152664 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.152790 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] federation.caching = True {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.152927 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.153065 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.153191 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] identity.caching = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.153319 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.153461 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.153588 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.153719 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.153854 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.153937 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.154078 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.154199 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.154350 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.154431 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.154585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.154662 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.154740 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.154813 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.154813 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.154932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.155014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.155087 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.155184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.155264 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.155414 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.155503 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] identity.caching = True {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.155644 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.155724 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.155886 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.155965 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.156130 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.156218 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.156370 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.156448 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.156621 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.156699 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.156848 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.156939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.157084 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.157165 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.157339 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.157424 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.157573 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.157660 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.157802 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.157882 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.158037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.158116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.158266 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.158380 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.158525 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.158605 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.158762 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.158842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.159001 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.159088 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.159246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.159327 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.159474 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.159556 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.159718 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.159805 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.159961 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.160041 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.160193 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.160279 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.160436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.160525 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.160679 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.160758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.160907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.160986 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.161142 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.161232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.161370 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.161451 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.161605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.161685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.161839 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.161926 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.162077 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.162156 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.162374 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.162458 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.162568 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.162661 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.162812 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.162892 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.163056 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.163136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.163286 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.163375 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.163514 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.163594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.163753 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.163831 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.163990 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.164078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.164249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.164328 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.164484 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.164656 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.164734 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.164909 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.165044 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.165153 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.165234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.165396 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.165477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.165625 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.165706 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.165870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.165950 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.166114 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.166194 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.166369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.166455 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.166608 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.166686 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.166837 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.166917 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.167071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.167153 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.167302 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.167382 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.167536 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.167625 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.167765 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.167846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.user = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.168009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.168087 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.168248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.168335 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.168497 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.168576 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.168750 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.168878 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.169003 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.169128 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.169254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.169359 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.169493 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.169613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.169730 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.169816 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.169954 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.170035 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.170192 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.170271 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.170459 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.170553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.170695 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.170775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.170945 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.171024 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.171195 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.171283 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.171443 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.171522 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.171672 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.171831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.171911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.172088 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.172169 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.172328 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.172415 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.172578 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.172658 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.172821 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.172903 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.173057 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.173137 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.173287 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.173367 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.173522 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.173603 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.173757 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] resource.caching = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.173837 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.174002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.174081 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.174241 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.174341 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.174501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.174581 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.174746 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.174825 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.174993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.175075 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.175229 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.175310 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.175466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.175545 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.175700 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.175780 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.175936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.176016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.176169 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] role.caching = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.176248 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.176409 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.176491 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] role.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.176636 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.176718 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.176882 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.176962 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] resource.caching = True {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.177116 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.177193 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.177359 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.177439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.177603 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.177681 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.177846 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.177926 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.178088 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.178167 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.178360 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.178444 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.178589 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.178670 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.178821 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.178901 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.179064 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.179141 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.179305 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] role.caching = True {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.179386 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.179546 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.179624 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] role.driver = sql {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.179821 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.179936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.180085 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.180335 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.180423 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.180647 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.180740 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.180892 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.180973 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.181140 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.181220 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.181386 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.181466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.181632 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.181715 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.181866 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.181946 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.182108 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.182186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.182383 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.182468 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.182622 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.182701 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.182856 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.182979 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.183124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.183238 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.183349 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.183552 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.183635 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.183821 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.183910 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.184163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.184278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.184389 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.184464 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.184624 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.184722 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.184856 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.184990 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.185116 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] token.caching = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.185211 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.185381 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.185471 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.185633 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.185712 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.185891 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.186002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.186152 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.186266 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.186430 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.186514 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.186692 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.186774 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.186936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.187019 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.187199 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.187279 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.187505 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.187585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.187755 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.187837 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.187992 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.188072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.188226 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.188308 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.188468 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] token.caching = True {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.188549 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.188708 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.188788 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.188935 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.189014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.189176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.189258 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.189435 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.189514 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.189689 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.189769 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] database.connection = **** {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.189931 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.190022 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.190176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.190257 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.190437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.190523 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.190680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.190760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.190915 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.190999 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.191150 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.191230 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.191384 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.191464 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.191618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.191700 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.191860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.191940 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.192091 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.192170 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.192337 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.192418 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.192569 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.192650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.192812 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.192892 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] database.connection = **** {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.193046 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.193141 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.193288 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.193369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.193515 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.193595 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.193752 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.193842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.193983 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.194064 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.194137 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 08:49:06.194270 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.194536 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.194779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.195029 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.195269 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.196161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.196405 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.196659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.196900 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.197151 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.197387 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.197633 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.197873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 08:49:06.198048 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 08:49:06.226149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.226400 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.226666 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.227022 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.227258 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.227530 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.235327 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.236128 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.266773 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.266992 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.267164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.267404 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.321866 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.322173 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.372824 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.373046 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.373935 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.374177 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.440105 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.440308 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.440404 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.440502 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.440582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.440656 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.440759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.440844 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.440978 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.441063 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.441196 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.441279 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.465793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.465993 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.466080 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.466157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.466231 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.466391 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.466479 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.466626 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.466712 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.466851 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.466934 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.467061 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.467153 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.467280 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.478403 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.478928 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.491434 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.491659 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.491810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.491897 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.492045 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.492129 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.492815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.492952 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.493036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.493237 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.493320 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.493448 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.493537 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.493662 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 08:49:06.511974 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.512182 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 08:49:06.512253 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.512438 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 08:49:06.512525 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.512706 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 08:49:06.512788 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.512974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 08:49:06.513056 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.513230 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.513313 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.513483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.513566 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.513736 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.513827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.513996 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.524040 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.524331 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.524546 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.524793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.524903 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.525081 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.525165 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.525378 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.532294 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.532587 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.537264 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.537551 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.537636 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.537831 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.537933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.538107 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.538211 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.538408 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.538498 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.538665 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.538762 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.538929 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.539011 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.539253 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.539364 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.539536 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.539734 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.539817 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.540072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.540163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.540341 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.540432 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.564002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.564475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.565501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.565782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.565995 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.566281 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.571085 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.571463 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.571551 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.571746 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.571832 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.572142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.578520 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.578801 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.578899 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.579105 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.582926 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.583213 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.583296 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.583499 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.583583 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.583775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.583857 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.584043 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.584125 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.584314 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.584404 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.584586 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.584669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.584864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.584954 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.585151 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.600832 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.601109 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.601317 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.602143 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.605573 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.606580 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.608764 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.609053 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.609767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.610067 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.613430 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.614559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.616656 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.618583 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.620488 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.620784 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.621061 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.621346 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.621616 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.621805 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.621890 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.622110 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.622425 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.622725 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.623008 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.623298 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.638211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.638525 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.638798 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.639064 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.639693 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.639997 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.640266 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.640532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.646021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.647593 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.647732 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.647865 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.649731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.650008 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.651017 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.651302 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.651595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.651873 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.652153 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.652904 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.653188 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.653488 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.653774 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.654065 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.663719 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.664004 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.664837 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.665112 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.665387 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.665653 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.665936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.666690 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.666987 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.667273 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.667554 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.667835 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.668110 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.668400 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.682365 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.685022 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.685325 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.688089 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.688294 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.690932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.691091 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.692558 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.692841 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.693117 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.693754 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.695352 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.695640 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.695924 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.700104 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.701703 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.702485 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.704102 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.704657 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.704942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.705217 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.705485 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.707097 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.707390 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.707677 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.707982 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.713758 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.714041 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.714334 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.716187 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.716477 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.716763 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.721201 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.721479 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.721752 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.722029 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.722295 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.722596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.722863 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.723125 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.723506 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.723740 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 08:49:06.723822 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.724023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.724116 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.724297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.724383 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.724555 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.724693 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.724823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.724906 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.725108 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.725380 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.725661 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.726037 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.726340 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.727263 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.727558 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.727840 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.728116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 08:49:06.759551 dv-cinder-797608-64-smb devstack@keystone.service[80152]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5608f5fdf9c0 pid: 80152 (default app) Jul 27 08:49:06.762672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5608f5fdf9c0 pid: 80153 (default app) Jul 27 08:49:06.763037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d12dd-31af-4236-ae70-d0f1a71e68b1 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:06.763323 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d12dd-31af-4236-ae70-d0f1a71e68b1 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:06.763597 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d12dd-31af-4236-ae70-d0f1a71e68b1 None None] PATH_INFO: `/v3` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:06.767890 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 791 bytes} [Wed Jul 27 08:49:06 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:14.573108 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f2c39-cb88-48c8-a043-53b8ed548d95 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:14.573720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f2c39-cb88-48c8-a043-53b8ed548d95 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:14.573720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f2c39-cb88-48c8-a043-53b8ed548d95 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:14.578194 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1/2] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:49:14.584203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bb7db-db92-4ca5-8a88-278180e41f8b None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:14.584700 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bb7db-db92-4ca5-8a88-278180e41f8b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:14.584787 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bb7db-db92-4ca5-8a88-278180e41f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:14.657366 dv-cinder-797608-64-smb devstack@keystone.service[80152]: INFO dbcounter [None req-ba8bb7db-db92-4ca5-8a88-278180e41f8b None None] Registered counter for database keystone Jul 27 08:49:14.680569 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG oslo_db.sqlalchemy.engines [None req-ba8bb7db-db92-4ca5-8a88-278180e41f8b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80152) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 08:49:14.687096 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writer thread running {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 08:49:14.869540 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG passlib.handlers.bcrypt [None req-ba8bb7db-db92-4ca5-8a88-278180e41f8b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80152) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 08:49:14.869873 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG passlib.handlers.bcrypt [None req-ba8bb7db-db92-4ca5-8a88-278180e41f8b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80152) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 08:49:14.926106 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-ba8bb7db-db92-4ca5-8a88-278180e41f8b None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:14.927776 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ba8bb7db-db92-4ca5-8a88-278180e41f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:15.058905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 2/3] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 27 08:49:15.199017 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f2c39-cb88-48c8-a043-53b8ed548d95 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:15.268675 dv-cinder-797608-64-smb devstack@keystone.service[80153]: INFO dbcounter [None req-d99f2c39-cb88-48c8-a043-53b8ed548d95 None None] Registered counter for database keystone Jul 27 08:49:15.288488 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG oslo_db.sqlalchemy.engines [None req-d99f2c39-cb88-48c8-a043-53b8ed548d95 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 08:49:15.295717 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writer thread running {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 08:49:15.415918 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f2c39-cb88-48c8-a043-53b8ed548d95 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:15.420335 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3efd8-9ec3-49db-801e-1781de5be986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:15.420983 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3efd8-9ec3-49db-801e-1781de5be986 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:15.421268 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3efd8-9ec3-49db-801e-1781de5be986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:15.421544 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3efd8-9ec3-49db-801e-1781de5be986 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:15.430619 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3efd8-9ec3-49db-801e-1781de5be986 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:15.483319 dv-cinder-797608-64-smb devstack@keystone.service[80153]: WARNING keystone.common.rbac_enforcer.enforcer [None req-96c3efd8-9ec3-49db-801e-1781de5be986 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 08:49:15.483575 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3efd8-9ec3-49db-801e-1781de5be986 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:15.494582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 2/4] 10.222.0.65 () {58 vars in 1324 bytes} [Wed Jul 27 08:49:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 08:49:15.500591 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bb7db-db92-4ca5-8a88-278180e41f8b None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:15.515687 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bb7db-db92-4ca5-8a88-278180e41f8b None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:15.520173 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2237c8-dd9e-45ab-893a-10a04156668a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:15.521289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2237c8-dd9e-45ab-893a-10a04156668a admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:15.521577 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2237c8-dd9e-45ab-893a-10a04156668a admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:15.521858 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2237c8-dd9e-45ab-893a-10a04156668a admin admin] PATH_INFO: `/v3/projects/47adb2f515cc47f1ba5c310cfe03d1d5` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:15.523685 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2237c8-dd9e-45ab-893a-10a04156668a admin admin] RBAC: Authorizing `identity:get_project(project_id=47adb2f515cc47f1ba5c310cfe03d1d5)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:15.575599 dv-cinder-797608-64-smb devstack@keystone.service[80152]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6a2237c8-dd9e-45ab-893a-10a04156668a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 08:49:15.575942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2237c8-dd9e-45ab-893a-10a04156668a admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:15.580600 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 3/5] 10.222.0.65 () {56 vars in 1207 bytes} [Wed Jul 27 08:49:15 2022] GET /identity/v3/projects/47adb2f515cc47f1ba5c310cfe03d1d5 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:49:17.592877 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8337992-afd1-4a98-b4df-1fbf3787fc40 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:17.593429 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8337992-afd1-4a98-b4df-1fbf3787fc40 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:17.593429 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8337992-afd1-4a98-b4df-1fbf3787fc40 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:17.597547 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 3/6] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:17.603129 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3946605-cfc2-4ece-948f-be6d133a9ef0 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:17.603529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3946605-cfc2-4ece-948f-be6d133a9ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:17.603693 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3946605-cfc2-4ece-948f-be6d133a9ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:17.624354 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f3946605-cfc2-4ece-948f-be6d133a9ef0 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:17.625880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f3946605-cfc2-4ece-948f-be6d133a9ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:17.633851 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 4/7] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 27 08:49:17.656681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8337992-afd1-4a98-b4df-1fbf3787fc40 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:17.669477 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8337992-afd1-4a98-b4df-1fbf3787fc40 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:17.673696 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452973d7-fb8d-4e01-ad42-f001ba0d1082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:17.674305 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452973d7-fb8d-4e01-ad42-f001ba0d1082 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:17.674614 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452973d7-fb8d-4e01-ad42-f001ba0d1082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:17.674891 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452973d7-fb8d-4e01-ad42-f001ba0d1082 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:17.682751 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452973d7-fb8d-4e01-ad42-f001ba0d1082 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:17.684531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452973d7-fb8d-4e01-ad42-f001ba0d1082 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:17.693193 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 4/8] 10.222.0.65 () {58 vars in 1324 bytes} [Wed Jul 27 08:49:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 08:49:17.698773 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3946605-cfc2-4ece-948f-be6d133a9ef0 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:17.707976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3946605-cfc2-4ece-948f-be6d133a9ef0 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:17.713447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6947bc8-0377-4227-a37c-e3f02a8cf452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:17.714084 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6947bc8-0377-4227-a37c-e3f02a8cf452 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:17.714405 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6947bc8-0377-4227-a37c-e3f02a8cf452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:17.714688 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6947bc8-0377-4227-a37c-e3f02a8cf452 admin admin] PATH_INFO: `/v3/users/3e18e0dcebec4953bb7ade2050d92c39` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:17.716068 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6947bc8-0377-4227-a37c-e3f02a8cf452 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e18e0dcebec4953bb7ade2050d92c39)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:17.717906 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6947bc8-0377-4227-a37c-e3f02a8cf452 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:17.719502 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 5/9] 10.222.0.65 () {56 vars in 1198 bytes} [Wed Jul 27 08:49:17 2022] GET /identity/v3/users/3e18e0dcebec4953bb7ade2050d92c39 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:19.796345 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcf113-b99d-4501-ba3c-d0a77eddf745 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:19.796890 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcf113-b99d-4501-ba3c-d0a77eddf745 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:19.796890 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcf113-b99d-4501-ba3c-d0a77eddf745 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:19.798238 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 5/10] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:19.803306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99727e5-3454-42c5-80b9-0d6c5db068e8 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:19.803741 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99727e5-3454-42c5-80b9-0d6c5db068e8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:19.803865 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99727e5-3454-42c5-80b9-0d6c5db068e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:19.823344 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f99727e5-3454-42c5-80b9-0d6c5db068e8 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:19.824571 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f99727e5-3454-42c5-80b9-0d6c5db068e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:19.825728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb943de-6dbe-4ab1-9325-6c81d8061502 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:19.826018 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb943de-6dbe-4ab1-9325-6c81d8061502 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:19.826297 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb943de-6dbe-4ab1-9325-6c81d8061502 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:19.827881 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 6/11] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:49:19.833093 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d87905-1d93-4c81-83da-63d425ca1f2f None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:19.833376 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d87905-1d93-4c81-83da-63d425ca1f2f None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:19.833649 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d87905-1d93-4c81-83da-63d425ca1f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:19.876554 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG passlib.handlers.bcrypt [None req-e7d87905-1d93-4c81-83da-63d425ca1f2f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80153) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 08:49:19.876988 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG passlib.handlers.bcrypt [None req-e7d87905-1d93-4c81-83da-63d425ca1f2f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80153) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 08:49:19.906623 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 6/12] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:49:19.923100 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-e7d87905-1d93-4c81-83da-63d425ca1f2f None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:19.924713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-e7d87905-1d93-4c81-83da-63d425ca1f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:19.929685 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99727e5-3454-42c5-80b9-0d6c5db068e8 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:19.953964 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:20.025196 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 7/13] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:49:20.036429 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99727e5-3454-42c5-80b9-0d6c5db068e8 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:20.047637 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d87905-1d93-4c81-83da-63d425ca1f2f None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:20.072712 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d1d8c-ddba-46df-8936-8ffc666634c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:20.073361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d1d8c-ddba-46df-8936-8ffc666634c4 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:20.073639 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d1d8c-ddba-46df-8936-8ffc666634c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:20.073917 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d1d8c-ddba-46df-8936-8ffc666634c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:20.087167 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d1d8c-ddba-46df-8936-8ffc666634c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:49:20.096797 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-e83d1d8c-ddba-46df-8936-8ffc666634c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:49:20.096797 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:49:20.096797 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:49:20.096797 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:49:20.096797 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:49:20.096797 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:49:20.096797 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:49:20.096797 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:49:20.096797 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:49:20.096797 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:49:20.096797 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:49:20.096797 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:49:20.096797 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:49:20.096797 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:49:20.096797 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:49:20.096797 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:49:20.097823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:49:20.097823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:49:20.097823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:49:20.097823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:49:20.097823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:49:20.097823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:49:20.097823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:49:20.097823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:49:20.097823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:49:20.097823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:49:20.097823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:49:20.097823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:49:20.097823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:49:20.097823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:49:20.097823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:49:20.097823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:49:20.098680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:49:20.098680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:49:20.098680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:49:20.098680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:49:20.098680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:49:20.098680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:49:20.098680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:49:20.098680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:49:20.098680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:49:20.098680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:49:20.098680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:49:20.098680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:49:20.098680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 7/14] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:49:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:49:20.104262 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d1d8c-ddba-46df-8936-8ffc666634c4 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:20.155003 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d87905-1d93-4c81-83da-63d425ca1f2f None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:20.157291 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:20.191932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:20.194646 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0ddd4-a231-4327-8c2c-bb45f318942b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:20.196232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0ddd4-a231-4327-8c2c-bb45f318942b None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:20.196781 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0ddd4-a231-4327-8c2c-bb45f318942b None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:20.196902 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0ddd4-a231-4327-8c2c-bb45f318942b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:20.211991 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d1d8c-ddba-46df-8936-8ffc666634c4 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:20.245710 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd045b-ac34-4eb0-aa6b-1024394ce623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:20.246344 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd045b-ac34-4eb0-aa6b-1024394ce623 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:20.246635 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd045b-ac34-4eb0-aa6b-1024394ce623 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:20.246910 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd045b-ac34-4eb0-aa6b-1024394ce623 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:20.247737 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd045b-ac34-4eb0-aa6b-1024394ce623 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:20.248040 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd045b-ac34-4eb0-aa6b-1024394ce623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:20.249427 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd045b-ac34-4eb0-aa6b-1024394ce623 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:20.262110 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 8/15] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:49:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:49:20.267621 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0ddd4-a231-4327-8c2c-bb45f318942b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:20.267750 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd045b-ac34-4eb0-aa6b-1024394ce623 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:20.269201 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0ddd4-a231-4327-8c2c-bb45f318942b None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:20.372285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 8/16] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:49:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 08:49:20.378041 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0ddd4-a231-4327-8c2c-bb45f318942b None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:20.381374 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:20.478679 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd045b-ac34-4eb0-aa6b-1024394ce623 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:20.483916 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0ddd4-a231-4327-8c2c-bb45f318942b None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:20.514043 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee0864-8fc4-4db0-b574-be4dc7e5b42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:20.514712 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee0864-8fc4-4db0-b574-be4dc7e5b42c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:20.514989 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee0864-8fc4-4db0-b574-be4dc7e5b42c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:20.515265 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee0864-8fc4-4db0-b574-be4dc7e5b42c None admin] PATH_INFO: `/v3/users/3e18e0dcebec4953bb7ade2050d92c39` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:20.516441 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee0864-8fc4-4db0-b574-be4dc7e5b42c None admin] RBAC: Authorizing `identity:get_user(user_id=3e18e0dcebec4953bb7ade2050d92c39)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:20.517892 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee0864-8fc4-4db0-b574-be4dc7e5b42c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:20.519508 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 9/17] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:49:20 2022] GET /identity/v3/users/3e18e0dcebec4953bb7ade2050d92c39 => generated 247 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:49:20.520509 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ed6db-80bc-4593-b717-3ac7b27144b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:20.521429 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ed6db-80bc-4593-b717-3ac7b27144b4 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:20.521711 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ed6db-80bc-4593-b717-3ac7b27144b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:20.521982 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ed6db-80bc-4593-b717-3ac7b27144b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:20.525520 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee0864-8fc4-4db0-b574-be4dc7e5b42c None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:20.541022 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:20.542110 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ed6db-80bc-4593-b717-3ac7b27144b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:20.543632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ed6db-80bc-4593-b717-3ac7b27144b4 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:20.565203 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-e04ed6db-80bc-4593-b717-3ac7b27144b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:49:20.565203 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:49:20.565203 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:49:20.565203 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:49:20.565203 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:49:20.565203 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:49:20.565203 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:49:20.565203 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:49:20.565203 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:49:20.565203 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:49:20.565203 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:49:20.565203 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:49:20.565203 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:49:20.565203 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:49:20.565203 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:49:20.566059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:49:20.566059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:49:20.566059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:49:20.566059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:49:20.566059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:49:20.566059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:49:20.566059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:49:20.566059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:49:20.566059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:49:20.566059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:49:20.566059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:49:20.566059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:49:20.566059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:49:20.566059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:49:20.566059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:49:20.566059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:49:20.566059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:49:20.566916 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:49:20.566916 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:49:20.566916 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:49:20.566916 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:49:20.566916 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 9/18] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:49:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:49:20.573143 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ed6db-80bc-4593-b717-3ac7b27144b4 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:20.629239 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:20.632152 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee0864-8fc4-4db0-b574-be4dc7e5b42c None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:20.671860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c4726-3b0a-4f5f-ac09-30e3a20f7954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:20.672518 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c4726-3b0a-4f5f-ac09-30e3a20f7954 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:20.672794 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c4726-3b0a-4f5f-ac09-30e3a20f7954 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:20.673070 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c4726-3b0a-4f5f-ac09-30e3a20f7954 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:20.674227 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c4726-3b0a-4f5f-ac09-30e3a20f7954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:20.675701 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c4726-3b0a-4f5f-ac09-30e3a20f7954 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:20.675807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ed6db-80bc-4593-b717-3ac7b27144b4 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:20.677631 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 10/19] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:49:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:49:20.683986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c4726-3b0a-4f5f-ac09-30e3a20f7954 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:20.711325 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d767c9a-d6f3-4d1a-8683-1900c0bace53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:20.711953 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d767c9a-d6f3-4d1a-8683-1900c0bace53 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:20.712228 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d767c9a-d6f3-4d1a-8683-1900c0bace53 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:20.712502 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d767c9a-d6f3-4d1a-8683-1900c0bace53 None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:20.713214 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d767c9a-d6f3-4d1a-8683-1900c0bace53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:20.713524 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d767c9a-d6f3-4d1a-8683-1900c0bace53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:20.714951 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d767c9a-d6f3-4d1a-8683-1900c0bace53 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:20.732709 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 10/20] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:49:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:49:20.770853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:20.793901 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c4726-3b0a-4f5f-ac09-30e3a20f7954 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:20.830394 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc876b-8cad-469e-825c-8078a7945f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:20.831140 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc876b-8cad-469e-825c-8078a7945f4a None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:20.831297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc876b-8cad-469e-825c-8078a7945f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:20.831569 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc876b-8cad-469e-825c-8078a7945f4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:20.832378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc876b-8cad-469e-825c-8078a7945f4a None admin] RBAC: Adding query filter params (role.id=20bc872844094480b9dca67a25b69e84, scope.domain.id=default, user.id=3e18e0dcebec4953bb7ade2050d92c39) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:20.832687 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc876b-8cad-469e-825c-8078a7945f4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:20.834173 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc876b-8cad-469e-825c-8078a7945f4a None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:20.841855 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 11/21] 10.222.0.65 () {56 vars in 1322 bytes} [Wed Jul 27 08:49:20 2022] GET /identity/v3/role_assignments?user.id=3e18e0dcebec4953bb7ade2050d92c39&scope.domain.id=default&role.id=20bc872844094480b9dca67a25b69e84 => generated 233 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:49:23.165489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28531fc-da4a-4a25-bcda-353b2105fae0 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:23.166102 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28531fc-da4a-4a25-bcda-353b2105fae0 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:23.166102 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28531fc-da4a-4a25-bcda-353b2105fae0 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:23.167584 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 11/22] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:23.172840 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e7ce9-a5f4-423d-833b-cd8573194e30 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:23.173283 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e7ce9-a5f4-423d-833b-cd8573194e30 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:23.173368 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e7ce9-a5f4-423d-833b-cd8573194e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:23.203325 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-4c9e7ce9-a5f4-423d-833b-cd8573194e30 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:23.204545 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4c9e7ce9-a5f4-423d-833b-cd8573194e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:23.303709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 12/23] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:49:23.335137 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28531fc-da4a-4a25-bcda-353b2105fae0 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:23.452484 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28531fc-da4a-4a25-bcda-353b2105fae0 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:23.478730 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:23.491597 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f7635-829e-47c0-8dc8-37fb74c6fedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:23.492789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f7635-829e-47c0-8dc8-37fb74c6fedb None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:23.493742 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f7635-829e-47c0-8dc8-37fb74c6fedb None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:23.494024 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f7635-829e-47c0-8dc8-37fb74c6fedb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:23.504926 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f7635-829e-47c0-8dc8-37fb74c6fedb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:23.506453 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f7635-829e-47c0-8dc8-37fb74c6fedb None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:23.522582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-e13f7635-829e-47c0-8dc8-37fb74c6fedb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:49:23.522582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:49:23.522582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:49:23.522582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:49:23.522582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:49:23.522582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:49:23.522582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:49:23.522582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:49:23.522582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:49:23.522582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:49:23.522582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:49:23.522582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:49:23.522582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:49:23.522582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:49:23.522582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:49:23.523492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:49:23.523492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:49:23.523492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:49:23.523492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:49:23.523492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:49:23.523492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:49:23.523492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:49:23.523492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:49:23.523492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:49:23.523492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:49:23.523492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:49:23.523492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:49:23.523492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:49:23.523492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:49:23.523492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:49:23.523492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:49:23.523492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:49:23.524556 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:49:23.524556 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:49:23.524556 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:49:23.524556 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:49:23.524772 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 12/24] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:49:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:49:23.530622 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e7ce9-a5f4-423d-833b-cd8573194e30 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:23.539674 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299ded4-1298-4139-9b60-1f76f1eb578f None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:23.539960 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299ded4-1298-4139-9b60-1f76f1eb578f None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:23.540240 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299ded4-1298-4139-9b60-1f76f1eb578f None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:23.541720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 13/25] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:23.553862 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36eb19-77d7-4fc3-9d7e-2d3225459449 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:23.554127 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36eb19-77d7-4fc3-9d7e-2d3225459449 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:23.554429 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36eb19-77d7-4fc3-9d7e-2d3225459449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:23.585772 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-3a36eb19-77d7-4fc3-9d7e-2d3225459449 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:23.587725 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-3a36eb19-77d7-4fc3-9d7e-2d3225459449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:23.670665 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:23.714288 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e7ce9-a5f4-423d-833b-cd8573194e30 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:23.747679 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 14/26] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:49:23.749134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a0277-1f12-422d-a19b-446978f5c997 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:23.749428 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a0277-1f12-422d-a19b-446978f5c997 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:23.749706 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a0277-1f12-422d-a19b-446978f5c997 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:23.751013 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 15/27] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:23.752821 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f438a1-2dcc-45c3-94e5-9b49a85c1061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:23.753687 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f438a1-2dcc-45c3-94e5-9b49a85c1061 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:23.754181 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f438a1-2dcc-45c3-94e5-9b49a85c1061 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:23.754679 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f438a1-2dcc-45c3-94e5-9b49a85c1061 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:23.755578 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f438a1-2dcc-45c3-94e5-9b49a85c1061 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:23.756082 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f438a1-2dcc-45c3-94e5-9b49a85c1061 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:23.756537 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f719865-752b-47d0-b460-18e55c30c170 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:23.756909 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f719865-752b-47d0-b460-18e55c30c170 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:23.757163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f719865-752b-47d0-b460-18e55c30c170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:23.758670 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f438a1-2dcc-45c3-94e5-9b49a85c1061 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:23.786106 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 13/28] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:23.787711 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec86417-f09e-4a64-a120-f6fa83c73080 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:23.788242 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec86417-f09e-4a64-a120-f6fa83c73080 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:23.788820 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec86417-f09e-4a64-a120-f6fa83c73080 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:23.790815 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 14/29] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:23.791726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec86417-f09e-4a64-a120-f6fa83c73080 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:23.793687 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-2f719865-752b-47d0-b460-18e55c30c170 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:23.795126 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-2f719865-752b-47d0-b460-18e55c30c170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:23.919133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec86417-f09e-4a64-a120-f6fa83c73080 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:23.959913 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fcc7bc-d643-417a-b293-60791ecdb48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:23.961012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fcc7bc-d643-417a-b293-60791ecdb48e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:23.961677 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fcc7bc-d643-417a-b293-60791ecdb48e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:23.962161 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fcc7bc-d643-417a-b293-60791ecdb48e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:23.964709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:23.975448 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fcc7bc-d643-417a-b293-60791ecdb48e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:49:23.981563 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-d1fcc7bc-d643-417a-b293-60791ecdb48e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:49:23.981563 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:49:23.981563 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:49:23.981563 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:49:23.981563 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:49:23.981563 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:49:23.981563 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:49:23.981563 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:49:23.981563 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:49:23.981563 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:49:23.981563 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:49:23.981563 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:49:23.981563 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:49:23.981563 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:49:23.981563 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:49:23.981563 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:49:23.982461 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:49:23.982461 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:49:23.982461 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:49:23.982461 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:49:23.982461 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:49:23.982461 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:49:23.982461 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:49:23.982461 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:49:23.982461 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:49:23.982461 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:49:23.982461 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:49:23.982461 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:49:23.982461 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:49:23.982461 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:49:23.982461 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:49:23.982461 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:49:23.983230 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:49:23.983230 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:49:23.983230 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:49:23.983230 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:49:23.983230 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:49:23.983230 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:49:23.983230 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:49:23.983230 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:49:23.983230 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:49:23.983230 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:49:23.983230 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:49:23.983230 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:49:23.985626 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 15/30] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:49:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:49:23.987042 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e4432-15fe-418a-bbbe-97e1bf60c2c6 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:23.987532 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e4432-15fe-418a-bbbe-97e1bf60c2c6 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:23.988070 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e4432-15fe-418a-bbbe-97e1bf60c2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:23.994404 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 16/31] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:49:23.995622 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f719865-752b-47d0-b460-18e55c30c170 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:24.019952 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-641e4432-15fe-418a-bbbe-97e1bf60c2c6 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:24.021553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-641e4432-15fe-418a-bbbe-97e1bf60c2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:24.041240 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:24.100537 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 16/32] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:49:24.102261 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e4432-15fe-418a-bbbe-97e1bf60c2c6 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:24.145398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f719865-752b-47d0-b460-18e55c30c170 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:24.186132 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6012e4-4cc6-4ee3-b216-71ce604de5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:24.186906 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6012e4-4cc6-4ee3-b216-71ce604de5b3 None admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:24.187196 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6012e4-4cc6-4ee3-b216-71ce604de5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:24.187501 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6012e4-4cc6-4ee3-b216-71ce604de5b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:24.188375 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6012e4-4cc6-4ee3-b216-71ce604de5b3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:24.189866 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6012e4-4cc6-4ee3-b216-71ce604de5b3 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:24.247131 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e4432-15fe-418a-bbbe-97e1bf60c2c6 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:24.275347 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:24.288676 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efcb02e-4926-40b0-91b0-a8aace412e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:24.290264 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efcb02e-4926-40b0-91b0-a8aace412e23 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:24.290852 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efcb02e-4926-40b0-91b0-a8aace412e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:24.291320 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efcb02e-4926-40b0-91b0-a8aace412e23 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:24.292270 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efcb02e-4926-40b0-91b0-a8aace412e23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:24.292822 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efcb02e-4926-40b0-91b0-a8aace412e23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:24.294507 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efcb02e-4926-40b0-91b0-a8aace412e23 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:24.304286 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 17/33] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:49:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:24.305488 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efcb02e-4926-40b0-91b0-a8aace412e23 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:24.347372 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 17/34] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 08:49:23 2022] POST /identity/v3/projects => generated 301 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:49:24.347945 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6012e4-4cc6-4ee3-b216-71ce604de5b3 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:24.436601 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efcb02e-4926-40b0-91b0-a8aace412e23 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:24.484522 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e819725-77f7-481d-a8df-7696b4851f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:24.485174 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e819725-77f7-481d-a8df-7696b4851f03 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:24.485462 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e819725-77f7-481d-a8df-7696b4851f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:24.485802 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e819725-77f7-481d-a8df-7696b4851f03 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:24.486644 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e819725-77f7-481d-a8df-7696b4851f03 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:24.488098 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e819725-77f7-481d-a8df-7696b4851f03 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:24.511103 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:24.534628 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6012e4-4cc6-4ee3-b216-71ce604de5b3 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:24.576060 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc770e1-1fff-4add-89fc-81b50ecbdb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:24.576714 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc770e1-1fff-4add-89fc-81b50ecbdb7f None admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:24.577005 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc770e1-1fff-4add-89fc-81b50ecbdb7f None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:24.577337 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc770e1-1fff-4add-89fc-81b50ecbdb7f None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:24.578104 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc770e1-1fff-4add-89fc-81b50ecbdb7f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:24.579662 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc770e1-1fff-4add-89fc-81b50ecbdb7f None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:24.600471 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 18/35] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Jul 27 08:49:24 2022] POST /identity/v3/roles => generated 225 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:49:24.601414 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc770e1-1fff-4add-89fc-81b50ecbdb7f None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:24.635057 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 18/36] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Jul 27 08:49:24 2022] POST /identity/v3/roles => generated 219 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:49:24.637105 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32062cf9-16b6-485a-a3d9-9cd37bf509fc None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:24.637648 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32062cf9-16b6-485a-a3d9-9cd37bf509fc None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:24.638124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32062cf9-16b6-485a-a3d9-9cd37bf509fc None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:24.640214 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 19/37] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:24.646676 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddfdd6-db69-47fb-9eb7-7f731b65aa00 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:24.647292 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddfdd6-db69-47fb-9eb7-7f731b65aa00 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:24.647785 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddfdd6-db69-47fb-9eb7-7f731b65aa00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:24.674969 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-37ddfdd6-db69-47fb-9eb7-7f731b65aa00 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:24.677259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-37ddfdd6-db69-47fb-9eb7-7f731b65aa00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:24.743504 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc770e1-1fff-4add-89fc-81b50ecbdb7f None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:24.773077 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:24.791984 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dafb20-8cb4-44b3-9443-1d152168e812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:24.793151 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dafb20-8cb4-44b3-9443-1d152168e812 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:24.793636 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dafb20-8cb4-44b3-9443-1d152168e812 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:24.794115 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dafb20-8cb4-44b3-9443-1d152168e812 None admin] PATH_INFO: `/v3/users/3e18e0dcebec4953bb7ade2050d92c39` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:24.796148 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dafb20-8cb4-44b3-9443-1d152168e812 None admin] RBAC: Authorizing `identity:get_user(user_id=3e18e0dcebec4953bb7ade2050d92c39)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:24.798073 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dafb20-8cb4-44b3-9443-1d152168e812 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:24.800132 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 19/38] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:49:24 2022] GET /identity/v3/users/3e18e0dcebec4953bb7ade2050d92c39 => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:24.805914 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dafb20-8cb4-44b3-9443-1d152168e812 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:24.819729 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:24.837418 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 20/39] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:49:24.843943 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca9146-143e-4efd-9552-4dc2674e8438 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:24.844576 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca9146-143e-4efd-9552-4dc2674e8438 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:24.845049 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca9146-143e-4efd-9552-4dc2674e8438 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:24.846704 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 21/40] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:24.852316 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5ddac-7079-4f2b-8509-3916438e5e05 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:24.852865 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5ddac-7079-4f2b-8509-3916438e5e05 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:24.853349 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5ddac-7079-4f2b-8509-3916438e5e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:24.883885 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-6cd5ddac-7079-4f2b-8509-3916438e5e05 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:24.885152 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6cd5ddac-7079-4f2b-8509-3916438e5e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:24.935929 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dafb20-8cb4-44b3-9443-1d152168e812 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:24.968483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 22/41] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:49:24.974280 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5ddac-7079-4f2b-8509-3916438e5e05 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:24.985078 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33124c1-486d-45e3-a76e-21c9a1c948e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:24.986014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33124c1-486d-45e3-a76e-21c9a1c948e0 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:24.986386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33124c1-486d-45e3-a76e-21c9a1c948e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:24.986604 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33124c1-486d-45e3-a76e-21c9a1c948e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:24.987875 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33124c1-486d-45e3-a76e-21c9a1c948e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:24.989344 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33124c1-486d-45e3-a76e-21c9a1c948e0 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:24.991153 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 20/42] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:49:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:49:24.991785 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33124c1-486d-45e3-a76e-21c9a1c948e0 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:25.077581 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:25.081424 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5ddac-7079-4f2b-8509-3916438e5e05 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:25.091205 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:25.103372 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33124c1-486d-45e3-a76e-21c9a1c948e0 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:25.124573 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441f0be-e418-464c-84a1-e68f50172fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:25.125206 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441f0be-e418-464c-84a1-e68f50172fc1 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:25.125491 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441f0be-e418-464c-84a1-e68f50172fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:25.125768 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441f0be-e418-464c-84a1-e68f50172fc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:25.126528 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441f0be-e418-464c-84a1-e68f50172fc1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:25.128055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441f0be-e418-464c-84a1-e68f50172fc1 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:25.140961 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4ee6c-3874-4ce1-b7cf-faac7a9a1a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:25.141608 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4ee6c-3874-4ce1-b7cf-faac7a9a1a4f None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:25.141889 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4ee6c-3874-4ce1-b7cf-faac7a9a1a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:25.142166 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4ee6c-3874-4ce1-b7cf-faac7a9a1a4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:25.143140 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 23/43] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Jul 27 08:49:24 2022] POST /identity/v3/roles => generated 223 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:49:25.143346 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d4ee6c-3874-4ce1-b7cf-faac7a9a1a4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:25.143945 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441f0be-e418-464c-84a1-e68f50172fc1 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:25.144916 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d4ee6c-3874-4ce1-b7cf-faac7a9a1a4f None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:25.146530 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 21/44] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:49:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:25.153596 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4ee6c-3874-4ce1-b7cf-faac7a9a1a4f None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:25.265679 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441f0be-e418-464c-84a1-e68f50172fc1 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:25.267594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4ee6c-3874-4ce1-b7cf-faac7a9a1a4f None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:25.307550 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a40e9-01ea-4b6b-81f4-74b555b5f556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:25.308300 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a40e9-01ea-4b6b-81f4-74b555b5f556 None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:25.308587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a40e9-01ea-4b6b-81f4-74b555b5f556 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:25.308866 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a40e9-01ea-4b6b-81f4-74b555b5f556 None admin] PATH_INFO: `/v3/domains/default/users/3e18e0dcebec4953bb7ade2050d92c39/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:25.309426 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946758d9-0273-41fa-a361-92f792694c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:25.310060 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946758d9-0273-41fa-a361-92f792694c38 None admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:25.311024 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946758d9-0273-41fa-a361-92f792694c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:25.311128 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a40e9-01ea-4b6b-81f4-74b555b5f556 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3e18e0dcebec4953bb7ade2050d92c39, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:25.311325 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946758d9-0273-41fa-a361-92f792694c38 None admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:25.312020 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946758d9-0273-41fa-a361-92f792694c38 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:25.312543 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a40e9-01ea-4b6b-81f4-74b555b5f556 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:25.313491 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946758d9-0273-41fa-a361-92f792694c38 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:25.328613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 24/45] 10.222.0.65 () {58 vars in 1361 bytes} [Wed Jul 27 08:49:25 2022] PUT /identity/v3/domains/default/users/3e18e0dcebec4953bb7ade2050d92c39/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:49:25.335806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:25.349010 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 22/46] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 08:49:25 2022] POST /identity/v3/projects => generated 312 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:49:27.357004 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753f84d-1d57-463a-909e-5029bad5d825 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:27.357516 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753f84d-1d57-463a-909e-5029bad5d825 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:27.357598 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753f84d-1d57-463a-909e-5029bad5d825 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:27.358969 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 25/47] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:27.364308 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11196871-4289-4420-b607-468f5eeb464b None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:27.364708 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11196871-4289-4420-b607-468f5eeb464b None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:27.364868 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11196871-4289-4420-b607-468f5eeb464b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:27.383731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-11196871-4289-4420-b607-468f5eeb464b None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:27.385280 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-11196871-4289-4420-b607-468f5eeb464b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:27.454716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 23/48] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:49:27.477394 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4a434-f403-48a5-92b1-1d8cb988a2e8 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:27.477781 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4a434-f403-48a5-92b1-1d8cb988a2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:27.478075 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4a434-f403-48a5-92b1-1d8cb988a2e8 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:27.478188 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11196871-4289-4420-b607-468f5eeb464b None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:27.479704 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 26/49] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:27.485218 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619fba1-56b3-475a-a581-728bd088c2d7 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:27.485512 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619fba1-56b3-475a-a581-728bd088c2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:27.485798 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619fba1-56b3-475a-a581-728bd088c2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:27.505464 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-9619fba1-56b3-475a-a581-728bd088c2d7 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:27.506736 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9619fba1-56b3-475a-a581-728bd088c2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:27.529417 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:27.578400 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 27/50] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:49:27.584543 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11196871-4289-4420-b607-468f5eeb464b None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:27.601034 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619fba1-56b3-475a-a581-728bd088c2d7 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:27.610657 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:27.621270 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec418b-4237-43e4-aacf-21bec2754eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:27.621920 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec418b-4237-43e4-aacf-21bec2754eeb None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:27.622199 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec418b-4237-43e4-aacf-21bec2754eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:27.622499 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec418b-4237-43e4-aacf-21bec2754eeb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:27.633841 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec418b-4237-43e4-aacf-21bec2754eeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:49:27.640873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-e9ec418b-4237-43e4-aacf-21bec2754eeb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:49:27.640873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:49:27.640873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:49:27.640873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:49:27.640873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:49:27.640873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:49:27.640873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:49:27.640873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:49:27.640873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:49:27.640873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:49:27.640873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:49:27.640873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:49:27.640873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:49:27.640873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:49:27.640873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:49:27.640873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:49:27.641787 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:49:27.641787 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:49:27.641787 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:49:27.641787 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:49:27.641787 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:49:27.641787 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:49:27.641787 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:49:27.641787 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:49:27.641787 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:49:27.641787 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:49:27.641787 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:49:27.641787 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:49:27.641787 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:49:27.641787 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:49:27.641787 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:49:27.641787 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:49:27.642659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:49:27.642659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:49:27.642659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:49:27.642659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:49:27.642659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:49:27.642659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:49:27.642659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:49:27.642659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:49:27.642659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:49:27.642659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:49:27.642659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:49:27.642659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:49:27.642659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 24/51] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:49:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:49:27.649965 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec418b-4237-43e4-aacf-21bec2754eeb None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:27.709503 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619fba1-56b3-475a-a581-728bd088c2d7 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:27.744862 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731cff0-a7c9-48b7-9349-1bc5787c7c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:27.745532 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731cff0-a7c9-48b7-9349-1bc5787c7c41 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:27.745819 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731cff0-a7c9-48b7-9349-1bc5787c7c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:27.746099 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731cff0-a7c9-48b7-9349-1bc5787c7c41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:27.747307 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731cff0-a7c9-48b7-9349-1bc5787c7c41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:27.748810 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731cff0-a7c9-48b7-9349-1bc5787c7c41 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:27.755033 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 28/52] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:49:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:49:27.755183 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec418b-4237-43e4-aacf-21bec2754eeb None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:27.756067 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731cff0-a7c9-48b7-9349-1bc5787c7c41 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:27.783430 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:27.787572 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232ad12-2197-40e8-b48b-16577619980e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:27.788204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232ad12-2197-40e8-b48b-16577619980e None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:27.788487 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232ad12-2197-40e8-b48b-16577619980e None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:27.788762 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232ad12-2197-40e8-b48b-16577619980e None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:27.789582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0232ad12-2197-40e8-b48b-16577619980e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:27.789888 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0232ad12-2197-40e8-b48b-16577619980e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:27.791319 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0232ad12-2197-40e8-b48b-16577619980e None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:27.803406 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 25/53] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:49:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:27.809268 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232ad12-2197-40e8-b48b-16577619980e None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:27.859315 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:27.863991 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731cff0-a7c9-48b7-9349-1bc5787c7c41 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:27.900456 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdd676-44c6-48f2-a1d2-bb702a8f3ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:27.900996 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdd676-44c6-48f2-a1d2-bb702a8f3ef8 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:27.901280 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdd676-44c6-48f2-a1d2-bb702a8f3ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:27.901559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdd676-44c6-48f2-a1d2-bb702a8f3ef8 None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:27.902249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fdd676-44c6-48f2-a1d2-bb702a8f3ef8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:27.903741 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fdd676-44c6-48f2-a1d2-bb702a8f3ef8 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:27.912564 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232ad12-2197-40e8-b48b-16577619980e None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:27.936975 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 29/54] 10.222.0.65 () {60 vars in 1140 bytes} [Wed Jul 27 08:49:27 2022] POST /identity/v3/projects => generated 298 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:49:27.963821 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc8647-4db7-4bfd-b0e9-4acafa13afe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:27.964491 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc8647-4db7-4bfd-b0e9-4acafa13afe1 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:27.964781 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc8647-4db7-4bfd-b0e9-4acafa13afe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:27.965057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc8647-4db7-4bfd-b0e9-4acafa13afe1 None admin] PATH_INFO: `/v3/users/3e18e0dcebec4953bb7ade2050d92c39` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:27.966430 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc8647-4db7-4bfd-b0e9-4acafa13afe1 None admin] RBAC: Authorizing `identity:get_user(user_id=3e18e0dcebec4953bb7ade2050d92c39)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:27.967953 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc8647-4db7-4bfd-b0e9-4acafa13afe1 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:27.969725 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 26/55] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:49:27 2022] GET /identity/v3/users/3e18e0dcebec4953bb7ade2050d92c39 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:49:27.975828 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdd676-44c6-48f2-a1d2-bb702a8f3ef8 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:28.078202 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:28.104733 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdd676-44c6-48f2-a1d2-bb702a8f3ef8 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:28.155525 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c120c55-91e5-47e0-85da-b3ed6b86fab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:28.156115 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c120c55-91e5-47e0-85da-b3ed6b86fab8 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:28.156403 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c120c55-91e5-47e0-85da-b3ed6b86fab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:28.156685 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c120c55-91e5-47e0-85da-b3ed6b86fab8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:28.157884 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c120c55-91e5-47e0-85da-b3ed6b86fab8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:28.159432 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c120c55-91e5-47e0-85da-b3ed6b86fab8 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:28.161083 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 30/56] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:49:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:28.167086 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc8647-4db7-4bfd-b0e9-4acafa13afe1 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:28.277329 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc8647-4db7-4bfd-b0e9-4acafa13afe1 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:28.296196 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:28.316499 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5e47d-5f87-409e-b255-ae2fec6bdb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:28.317161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5e47d-5f87-409e-b255-ae2fec6bdb6b None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:28.317442 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5e47d-5f87-409e-b255-ae2fec6bdb6b None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:28.317748 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5e47d-5f87-409e-b255-ae2fec6bdb6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:28.318578 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5e47d-5f87-409e-b255-ae2fec6bdb6b None admin] RBAC: Adding query filter params (role.id=20bc872844094480b9dca67a25b69e84, scope.domain.id=default, user.id=3e18e0dcebec4953bb7ade2050d92c39) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:28.318897 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5e47d-5f87-409e-b255-ae2fec6bdb6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:28.321000 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5e47d-5f87-409e-b255-ae2fec6bdb6b None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:28.331256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 27/57] 10.222.0.65 () {56 vars in 1322 bytes} [Wed Jul 27 08:49:28 2022] GET /identity/v3/role_assignments?user.id=3e18e0dcebec4953bb7ade2050d92c39&scope.domain.id=default&role.id=20bc872844094480b9dca67a25b69e84 => generated 530 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:30.005922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d202343-d5e1-4503-94c3-2a8b85a9e7ff None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:30.006494 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d202343-d5e1-4503-94c3-2a8b85a9e7ff None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:30.006646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d202343-d5e1-4503-94c3-2a8b85a9e7ff None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:30.008353 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 31/58] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:30.014353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93380c3d-9463-435b-b0b3-7b093f728ab6 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:30.014783 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93380c3d-9463-435b-b0b3-7b093f728ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:30.014994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93380c3d-9463-435b-b0b3-7b093f728ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:30.033614 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-93380c3d-9463-435b-b0b3-7b093f728ab6 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:30.034842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-93380c3d-9463-435b-b0b3-7b093f728ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:30.100718 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 28/59] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:49:30.125254 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d202343-d5e1-4503-94c3-2a8b85a9e7ff None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:30.227066 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d202343-d5e1-4503-94c3-2a8b85a9e7ff None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:30.260841 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5344e58-4581-407b-b617-bdc67c799914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:30.261413 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5344e58-4581-407b-b617-bdc67c799914 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:30.261698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5344e58-4581-407b-b617-bdc67c799914 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:30.261977 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5344e58-4581-407b-b617-bdc67c799914 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:30.263164 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5344e58-4581-407b-b617-bdc67c799914 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:30.264630 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5344e58-4581-407b-b617-bdc67c799914 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:30.266241 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 32/60] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:49:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:30.271807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93380c3d-9463-435b-b0b3-7b093f728ab6 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:30.371523 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93380c3d-9463-435b-b0b3-7b093f728ab6 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:30.381836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:30.406133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefceeb-173c-4e9e-bbb9-94019049fddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:30.406782 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefceeb-173c-4e9e-bbb9-94019049fddd None admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:30.407065 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefceeb-173c-4e9e-bbb9-94019049fddd None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:30.407341 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefceeb-173c-4e9e-bbb9-94019049fddd None admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:30.408604 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdefceeb-173c-4e9e-bbb9-94019049fddd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:30.409490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdefceeb-173c-4e9e-bbb9-94019049fddd None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:30.436232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 29/61] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 08:49:30 2022] POST /identity/v3/users => generated 275 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:49:33.509197 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704abfc0-c1f2-4830-b404-aa797edb1451 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:33.510184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704abfc0-c1f2-4830-b404-aa797edb1451 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:33.510715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704abfc0-c1f2-4830-b404-aa797edb1451 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:33.512296 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 33/62] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:33.517675 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535caaa9-8d78-4fc6-940c-dd7fd82decac None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:33.518585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535caaa9-8d78-4fc6-940c-dd7fd82decac None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:33.519070 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535caaa9-8d78-4fc6-940c-dd7fd82decac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:33.547365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-535caaa9-8d78-4fc6-940c-dd7fd82decac None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:33.548989 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-535caaa9-8d78-4fc6-940c-dd7fd82decac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:33.644951 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 30/63] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:49:33.681541 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704abfc0-c1f2-4830-b404-aa797edb1451 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:33.697911 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8aff14-9662-4f6f-80c1-0a6779f05d1c None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:33.698613 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8aff14-9662-4f6f-80c1-0a6779f05d1c None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:33.699096 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8aff14-9662-4f6f-80c1-0a6779f05d1c None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:33.700692 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 31/64] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:49:33.706333 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:33.721300 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb3ce0-f17d-48f2-99e0-44e916a435ff None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:33.721618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb3ce0-f17d-48f2-99e0-44e916a435ff None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:33.721893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb3ce0-f17d-48f2-99e0-44e916a435ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:33.746678 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-c8eb3ce0-f17d-48f2-99e0-44e916a435ff None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:33.747876 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-c8eb3ce0-f17d-48f2-99e0-44e916a435ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:33.852174 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704abfc0-c1f2-4830-b404-aa797edb1451 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:33.854550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 32/65] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 27 08:49:33.856100 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc161a76-460e-4f0d-9814-60be383f82dd None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:33.856393 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc161a76-460e-4f0d-9814-60be383f82dd None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:33.856680 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc161a76-460e-4f0d-9814-60be383f82dd None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:33.858122 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 33/66] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:33.866171 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae90dfd-6811-49e0-9b12-6a8f5b95bc52 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:33.866503 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae90dfd-6811-49e0-9b12-6a8f5b95bc52 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:33.866790 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae90dfd-6811-49e0-9b12-6a8f5b95bc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:33.897948 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-bae90dfd-6811-49e0-9b12-6a8f5b95bc52 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:33.898161 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391c45a-0948-4f29-a2da-ed8aa9615e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:33.898891 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391c45a-0948-4f29-a2da-ed8aa9615e88 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:33.899438 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391c45a-0948-4f29-a2da-ed8aa9615e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:33.899720 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391c45a-0948-4f29-a2da-ed8aa9615e88 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:33.899889 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-bae90dfd-6811-49e0-9b12-6a8f5b95bc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:33.913066 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391c45a-0948-4f29-a2da-ed8aa9615e88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:49:33.919235 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-8391c45a-0948-4f29-a2da-ed8aa9615e88 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:49:33.919235 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:49:33.919235 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:49:33.919235 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:49:33.919235 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:49:33.919235 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:49:33.919235 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:49:33.919235 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:49:33.919235 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:49:33.919235 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:49:33.919235 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:49:33.919235 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:49:33.919235 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:49:33.919235 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:49:33.919235 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:49:33.919235 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:49:33.920163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:49:33.920163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:49:33.920163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:49:33.920163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:49:33.920163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:49:33.920163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:49:33.920163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:49:33.920163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:49:33.920163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:49:33.920163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:49:33.920163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:49:33.920163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:49:33.920163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:49:33.920163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:49:33.920163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:49:33.920163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:49:33.920896 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:49:33.920896 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:49:33.920896 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:49:33.920896 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:49:33.920896 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:49:33.920896 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:49:33.920896 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:49:33.920896 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:49:33.920896 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:49:33.920896 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:49:33.920896 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:49:33.920896 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:49:33.920896 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 34/67] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:49:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:49:33.922002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391c45a-0948-4f29-a2da-ed8aa9615e88 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:33.924773 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:33.989616 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 34/68] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:49:33.991179 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae90dfd-6811-49e0-9b12-6a8f5b95bc52 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:34.036549 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:34.088494 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391c45a-0948-4f29-a2da-ed8aa9615e88 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:34.136371 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9de1b-0a5e-4fc9-b77e-2d67bc06f3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:34.137388 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9de1b-0a5e-4fc9-b77e-2d67bc06f3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:34.137912 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9de1b-0a5e-4fc9-b77e-2d67bc06f3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:34.138281 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9de1b-0a5e-4fc9-b77e-2d67bc06f3c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:34.146197 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae90dfd-6811-49e0-9b12-6a8f5b95bc52 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:34.151200 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9de1b-0a5e-4fc9-b77e-2d67bc06f3c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:49:34.156838 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-38d9de1b-0a5e-4fc9-b77e-2d67bc06f3c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:49:34.156838 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:49:34.156838 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:49:34.156838 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:49:34.156838 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:49:34.156838 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:49:34.156838 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:49:34.156838 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:49:34.156838 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:49:34.156838 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:49:34.156838 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:49:34.156838 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:49:34.156838 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:49:34.156838 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:49:34.156838 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:49:34.156838 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:49:34.158009 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:49:34.158009 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:49:34.158009 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:49:34.158009 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:49:34.158009 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:49:34.158009 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:49:34.158009 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:49:34.158009 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:49:34.158009 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:49:34.158009 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:49:34.158009 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:49:34.158009 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:49:34.158009 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:49:34.158009 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:49:34.158009 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:49:34.158009 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:49:34.159028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:49:34.159028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:49:34.159028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:49:34.159028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:49:34.159028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:49:34.159028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:49:34.159028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:49:34.159028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:49:34.159028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:49:34.159028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:49:34.159028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:49:34.159028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:49:34.159028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 35/69] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:49:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:49:34.159028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9de1b-0a5e-4fc9-b77e-2d67bc06f3c2 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:34.193555 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955710e-6ecd-4fea-beaf-67bc773a4ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:34.194201 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955710e-6ecd-4fea-beaf-67bc773a4ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:34.194521 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955710e-6ecd-4fea-beaf-67bc773a4ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:34.194799 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955710e-6ecd-4fea-beaf-67bc773a4ac0 None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:34.195582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955710e-6ecd-4fea-beaf-67bc773a4ac0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:34.195894 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955710e-6ecd-4fea-beaf-67bc773a4ac0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:34.197314 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955710e-6ecd-4fea-beaf-67bc773a4ac0 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:34.206454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 35/70] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 08:49:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:34.207722 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d95c1b-bee4-46ea-b8c6-6bc8e992fa92 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:34.208014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d95c1b-bee4-46ea-b8c6-6bc8e992fa92 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:34.208294 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d95c1b-bee4-46ea-b8c6-6bc8e992fa92 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:34.209532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 36/71] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:34.210533 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d95c1b-bee4-46ea-b8c6-6bc8e992fa92 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:34.232517 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:34.285599 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9de1b-0a5e-4fc9-b77e-2d67bc06f3c2 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:34.319219 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:34.325721 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b4980-b07b-4949-b558-2ccd5480c672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:34.326419 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b4980-b07b-4949-b558-2ccd5480c672 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:34.326707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b4980-b07b-4949-b558-2ccd5480c672 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:34.327003 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d95c1b-bee4-46ea-b8c6-6bc8e992fa92 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:34.327107 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b4980-b07b-4949-b558-2ccd5480c672 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:34.340871 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b4980-b07b-4949-b558-2ccd5480c672 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:49:34.346378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-870b4980-b07b-4949-b558-2ccd5480c672 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:49:34.346378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:49:34.346378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:49:34.346378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:49:34.346378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:49:34.346378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:49:34.346378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:49:34.346378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:49:34.346378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:49:34.346378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:49:34.346378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:49:34.346378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:49:34.346378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:49:34.346378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:49:34.346378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:49:34.346378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:49:34.347234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:49:34.347234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:49:34.347234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:49:34.347234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:49:34.347234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:49:34.347234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:49:34.347234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:49:34.347234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:49:34.347234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:49:34.347234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:49:34.347234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:49:34.347234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:49:34.347234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:49:34.347234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:49:34.347234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:49:34.347234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:49:34.347993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:49:34.347993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:49:34.347993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:49:34.347993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:49:34.347993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:49:34.347993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:49:34.347993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:49:34.347993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:49:34.347993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:49:34.347993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:49:34.347993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:49:34.347993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:49:34.347993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 36/72] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 08:49:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:49:34.348638 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b4980-b07b-4949-b558-2ccd5480c672 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:34.376595 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd84fa1-e90d-4c0a-84cc-801da2458471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:34.377463 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd84fa1-e90d-4c0a-84cc-801da2458471 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:34.377887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd84fa1-e90d-4c0a-84cc-801da2458471 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:34.378171 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd84fa1-e90d-4c0a-84cc-801da2458471 None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:34.378934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd84fa1-e90d-4c0a-84cc-801da2458471 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:34.379238 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd84fa1-e90d-4c0a-84cc-801da2458471 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:34.380638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd84fa1-e90d-4c0a-84cc-801da2458471 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:34.390759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 37/73] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:49:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:34.392018 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7e485-43f4-4580-ac9e-0b028195e8bd None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:34.392311 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7e485-43f4-4580-ac9e-0b028195e8bd None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:34.392594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7e485-43f4-4580-ac9e-0b028195e8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:34.418294 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-61e7e485-43f4-4580-ac9e-0b028195e8bd None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:34.419548 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-61e7e485-43f4-4580-ac9e-0b028195e8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:34.467362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b4980-b07b-4949-b558-2ccd5480c672 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:34.490521 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 38/74] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:49:34.491380 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7e485-43f4-4580-ac9e-0b028195e8bd None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:34.503089 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:34.503341 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca81f2a-e7e1-4f72-8edb-e66a9a2abd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:34.504089 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca81f2a-e7e1-4f72-8edb-e66a9a2abd8e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:34.504514 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca81f2a-e7e1-4f72-8edb-e66a9a2abd8e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:34.504859 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca81f2a-e7e1-4f72-8edb-e66a9a2abd8e None admin] PATH_INFO: `/v3/users/d01f9e38b5a34766b5dd6418b0516320` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:34.520336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca81f2a-e7e1-4f72-8edb-e66a9a2abd8e None admin] RBAC: Authorizing `identity:get_user(user_id=d01f9e38b5a34766b5dd6418b0516320)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:34.521833 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca81f2a-e7e1-4f72-8edb-e66a9a2abd8e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:34.524116 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 37/75] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:49:34 2022] GET /identity/v3/users/d01f9e38b5a34766b5dd6418b0516320 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:34.525162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca81f2a-e7e1-4f72-8edb-e66a9a2abd8e None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:34.575007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:34.599348 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7e485-43f4-4580-ac9e-0b028195e8bd None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:34.627700 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca81f2a-e7e1-4f72-8edb-e66a9a2abd8e None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:34.634932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f215a3-3322-4f47-b99b-7273c43a4801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:34.635560 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f215a3-3322-4f47-b99b-7273c43a4801 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:34.635837 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f215a3-3322-4f47-b99b-7273c43a4801 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:34.636107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f215a3-3322-4f47-b99b-7273c43a4801 None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:34.636861 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f215a3-3322-4f47-b99b-7273c43a4801 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:34.637133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f215a3-3322-4f47-b99b-7273c43a4801 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:34.638545 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f215a3-3322-4f47-b99b-7273c43a4801 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:34.647178 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 39/76] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:49:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:34.648438 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590dcb9a-be03-4b97-b0d9-087c3e6fd763 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:34.649060 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590dcb9a-be03-4b97-b0d9-087c3e6fd763 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:34.649736 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590dcb9a-be03-4b97-b0d9-087c3e6fd763 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:34.651341 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 40/77] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:34.651971 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590dcb9a-be03-4b97-b0d9-087c3e6fd763 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:34.667592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4b073-ccd8-47a2-b264-73bda43dca0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:34.668250 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4b073-ccd8-47a2-b264-73bda43dca0b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:34.668527 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4b073-ccd8-47a2-b264-73bda43dca0b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:34.668799 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4b073-ccd8-47a2-b264-73bda43dca0b None admin] PATH_INFO: `/v3/users/3e18e0dcebec4953bb7ade2050d92c39` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:34.670010 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4b073-ccd8-47a2-b264-73bda43dca0b None admin] RBAC: Authorizing `identity:get_user(user_id=3e18e0dcebec4953bb7ade2050d92c39)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:34.671525 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4b073-ccd8-47a2-b264-73bda43dca0b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:34.673138 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 38/78] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:49:34 2022] GET /identity/v3/users/3e18e0dcebec4953bb7ade2050d92c39 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:34.673905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4b073-ccd8-47a2-b264-73bda43dca0b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:34.737386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:34.768331 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590dcb9a-be03-4b97-b0d9-087c3e6fd763 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:34.780155 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4b073-ccd8-47a2-b264-73bda43dca0b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:34.797898 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:34.804064 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf9d34-10bc-49c7-884c-a33044349456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:34.804815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf9d34-10bc-49c7-884c-a33044349456 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:34.805148 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf9d34-10bc-49c7-884c-a33044349456 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:34.805436 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf9d34-10bc-49c7-884c-a33044349456 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:34.814848 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ded8d-b797-4786-b1d8-92c6f924e6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:34.815588 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ded8d-b797-4786-b1d8-92c6f924e6ae None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:34.815748 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf9d34-10bc-49c7-884c-a33044349456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:49:34.815988 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ded8d-b797-4786-b1d8-92c6f924e6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:34.816329 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ded8d-b797-4786-b1d8-92c6f924e6ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:34.821278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-1ebf9d34-10bc-49c7-884c-a33044349456 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:49:34.821278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:49:34.821278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:49:34.821278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:49:34.821278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:49:34.821278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:49:34.821278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:49:34.821278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:49:34.821278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:49:34.821278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:49:34.821278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:49:34.821278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:49:34.821278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:49:34.821278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:49:34.821278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:49:34.821278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:49:34.822154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:49:34.822154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:49:34.822154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:49:34.822154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:49:34.822154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:49:34.822154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:49:34.822154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:49:34.822154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:49:34.822154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:49:34.822154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:49:34.822154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:49:34.822154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:49:34.822154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:49:34.822154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:49:34.822154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:49:34.822154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:49:34.822955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:49:34.822955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:49:34.822955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:49:34.822955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:49:34.822955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:49:34.822955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:49:34.822955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:49:34.822955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:49:34.822955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:49:34.822955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:49:34.822955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:49:34.822955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:49:34.822955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 41/79] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:49:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:49:34.823625 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf9d34-10bc-49c7-884c-a33044349456 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:34.886115 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ded8d-b797-4786-b1d8-92c6f924e6ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:34.887556 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ded8d-b797-4786-b1d8-92c6f924e6ae None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:34.928237 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf9d34-10bc-49c7-884c-a33044349456 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:34.958245 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:34.964124 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0469f73-7dc0-4ac7-aeb6-94e049476a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:34.964781 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0469f73-7dc0-4ac7-aeb6-94e049476a4d None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:34.965068 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0469f73-7dc0-4ac7-aeb6-94e049476a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:34.965353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0469f73-7dc0-4ac7-aeb6-94e049476a4d None admin] PATH_INFO: `/v3/users/d01f9e38b5a34766b5dd6418b0516320` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:34.966593 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0469f73-7dc0-4ac7-aeb6-94e049476a4d None admin] RBAC: Authorizing `identity:get_user(user_id=d01f9e38b5a34766b5dd6418b0516320)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:34.968088 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0469f73-7dc0-4ac7-aeb6-94e049476a4d None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:34.969880 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 42/80] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:49:34 2022] GET /identity/v3/users/d01f9e38b5a34766b5dd6418b0516320 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:34.970870 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc584b98-8e14-4a20-af18-6725419a4e4a None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:34.971159 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc584b98-8e14-4a20-af18-6725419a4e4a None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:34.971437 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc584b98-8e14-4a20-af18-6725419a4e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:34.989817 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-fc584b98-8e14-4a20-af18-6725419a4e4a None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:34.990295 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 39/81] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:49:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:34.991066 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-fc584b98-8e14-4a20-af18-6725419a4e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:34.991167 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ded8d-b797-4786-b1d8-92c6f924e6ae None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:35.013788 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:35.061892 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 43/82] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:49:35.074615 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc584b98-8e14-4a20-af18-6725419a4e4a None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:35.105412 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ded8d-b797-4786-b1d8-92c6f924e6ae None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:35.141328 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ade0b-b8e9-4a37-a343-3340b10274ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:35.141879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ade0b-b8e9-4a37-a343-3340b10274ec None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:35.142160 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ade0b-b8e9-4a37-a343-3340b10274ec None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:35.142481 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ade0b-b8e9-4a37-a343-3340b10274ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:35.173104 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc584b98-8e14-4a20-af18-6725419a4e4a None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:35.202134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:35.208231 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9b9d8-5e84-42f0-9573-6084524fd3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:35.208855 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9b9d8-5e84-42f0-9573-6084524fd3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:35.209140 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9b9d8-5e84-42f0-9573-6084524fd3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:35.209420 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9b9d8-5e84-42f0-9573-6084524fd3a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:35.210137 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9b9d8-5e84-42f0-9573-6084524fd3a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:35.210477 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9b9d8-5e84-42f0-9573-6084524fd3a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:35.211684 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ade0b-b8e9-4a37-a343-3340b10274ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:35.212578 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9b9d8-5e84-42f0-9573-6084524fd3a5 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:35.213566 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ade0b-b8e9-4a37-a343-3340b10274ec None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:35.220895 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 44/83] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 08:49:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:35.221716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9b9d8-5e84-42f0-9573-6084524fd3a5 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:35.232349 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:35.319156 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 40/84] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:49:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:35.319156 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ade0b-b8e9-4a37-a343-3340b10274ec None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:35.326341 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9b9d8-5e84-42f0-9573-6084524fd3a5 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:35.364172 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6cff1-3b69-40a3-815c-5691f06da226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:35.364797 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6cff1-3b69-40a3-815c-5691f06da226 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:35.365079 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6cff1-3b69-40a3-815c-5691f06da226 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:35.365357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6cff1-3b69-40a3-815c-5691f06da226 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:35.421160 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ade0b-b8e9-4a37-a343-3340b10274ec None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:35.425140 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:35.435397 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6cff1-3b69-40a3-815c-5691f06da226 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:35.436876 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6cff1-3b69-40a3-815c-5691f06da226 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:35.440288 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:35.459020 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f08a0-d6be-4a53-b0b9-aade2891ee52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:35.459674 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f08a0-d6be-4a53-b0b9-aade2891ee52 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:35.459956 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f08a0-d6be-4a53-b0b9-aade2891ee52 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:35.460238 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f08a0-d6be-4a53-b0b9-aade2891ee52 None admin] PATH_INFO: `/v3/projects/c75e3b6b026f4fe9874853759e673fd6` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:35.462442 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f08a0-d6be-4a53-b0b9-aade2891ee52 None admin] RBAC: Authorizing `identity:get_project(project_id=c75e3b6b026f4fe9874853759e673fd6)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:35.463916 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f08a0-d6be-4a53-b0b9-aade2891ee52 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:35.465610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 41/85] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:49:35 2022] GET /identity/v3/projects/c75e3b6b026f4fe9874853759e673fd6 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:35.466406 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f08a0-d6be-4a53-b0b9-aade2891ee52 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:35.539349 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 45/86] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:49:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:35.540132 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6cff1-3b69-40a3-815c-5691f06da226 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:35.570238 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f08a0-d6be-4a53-b0b9-aade2891ee52 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:35.606007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1ccc0-0fee-4c7a-813b-3d301f71d30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:35.606710 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1ccc0-0fee-4c7a-813b-3d301f71d30c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:35.606995 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1ccc0-0fee-4c7a-813b-3d301f71d30c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:35.607274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1ccc0-0fee-4c7a-813b-3d301f71d30c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:35.608484 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1ccc0-0fee-4c7a-813b-3d301f71d30c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:35.609977 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1ccc0-0fee-4c7a-813b-3d301f71d30c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:35.611641 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 42/87] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:49:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:35.612508 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1ccc0-0fee-4c7a-813b-3d301f71d30c None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:35.632830 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:35.642985 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6cff1-3b69-40a3-815c-5691f06da226 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:35.672408 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:35.679328 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9901b4-7792-4e6f-a4fb-3e8728f1d380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:35.680320 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9901b4-7792-4e6f-a4fb-3e8728f1d380 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:35.680603 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9901b4-7792-4e6f-a4fb-3e8728f1d380 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:35.680877 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9901b4-7792-4e6f-a4fb-3e8728f1d380 None admin] PATH_INFO: `/v3/users/d01f9e38b5a34766b5dd6418b0516320` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:35.682109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9901b4-7792-4e6f-a4fb-3e8728f1d380 None admin] RBAC: Authorizing `identity:get_user(user_id=d01f9e38b5a34766b5dd6418b0516320)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:35.683592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9901b4-7792-4e6f-a4fb-3e8728f1d380 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:35.685236 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 46/88] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:49:35 2022] GET /identity/v3/users/d01f9e38b5a34766b5dd6418b0516320 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:35.686031 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9901b4-7792-4e6f-a4fb-3e8728f1d380 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:35.718940 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1ccc0-0fee-4c7a-813b-3d301f71d30c None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:35.754816 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833c052-f1f7-47d4-9ed8-01a608005dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:35.755474 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833c052-f1f7-47d4-9ed8-01a608005dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:35.755754 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833c052-f1f7-47d4-9ed8-01a608005dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:35.756031 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833c052-f1f7-47d4-9ed8-01a608005dd9 None admin] PATH_INFO: `/v3/projects/c75e3b6b026f4fe9874853759e673fd6` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:35.757214 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833c052-f1f7-47d4-9ed8-01a608005dd9 None admin] RBAC: Authorizing `identity:get_project(project_id=c75e3b6b026f4fe9874853759e673fd6)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:35.759197 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833c052-f1f7-47d4-9ed8-01a608005dd9 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:35.760927 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 43/89] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:49:35 2022] GET /identity/v3/projects/c75e3b6b026f4fe9874853759e673fd6 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:35.761715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833c052-f1f7-47d4-9ed8-01a608005dd9 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:35.788807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9901b4-7792-4e6f-a4fb-3e8728f1d380 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:35.823395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d22e17-4ac6-4672-8704-7fcb4772cbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:35.824020 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d22e17-4ac6-4672-8704-7fcb4772cbae None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:35.824296 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d22e17-4ac6-4672-8704-7fcb4772cbae None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:35.824568 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d22e17-4ac6-4672-8704-7fcb4772cbae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:35.825358 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d22e17-4ac6-4672-8704-7fcb4772cbae None admin] RBAC: Adding query filter params (role.id=87d42817a302438b93da02bfed3f6781, scope.project.id=c75e3b6b026f4fe9874853759e673fd6, user.id=d01f9e38b5a34766b5dd6418b0516320) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:35.825663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d22e17-4ac6-4672-8704-7fcb4772cbae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:35.827147 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d22e17-4ac6-4672-8704-7fcb4772cbae None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:35.832586 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 47/90] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:49:35 2022] GET /identity/v3/role_assignments?user.id=d01f9e38b5a34766b5dd6418b0516320&scope.project.id=c75e3b6b026f4fe9874853759e673fd6&role.id=87d42817a302438b93da02bfed3f6781 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:35.833363 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d22e17-4ac6-4672-8704-7fcb4772cbae None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:35.872677 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833c052-f1f7-47d4-9ed8-01a608005dd9 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:35.875961 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:35.902307 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:35.916754 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0d953-eee2-43b8-bb0d-e77cac0d0ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:35.917429 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0d953-eee2-43b8-bb0d-e77cac0d0ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:35.917734 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0d953-eee2-43b8-bb0d-e77cac0d0ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:35.917993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0d953-eee2-43b8-bb0d-e77cac0d0ff8 None admin] PATH_INFO: `/v3/projects/c75e3b6b026f4fe9874853759e673fd6` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:35.919319 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0d953-eee2-43b8-bb0d-e77cac0d0ff8 None admin] RBAC: Authorizing `identity:get_project(project_id=c75e3b6b026f4fe9874853759e673fd6)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:35.920832 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0d953-eee2-43b8-bb0d-e77cac0d0ff8 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:35.922955 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 44/91] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:49:35 2022] GET /identity/v3/projects/c75e3b6b026f4fe9874853759e673fd6 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:35.923661 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0d953-eee2-43b8-bb0d-e77cac0d0ff8 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:35.981192 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d22e17-4ac6-4672-8704-7fcb4772cbae None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:36.025743 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04dbf8-58eb-42ab-922e-3b52d62f7887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:36.026220 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04dbf8-58eb-42ab-922e-3b52d62f7887 None admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:36.026628 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04dbf8-58eb-42ab-922e-3b52d62f7887 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:36.027027 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04dbf8-58eb-42ab-922e-3b52d62f7887 None admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:36.027728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04dbf8-58eb-42ab-922e-3b52d62f7887 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:36.029219 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04dbf8-58eb-42ab-922e-3b52d62f7887 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:36.052262 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0d953-eee2-43b8-bb0d-e77cac0d0ff8 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:36.062719 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 48/92] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 08:49:35 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:49:36.062719 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04dbf8-58eb-42ab-922e-3b52d62f7887 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:36.104375 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345be7b-697e-41b0-9226-2c6c1f9da8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:36.105124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345be7b-697e-41b0-9226-2c6c1f9da8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:36.105504 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345be7b-697e-41b0-9226-2c6c1f9da8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:36.105852 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345be7b-697e-41b0-9226-2c6c1f9da8b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:36.190894 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:36.203795 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:36.207743 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04dbf8-58eb-42ab-922e-3b52d62f7887 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:36.218990 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345be7b-697e-41b0-9226-2c6c1f9da8b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:36.220821 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345be7b-697e-41b0-9226-2c6c1f9da8b5 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:36.257933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e7a91-b1c9-4490-b3eb-ee586ae4e55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:36.259396 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e7a91-b1c9-4490-b3eb-ee586ae4e55e None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:36.259691 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e7a91-b1c9-4490-b3eb-ee586ae4e55e None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:36.259990 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e7a91-b1c9-4490-b3eb-ee586ae4e55e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:36.260944 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e7a91-b1c9-4490-b3eb-ee586ae4e55e None admin] RBAC: Adding query filter params (role.id=20bc872844094480b9dca67a25b69e84, scope.project.id=c75e3b6b026f4fe9874853759e673fd6, user.id=3e18e0dcebec4953bb7ade2050d92c39) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:36.261258 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e7a91-b1c9-4490-b3eb-ee586ae4e55e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:36.264158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e7a91-b1c9-4490-b3eb-ee586ae4e55e None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:36.272556 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 49/93] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:49:36 2022] GET /identity/v3/role_assignments?user.id=3e18e0dcebec4953bb7ade2050d92c39&scope.project.id=c75e3b6b026f4fe9874853759e673fd6&role.id=20bc872844094480b9dca67a25b69e84 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:36.275593 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e7a91-b1c9-4490-b3eb-ee586ae4e55e None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:36.388644 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 45/94] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:49:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:36.395129 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345be7b-697e-41b0-9226-2c6c1f9da8b5 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:36.444817 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e7a91-b1c9-4490-b3eb-ee586ae4e55e None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:36.505547 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86237e-1142-4be4-b6fb-3218315c380c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:36.506183 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86237e-1142-4be4-b6fb-3218315c380c None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:36.506504 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86237e-1142-4be4-b6fb-3218315c380c None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:36.506780 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86237e-1142-4be4-b6fb-3218315c380c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:36.507586 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86237e-1142-4be4-b6fb-3218315c380c None admin] RBAC: Adding query filter params (role.id=07fbbf1ea87a40f791466f0c934b4183, scope.project.id=c75e3b6b026f4fe9874853759e673fd6, user.id=d01f9e38b5a34766b5dd6418b0516320) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:36.507981 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86237e-1142-4be4-b6fb-3218315c380c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:36.509933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86237e-1142-4be4-b6fb-3218315c380c None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:36.516866 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 50/95] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:49:36 2022] GET /identity/v3/role_assignments?user.id=d01f9e38b5a34766b5dd6418b0516320&scope.project.id=c75e3b6b026f4fe9874853759e673fd6&role.id=07fbbf1ea87a40f791466f0c934b4183 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:36.521173 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:36.534918 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345be7b-697e-41b0-9226-2c6c1f9da8b5 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:36.583671 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d2e145-9736-4c8b-9389-20bc6e51209f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:36.584418 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2e145-9736-4c8b-9389-20bc6e51209f None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:36.584654 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2e145-9736-4c8b-9389-20bc6e51209f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:36.584994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2e145-9736-4c8b-9389-20bc6e51209f None admin] PATH_INFO: `/v3/projects/72394fbb315448a09ffaf744734203f3` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:36.586681 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d2e145-9736-4c8b-9389-20bc6e51209f None admin] RBAC: Authorizing `identity:get_project(project_id=72394fbb315448a09ffaf744734203f3)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:36.588229 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d2e145-9736-4c8b-9389-20bc6e51209f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:36.590151 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 46/96] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:49:36 2022] GET /identity/v3/projects/72394fbb315448a09ffaf744734203f3 => generated 312 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:36.596596 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86237e-1142-4be4-b6fb-3218315c380c None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:36.610211 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:36.729911 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86237e-1142-4be4-b6fb-3218315c380c None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:36.781392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90685475-4ced-4cbd-9614-80aef248494e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:36.782075 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90685475-4ced-4cbd-9614-80aef248494e None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:36.782490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90685475-4ced-4cbd-9614-80aef248494e None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:36.782778 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90685475-4ced-4cbd-9614-80aef248494e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:36.783810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90685475-4ced-4cbd-9614-80aef248494e None admin] RBAC: Adding query filter params (role.id=87d42817a302438b93da02bfed3f6781, scope.project.id=72394fbb315448a09ffaf744734203f3, user.id=d01f9e38b5a34766b5dd6418b0516320) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:36.784131 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90685475-4ced-4cbd-9614-80aef248494e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:36.785726 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90685475-4ced-4cbd-9614-80aef248494e None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:36.793451 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 51/97] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:49:36 2022] GET /identity/v3/role_assignments?user.id=d01f9e38b5a34766b5dd6418b0516320&scope.project.id=72394fbb315448a09ffaf744734203f3&role.id=87d42817a302438b93da02bfed3f6781 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:38.740411 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff6715-80bc-4ce3-b409-f2446ba77d96 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:38.740920 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff6715-80bc-4ce3-b409-f2446ba77d96 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:38.740993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff6715-80bc-4ce3-b409-f2446ba77d96 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:38.743048 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 47/98] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:38.748771 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf97a1-e5c3-49f1-8736-f014617100e7 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:38.749252 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf97a1-e5c3-49f1-8736-f014617100e7 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:38.749322 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf97a1-e5c3-49f1-8736-f014617100e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:38.779557 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-34cf97a1-e5c3-49f1-8736-f014617100e7 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:38.780819 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-34cf97a1-e5c3-49f1-8736-f014617100e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:38.871279 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 52/99] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 27 08:49:38.924075 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff6715-80bc-4ce3-b409-f2446ba77d96 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:39.060110 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff6715-80bc-4ce3-b409-f2446ba77d96 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:39.111696 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688bf54-ec5e-45a9-a7cf-06ae126e8be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:39.112357 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688bf54-ec5e-45a9-a7cf-06ae126e8be6 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:39.112636 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688bf54-ec5e-45a9-a7cf-06ae126e8be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:39.112916 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688bf54-ec5e-45a9-a7cf-06ae126e8be6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:39.139548 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688bf54-ec5e-45a9-a7cf-06ae126e8be6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:49:39.144880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-2688bf54-ec5e-45a9-a7cf-06ae126e8be6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:49:39.144880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:49:39.144880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:49:39.144880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:49:39.144880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:49:39.144880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:49:39.144880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:49:39.144880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:49:39.144880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:49:39.144880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:49:39.144880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:49:39.144880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:49:39.144880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:49:39.144880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:49:39.144880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:49:39.144880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:49:39.146373 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:49:39.146373 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:49:39.146373 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:49:39.146373 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:49:39.146373 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:49:39.146373 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:49:39.146373 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:49:39.146373 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:49:39.146373 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:49:39.146373 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:49:39.146373 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:49:39.146373 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:49:39.146373 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:49:39.146373 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:49:39.146373 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:49:39.146373 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:49:39.147709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:49:39.147709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:49:39.147709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:49:39.147709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:49:39.147709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:49:39.147709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:49:39.147709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:49:39.147709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:49:39.147709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:49:39.147709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:49:39.147709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:49:39.147709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:49:39.151311 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 48/100] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:49:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:49:39.158639 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf97a1-e5c3-49f1-8736-f014617100e7 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:39.161390 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:39.175116 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da9f48-982c-4007-8db0-5f8857073179 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:39.175543 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da9f48-982c-4007-8db0-5f8857073179 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:39.176187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da9f48-982c-4007-8db0-5f8857073179 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:39.177059 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 49/101] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:39.183850 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752f690-3279-4793-bc93-ab1dfefd9f00 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:39.184526 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752f690-3279-4793-bc93-ab1dfefd9f00 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:39.184526 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752f690-3279-4793-bc93-ab1dfefd9f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:39.227510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-8752f690-3279-4793-bc93-ab1dfefd9f00 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:39.228777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-8752f690-3279-4793-bc93-ab1dfefd9f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:39.252344 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:39.374760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 50/102] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:49:39.380338 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf97a1-e5c3-49f1-8736-f014617100e7 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:39.433925 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752f690-3279-4793-bc93-ab1dfefd9f00 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:39.438037 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621a154-f6bf-43a1-b1e6-235d966ee735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:39.443631 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621a154-f6bf-43a1-b1e6-235d966ee735 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:39.443938 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621a154-f6bf-43a1-b1e6-235d966ee735 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:39.444224 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621a154-f6bf-43a1-b1e6-235d966ee735 None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:39.444996 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621a154-f6bf-43a1-b1e6-235d966ee735 None admin] RBAC: Adding query filter params (name=member) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:39.445341 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621a154-f6bf-43a1-b1e6-235d966ee735 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:39.448986 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621a154-f6bf-43a1-b1e6-235d966ee735 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:39.457610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 53/103] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 08:49:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:49:39.463700 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621a154-f6bf-43a1-b1e6-235d966ee735 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:39.588485 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:39.668053 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621a154-f6bf-43a1-b1e6-235d966ee735 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:39.716758 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752f690-3279-4793-bc93-ab1dfefd9f00 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:39.734831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66287b87-91ed-4654-bf3d-bf26ee378df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:39.736103 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66287b87-91ed-4654-bf3d-bf26ee378df8 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:39.736765 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66287b87-91ed-4654-bf3d-bf26ee378df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:39.737514 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66287b87-91ed-4654-bf3d-bf26ee378df8 None admin] PATH_INFO: `/v3/users/d01f9e38b5a34766b5dd6418b0516320` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:39.740010 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66287b87-91ed-4654-bf3d-bf26ee378df8 None admin] RBAC: Authorizing `identity:get_user(user_id=d01f9e38b5a34766b5dd6418b0516320)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:39.743507 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66287b87-91ed-4654-bf3d-bf26ee378df8 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:39.746785 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 54/104] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:49:39 2022] GET /identity/v3/users/d01f9e38b5a34766b5dd6418b0516320 => generated 275 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:49:39.749102 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888b0a2-832c-4474-b076-abc2d6bcfb8e None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:39.749662 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888b0a2-832c-4474-b076-abc2d6bcfb8e None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:39.750246 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888b0a2-832c-4474-b076-abc2d6bcfb8e None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:39.753129 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 55/105] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:39.760021 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888b0a2-832c-4474-b076-abc2d6bcfb8e None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:39.803990 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b04a6-a0a9-47f5-9215-f4b84a9c3166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:39.805874 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b04a6-a0a9-47f5-9215-f4b84a9c3166 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:39.806388 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b04a6-a0a9-47f5-9215-f4b84a9c3166 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:39.806841 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b04a6-a0a9-47f5-9215-f4b84a9c3166 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:39.827037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b04a6-a0a9-47f5-9215-f4b84a9c3166 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:49:39.832830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-2d7b04a6-a0a9-47f5-9215-f4b84a9c3166 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:49:39.832830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:49:39.832830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:49:39.832830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:49:39.832830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:49:39.832830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:49:39.832830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:49:39.832830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:49:39.832830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:49:39.832830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:49:39.832830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:49:39.832830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:49:39.832830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:49:39.832830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:49:39.832830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:49:39.832830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:49:39.833731 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:49:39.833731 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:49:39.833731 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:49:39.833731 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:49:39.833731 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:49:39.833731 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:49:39.833731 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:49:39.833731 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:49:39.833731 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:49:39.833731 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:49:39.833731 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:49:39.833731 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:49:39.833731 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:49:39.833731 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:49:39.833731 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:49:39.833731 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:49:39.834590 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:49:39.834590 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:49:39.834590 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:49:39.834590 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:49:39.834590 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:49:39.834590 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:49:39.834590 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:49:39.834590 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:49:39.834590 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:49:39.834590 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:49:39.834590 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:49:39.834590 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:49:39.837127 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 51/106] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 08:49:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:49:39.842572 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bd39f-3fc6-4e08-a86a-086b56d0f88a None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:39.843174 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bd39f-3fc6-4e08-a86a-086b56d0f88a None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:39.843707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bd39f-3fc6-4e08-a86a-086b56d0f88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:39.875791 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-cb1bd39f-3fc6-4e08-a86a-086b56d0f88a None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:39.878764 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-cb1bd39f-3fc6-4e08-a86a-086b56d0f88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:39.882762 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:39.954923 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 52/107] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:49:39.956372 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1bd39f-3fc6-4e08-a86a-086b56d0f88a None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:40.073339 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1bd39f-3fc6-4e08-a86a-086b56d0f88a None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:40.104606 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888b0a2-832c-4474-b076-abc2d6bcfb8e None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:40.121712 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf4192-b136-46da-8aa8-8b2ca52461bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:40.122765 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf4192-b136-46da-8aa8-8b2ca52461bd None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:40.123384 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf4192-b136-46da-8aa8-8b2ca52461bd None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:40.123924 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf4192-b136-46da-8aa8-8b2ca52461bd None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:40.125039 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf4192-b136-46da-8aa8-8b2ca52461bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:40.125642 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf4192-b136-46da-8aa8-8b2ca52461bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:40.127294 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf4192-b136-46da-8aa8-8b2ca52461bd None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:40.133888 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:40.139469 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 53/108] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:49:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:40.140602 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf4192-b136-46da-8aa8-8b2ca52461bd None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:40.221223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:40.242344 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea83a5-e01f-4127-acfc-fbdcedf55e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:40.242344 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea83a5-e01f-4127-acfc-fbdcedf55e6d None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:40.242344 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea83a5-e01f-4127-acfc-fbdcedf55e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:40.242344 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea83a5-e01f-4127-acfc-fbdcedf55e6d None admin] PATH_INFO: `/v3/projects/c75e3b6b026f4fe9874853759e673fd6` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:40.242771 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea83a5-e01f-4127-acfc-fbdcedf55e6d None admin] RBAC: Authorizing `identity:get_project(project_id=c75e3b6b026f4fe9874853759e673fd6)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:40.243739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea83a5-e01f-4127-acfc-fbdcedf55e6d None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:40.247035 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 56/109] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:49:39 2022] GET /identity/v3/projects/c75e3b6b026f4fe9874853759e673fd6 => generated 298 bytes in 488 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:40.248260 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea83a5-e01f-4127-acfc-fbdcedf55e6d None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:40.276914 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf4192-b136-46da-8aa8-8b2ca52461bd None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:40.340200 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b39b6d-38c9-4a41-899f-1b6a9d20da68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:40.341241 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b39b6d-38c9-4a41-899f-1b6a9d20da68 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:40.341754 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b39b6d-38c9-4a41-899f-1b6a9d20da68 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:40.342228 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b39b6d-38c9-4a41-899f-1b6a9d20da68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:40.364467 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b39b6d-38c9-4a41-899f-1b6a9d20da68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:49:40.380664 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-b0b39b6d-38c9-4a41-899f-1b6a9d20da68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:49:40.380664 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:49:40.380664 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:49:40.380664 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:49:40.380664 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:49:40.380664 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:49:40.380664 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:49:40.380664 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:49:40.380664 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:49:40.380664 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:49:40.380664 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:49:40.380664 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:49:40.380664 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:49:40.380664 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:49:40.380664 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:49:40.380664 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:49:40.382001 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:49:40.382001 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:49:40.382001 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:49:40.382001 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:49:40.382001 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:49:40.382001 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:49:40.382001 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:49:40.382001 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:49:40.382001 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:49:40.382001 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:49:40.382001 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:49:40.382001 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:49:40.382001 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:49:40.382001 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:49:40.382001 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:49:40.382001 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:49:40.383610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:49:40.383610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:49:40.383610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:49:40.383610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:49:40.383610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:49:40.383610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:49:40.383610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:49:40.383610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:49:40.383610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:49:40.383610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:49:40.383610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:49:40.383610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:49:40.392998 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 54/110] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:49:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:49:40.394343 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b39b6d-38c9-4a41-899f-1b6a9d20da68 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:40.446082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea83a5-e01f-4127-acfc-fbdcedf55e6d None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:40.516887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12e9f9-4e1e-4c23-9b4f-f5e74b05a93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:40.518058 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12e9f9-4e1e-4c23-9b4f-f5e74b05a93e None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:40.518705 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12e9f9-4e1e-4c23-9b4f-f5e74b05a93e None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:40.519289 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12e9f9-4e1e-4c23-9b4f-f5e74b05a93e None admin] PATH_INFO: `/v3/users/d01f9e38b5a34766b5dd6418b0516320` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:40.521624 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12e9f9-4e1e-4c23-9b4f-f5e74b05a93e None admin] RBAC: Authorizing `identity:get_user(user_id=d01f9e38b5a34766b5dd6418b0516320)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:40.525188 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12e9f9-4e1e-4c23-9b4f-f5e74b05a93e None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:40.528633 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 57/111] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:49:40 2022] GET /identity/v3/users/d01f9e38b5a34766b5dd6418b0516320 => generated 275 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:40.529969 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12e9f9-4e1e-4c23-9b4f-f5e74b05a93e None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:40.583236 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:40.642115 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b39b6d-38c9-4a41-899f-1b6a9d20da68 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:40.657187 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:40.684141 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3a8c8-75ed-4d7d-8920-651a798f8a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:40.685019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3a8c8-75ed-4d7d-8920-651a798f8a56 None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:40.685346 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3a8c8-75ed-4d7d-8920-651a798f8a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:40.685675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3a8c8-75ed-4d7d-8920-651a798f8a56 None admin] PATH_INFO: `/v3/projects/c75e3b6b026f4fe9874853759e673fd6/users/d01f9e38b5a34766b5dd6418b0516320/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:40.688023 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3a8c8-75ed-4d7d-8920-651a798f8a56 None admin] RBAC: Authorizing `identity:create_grant(project_id=c75e3b6b026f4fe9874853759e673fd6, user_id=d01f9e38b5a34766b5dd6418b0516320, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:40.689603 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3a8c8-75ed-4d7d-8920-651a798f8a56 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:40.698616 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12e9f9-4e1e-4c23-9b4f-f5e74b05a93e None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:40.704940 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 55/112] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 08:49:40 2022] PUT /identity/v3/projects/c75e3b6b026f4fe9874853759e673fd6/users/d01f9e38b5a34766b5dd6418b0516320/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:49:40.706365 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3a8c8-75ed-4d7d-8920-651a798f8a56 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:40.753920 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4e9b1-daf3-408c-aea6-1d3b934b305a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:40.755742 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4e9b1-daf3-408c-aea6-1d3b934b305a None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:40.756183 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4e9b1-daf3-408c-aea6-1d3b934b305a None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:40.756598 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4e9b1-daf3-408c-aea6-1d3b934b305a None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:40.757779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a4e9b1-daf3-408c-aea6-1d3b934b305a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:40.759355 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a4e9b1-daf3-408c-aea6-1d3b934b305a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:40.763201 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a4e9b1-daf3-408c-aea6-1d3b934b305a None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:40.790479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 58/113] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:49:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:40.790479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f594cac-d896-46bc-beea-df0782ff3b67 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:40.790479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f594cac-d896-46bc-beea-df0782ff3b67 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:40.790479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f594cac-d896-46bc-beea-df0782ff3b67 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:40.791084 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 59/114] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:40.793683 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe55af-5b75-46bb-96d6-8e67635b6d32 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:40.794183 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe55af-5b75-46bb-96d6-8e67635b6d32 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:40.794662 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe55af-5b75-46bb-96d6-8e67635b6d32 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:40.796669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 60/115] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:40.801055 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f10aa0-43a5-4dcb-86b5-d312852b8e4d None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:40.801491 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f10aa0-43a5-4dcb-86b5-d312852b8e4d None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:40.801918 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f10aa0-43a5-4dcb-86b5-d312852b8e4d None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:40.805212 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 61/116] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:40.807730 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9debc-df55-435e-94b7-577a5cf3aaa7 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:40.808178 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9debc-df55-435e-94b7-577a5cf3aaa7 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:40.809192 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9debc-df55-435e-94b7-577a5cf3aaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:40.840326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-87a9debc-df55-435e-94b7-577a5cf3aaa7 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:40.841920 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-87a9debc-df55-435e-94b7-577a5cf3aaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:40.884769 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3a8c8-75ed-4d7d-8920-651a798f8a56 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:40.920992 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:40.954730 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799a4fa-e748-456b-af33-37c95d14ed96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:40.955603 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799a4fa-e748-456b-af33-37c95d14ed96 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:40.956093 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799a4fa-e748-456b-af33-37c95d14ed96 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:40.956581 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799a4fa-e748-456b-af33-37c95d14ed96 None admin] PATH_INFO: `/v3/projects/c75e3b6b026f4fe9874853759e673fd6` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:40.956736 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 62/117] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:49:40.958085 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9debc-df55-435e-94b7-577a5cf3aaa7 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:40.958885 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799a4fa-e748-456b-af33-37c95d14ed96 None admin] RBAC: Authorizing `identity:get_project(project_id=c75e3b6b026f4fe9874853759e673fd6)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:40.961991 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799a4fa-e748-456b-af33-37c95d14ed96 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:40.964391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 56/118] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:49:40 2022] GET /identity/v3/projects/c75e3b6b026f4fe9874853759e673fd6 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:40.966740 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4c987-17fd-419a-8476-fc7486d360ab None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:40.967246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4c987-17fd-419a-8476-fc7486d360ab None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:40.967733 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4c987-17fd-419a-8476-fc7486d360ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:40.997017 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-61e4c987-17fd-419a-8476-fc7486d360ab None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:40.999114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-61e4c987-17fd-419a-8476-fc7486d360ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:41.058692 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:41.113520 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9debc-df55-435e-94b7-577a5cf3aaa7 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:41.127605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 57/119] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:49:41.129405 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06995769-f0fb-40de-8da8-71f69e05e628 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:41.129883 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06995769-f0fb-40de-8da8-71f69e05e628 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:41.130399 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06995769-f0fb-40de-8da8-71f69e05e628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:41.159876 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-06995769-f0fb-40de-8da8-71f69e05e628 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:41.162449 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-06995769-f0fb-40de-8da8-71f69e05e628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:41.186400 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c168d-dc5e-4b0e-bb1c-a26f2ee03623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:41.187319 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c168d-dc5e-4b0e-bb1c-a26f2ee03623 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:41.187860 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c168d-dc5e-4b0e-bb1c-a26f2ee03623 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:41.188253 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c168d-dc5e-4b0e-bb1c-a26f2ee03623 None admin] PATH_INFO: `/v3/users/3e18e0dcebec4953bb7ade2050d92c39` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:41.190089 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c168d-dc5e-4b0e-bb1c-a26f2ee03623 None admin] RBAC: Authorizing `identity:get_user(user_id=3e18e0dcebec4953bb7ade2050d92c39)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:41.192240 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c168d-dc5e-4b0e-bb1c-a26f2ee03623 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:41.202227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 63/120] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:49:40 2022] GET /identity/v3/users/3e18e0dcebec4953bb7ade2050d92c39 => generated 247 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:41.202227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c168d-dc5e-4b0e-bb1c-a26f2ee03623 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:41.297504 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 58/121] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:49:41.298587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06995769-f0fb-40de-8da8-71f69e05e628 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:41.370662 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:41.386730 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c168d-dc5e-4b0e-bb1c-a26f2ee03623 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:41.440916 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:41.457094 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a87156-b3eb-4952-a1c3-a7f721b9ab94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:41.458236 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a87156-b3eb-4952-a1c3-a7f721b9ab94 None admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:41.458751 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a87156-b3eb-4952-a1c3-a7f721b9ab94 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:41.459248 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a87156-b3eb-4952-a1c3-a7f721b9ab94 None admin] PATH_INFO: `/v3/projects/c75e3b6b026f4fe9874853759e673fd6/users/d01f9e38b5a34766b5dd6418b0516320/roles/07fbbf1ea87a40f791466f0c934b4183` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:41.463615 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a87156-b3eb-4952-a1c3-a7f721b9ab94 None admin] RBAC: Authorizing `identity:create_grant(project_id=c75e3b6b026f4fe9874853759e673fd6, user_id=d01f9e38b5a34766b5dd6418b0516320, role_id=07fbbf1ea87a40f791466f0c934b4183)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:41.464073 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06995769-f0fb-40de-8da8-71f69e05e628 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:41.466370 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a87156-b3eb-4952-a1c3-a7f721b9ab94 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:41.498365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 64/122] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 08:49:41 2022] PUT /identity/v3/projects/c75e3b6b026f4fe9874853759e673fd6/users/d01f9e38b5a34766b5dd6418b0516320/roles/07fbbf1ea87a40f791466f0c934b4183 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:49:41.498365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a87156-b3eb-4952-a1c3-a7f721b9ab94 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:41.551745 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46c772-39a2-4294-a344-112755f90d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:41.553153 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46c772-39a2-4294-a344-112755f90d62 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:41.554262 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46c772-39a2-4294-a344-112755f90d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:41.555414 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46c772-39a2-4294-a344-112755f90d62 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:41.579047 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af46c772-39a2-4294-a344-112755f90d62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:49:41.592986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-af46c772-39a2-4294-a344-112755f90d62 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:49:41.592986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:49:41.592986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:49:41.592986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:49:41.592986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:49:41.592986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:49:41.592986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:49:41.592986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:49:41.592986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:49:41.592986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:49:41.592986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:49:41.592986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:49:41.592986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:49:41.592986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:49:41.592986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:49:41.592986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:49:41.593921 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:49:41.593921 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:49:41.593921 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:49:41.593921 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:49:41.593921 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:49:41.593921 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:49:41.593921 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:49:41.593921 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:49:41.593921 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:49:41.593921 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:49:41.593921 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:49:41.593921 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:49:41.593921 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:49:41.593921 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:49:41.593921 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:49:41.593921 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:49:41.594703 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:49:41.594703 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:49:41.594703 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:49:41.594703 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:49:41.594703 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:49:41.594703 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:49:41.594703 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:49:41.594703 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:49:41.594703 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:49:41.594703 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:49:41.594703 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:49:41.594703 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:49:41.595985 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 59/123] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:49:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:49:41.598197 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46c772-39a2-4294-a344-112755f90d62 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:41.704319 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a87156-b3eb-4952-a1c3-a7f721b9ab94 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:41.760373 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7ef90-614a-4478-8f56-f3775a201618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:41.761281 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7ef90-614a-4478-8f56-f3775a201618 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:41.761578 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7ef90-614a-4478-8f56-f3775a201618 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:41.761893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7ef90-614a-4478-8f56-f3775a201618 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:41.763327 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7ef90-614a-4478-8f56-f3775a201618 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:41.764875 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7ef90-614a-4478-8f56-f3775a201618 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:41.767087 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 65/124] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:49:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:41.767989 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7ef90-614a-4478-8f56-f3775a201618 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:41.843704 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46c772-39a2-4294-a344-112755f90d62 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:41.869087 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:41.874819 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:41.933078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58364a-ac72-4d8b-a961-4378adc86165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:41.934695 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58364a-ac72-4d8b-a961-4378adc86165 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:41.935206 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58364a-ac72-4d8b-a961-4378adc86165 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:41.936526 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58364a-ac72-4d8b-a961-4378adc86165 None admin] PATH_INFO: `/v3/projects/c75e3b6b026f4fe9874853759e673fd6` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:41.939377 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58364a-ac72-4d8b-a961-4378adc86165 None admin] RBAC: Authorizing `identity:get_project(project_id=c75e3b6b026f4fe9874853759e673fd6)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:41.943367 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58364a-ac72-4d8b-a961-4378adc86165 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:41.947927 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 60/125] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:49:41 2022] GET /identity/v3/projects/c75e3b6b026f4fe9874853759e673fd6 => generated 298 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:41.950627 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58364a-ac72-4d8b-a961-4378adc86165 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:41.975220 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7ef90-614a-4478-8f56-f3775a201618 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:42.061272 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b917b-f33f-4b8d-bad8-c7a673830e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:42.061999 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b917b-f33f-4b8d-bad8-c7a673830e73 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:42.062359 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b917b-f33f-4b8d-bad8-c7a673830e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:42.062653 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b917b-f33f-4b8d-bad8-c7a673830e73 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:42.078997 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b917b-f33f-4b8d-bad8-c7a673830e73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:49:42.091968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-5a9b917b-f33f-4b8d-bad8-c7a673830e73 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:49:42.091968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:49:42.091968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:49:42.091968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:49:42.091968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:49:42.091968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:49:42.091968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:49:42.091968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:49:42.091968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:49:42.091968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:49:42.091968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:49:42.091968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:49:42.091968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:49:42.091968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:49:42.091968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:49:42.091968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:49:42.093119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:49:42.093119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:49:42.093119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:49:42.093119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:49:42.093119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:49:42.093119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:49:42.093119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:49:42.093119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:49:42.093119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:49:42.093119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:49:42.093119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:49:42.093119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:49:42.093119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:49:42.093119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:49:42.093119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:49:42.093119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:49:42.094730 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:49:42.094730 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:49:42.094730 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:49:42.094730 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:49:42.094730 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:49:42.094730 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:49:42.094730 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:49:42.094730 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:49:42.094730 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:49:42.094730 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:49:42.094730 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:49:42.094730 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:49:42.094730 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 66/126] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:49:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:49:42.099150 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b917b-f33f-4b8d-bad8-c7a673830e73 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:42.174232 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58364a-ac72-4d8b-a961-4378adc86165 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:42.243164 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2bc42-850c-4631-bc6e-eaad2ccc8004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:42.243797 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2bc42-850c-4631-bc6e-eaad2ccc8004 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:42.244289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2bc42-850c-4631-bc6e-eaad2ccc8004 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:42.245370 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2bc42-850c-4631-bc6e-eaad2ccc8004 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:42.246187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2bc42-850c-4631-bc6e-eaad2ccc8004 None admin] RBAC: Adding query filter params (name=member) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:42.246677 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2bc42-850c-4631-bc6e-eaad2ccc8004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:42.248688 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2bc42-850c-4631-bc6e-eaad2ccc8004 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:42.266235 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 61/127] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 08:49:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:42.267424 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2bc42-850c-4631-bc6e-eaad2ccc8004 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:42.299791 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b917b-f33f-4b8d-bad8-c7a673830e73 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:42.326795 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:42.329879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:42.347249 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0e536-6159-497e-900e-70e465f35036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:42.348250 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0e536-6159-497e-900e-70e465f35036 None admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:42.348756 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0e536-6159-497e-900e-70e465f35036 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:42.349329 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0e536-6159-497e-900e-70e465f35036 None admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:42.350438 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c0e536-6159-497e-900e-70e465f35036 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:42.352393 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c0e536-6159-497e-900e-70e465f35036 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:42.386137 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 67/128] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 08:49:42 2022] POST /identity/v3/projects => generated 302 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:49:42.387687 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0e536-6159-497e-900e-70e465f35036 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:42.440915 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2bc42-850c-4631-bc6e-eaad2ccc8004 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:42.568593 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e051347-1d93-4a26-b5ab-b8db50a08d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:42.572188 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e051347-1d93-4a26-b5ab-b8db50a08d84 None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:42.575981 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e051347-1d93-4a26-b5ab-b8db50a08d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:42.576889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e051347-1d93-4a26-b5ab-b8db50a08d84 None admin] PATH_INFO: `/v3/projects/c75e3b6b026f4fe9874853759e673fd6/users/3e18e0dcebec4953bb7ade2050d92c39/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:42.588889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e051347-1d93-4a26-b5ab-b8db50a08d84 None admin] RBAC: Authorizing `identity:create_grant(project_id=c75e3b6b026f4fe9874853759e673fd6, user_id=3e18e0dcebec4953bb7ade2050d92c39, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:42.592357 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e051347-1d93-4a26-b5ab-b8db50a08d84 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:42.621800 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 62/129] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 08:49:42 2022] PUT /identity/v3/projects/c75e3b6b026f4fe9874853759e673fd6/users/3e18e0dcebec4953bb7ade2050d92c39/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:49:42.624838 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e051347-1d93-4a26-b5ab-b8db50a08d84 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:42.729511 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0e536-6159-497e-900e-70e465f35036 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:42.803582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95e2f9-c588-46f3-85da-0a669e9df06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:42.804782 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95e2f9-c588-46f3-85da-0a669e9df06c None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:42.805698 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95e2f9-c588-46f3-85da-0a669e9df06c None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:42.806212 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95e2f9-c588-46f3-85da-0a669e9df06c None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:42.807528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95e2f9-c588-46f3-85da-0a669e9df06c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:42.808134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95e2f9-c588-46f3-85da-0a669e9df06c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:42.810561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95e2f9-c588-46f3-85da-0a669e9df06c None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:42.826159 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:42.830968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 68/130] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 08:49:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:42.831915 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e051347-1d93-4a26-b5ab-b8db50a08d84 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:42.839772 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95e2f9-c588-46f3-85da-0a669e9df06c None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:42.877523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349f61c-cbb5-4b45-84ac-bbdfdb5c3d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:42.878805 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349f61c-cbb5-4b45-84ac-bbdfdb5c3d9d None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:42.879340 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349f61c-cbb5-4b45-84ac-bbdfdb5c3d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:42.879853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349f61c-cbb5-4b45-84ac-bbdfdb5c3d9d None admin] PATH_INFO: `/v3/users/d01f9e38b5a34766b5dd6418b0516320` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:42.881638 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349f61c-cbb5-4b45-84ac-bbdfdb5c3d9d None admin] RBAC: Authorizing `identity:get_user(user_id=d01f9e38b5a34766b5dd6418b0516320)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:42.884007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349f61c-cbb5-4b45-84ac-bbdfdb5c3d9d None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:42.886103 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 63/131] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:49:42 2022] GET /identity/v3/users/d01f9e38b5a34766b5dd6418b0516320 => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:42.892948 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349f61c-cbb5-4b45-84ac-bbdfdb5c3d9d None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:42.908725 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:43.067167 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349f61c-cbb5-4b45-84ac-bbdfdb5c3d9d None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:43.072329 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95e2f9-c588-46f3-85da-0a669e9df06c None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:43.123146 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ebfb0-f8a4-4eea-a2ab-f5b0655236bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:43.123836 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ebfb0-f8a4-4eea-a2ab-f5b0655236bb None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:43.124120 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ebfb0-f8a4-4eea-a2ab-f5b0655236bb None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:43.124400 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ebfb0-f8a4-4eea-a2ab-f5b0655236bb None admin] PATH_INFO: `/v3/projects/72394fbb315448a09ffaf744734203f3` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:43.129688 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ebfb0-f8a4-4eea-a2ab-f5b0655236bb None admin] RBAC: Authorizing `identity:get_project(project_id=72394fbb315448a09ffaf744734203f3)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:43.131335 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ebfb0-f8a4-4eea-a2ab-f5b0655236bb None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:43.133442 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 64/132] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:49:42 2022] GET /identity/v3/projects/72394fbb315448a09ffaf744734203f3 => generated 312 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:43.142867 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ebfb0-f8a4-4eea-a2ab-f5b0655236bb None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:43.167893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3818a53-fd6d-42f4-8d6a-633aa5389d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:43.168589 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3818a53-fd6d-42f4-8d6a-633aa5389d07 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:43.168876 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3818a53-fd6d-42f4-8d6a-633aa5389d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:43.169161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3818a53-fd6d-42f4-8d6a-633aa5389d07 None admin] PATH_INFO: `/v3/users/8cd08420291f4825bc1ee53760214ee0` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:43.203293 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3818a53-fd6d-42f4-8d6a-633aa5389d07 None admin] RBAC: Authorizing `identity:get_user(user_id=8cd08420291f4825bc1ee53760214ee0)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:43.205110 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3818a53-fd6d-42f4-8d6a-633aa5389d07 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:43.207423 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 69/133] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:49:42 2022] GET /identity/v3/users/8cd08420291f4825bc1ee53760214ee0 => generated 289 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:43.214360 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3818a53-fd6d-42f4-8d6a-633aa5389d07 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:43.281062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:43.347524 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:43.366268 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3818a53-fd6d-42f4-8d6a-633aa5389d07 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:43.420950 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65991b2a-acb4-4a2e-95d5-5b3947b2f10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:43.421541 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65991b2a-acb4-4a2e-95d5-5b3947b2f10b None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:43.421856 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65991b2a-acb4-4a2e-95d5-5b3947b2f10b None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:43.422137 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65991b2a-acb4-4a2e-95d5-5b3947b2f10b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:43.472576 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ebfb0-f8a4-4eea-a2ab-f5b0655236bb None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:43.563343 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f560e-8f65-43da-82be-133a0579affc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:43.564044 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f560e-8f65-43da-82be-133a0579affc None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:43.564332 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f560e-8f65-43da-82be-133a0579affc None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:43.564610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f560e-8f65-43da-82be-133a0579affc None admin] PATH_INFO: `/v3/projects/72394fbb315448a09ffaf744734203f3/users/d01f9e38b5a34766b5dd6418b0516320/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:43.567130 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f560e-8f65-43da-82be-133a0579affc None admin] RBAC: Authorizing `identity:create_grant(project_id=72394fbb315448a09ffaf744734203f3, user_id=d01f9e38b5a34766b5dd6418b0516320, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:43.568627 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f560e-8f65-43da-82be-133a0579affc None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:43.582660 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65991b2a-acb4-4a2e-95d5-5b3947b2f10b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:43.584269 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65991b2a-acb4-4a2e-95d5-5b3947b2f10b None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:43.599714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 65/134] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 08:49:43 2022] PUT /identity/v3/projects/72394fbb315448a09ffaf744734203f3/users/d01f9e38b5a34766b5dd6418b0516320/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:49:43.706696 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:43.723933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 70/135] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:49:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 08:49:43.730489 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f560e-8f65-43da-82be-133a0579affc None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:43.864820 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:43.876432 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f560e-8f65-43da-82be-133a0579affc None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:43.926468 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15440cb3-e378-4ac6-a8e1-3ef9f25ac811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:43.927136 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15440cb3-e378-4ac6-a8e1-3ef9f25ac811 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:43.927425 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15440cb3-e378-4ac6-a8e1-3ef9f25ac811 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:43.927709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15440cb3-e378-4ac6-a8e1-3ef9f25ac811 None admin] PATH_INFO: `/v3/projects/c75e3b6b026f4fe9874853759e673fd6` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:43.928911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15440cb3-e378-4ac6-a8e1-3ef9f25ac811 None admin] RBAC: Authorizing `identity:get_project(project_id=c75e3b6b026f4fe9874853759e673fd6)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:43.930779 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15440cb3-e378-4ac6-a8e1-3ef9f25ac811 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:43.932483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 66/136] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:49:43 2022] GET /identity/v3/projects/c75e3b6b026f4fe9874853759e673fd6 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:49:43.941602 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65991b2a-acb4-4a2e-95d5-5b3947b2f10b None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:44.083595 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65991b2a-acb4-4a2e-95d5-5b3947b2f10b None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:44.128747 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d3593-36d1-40f6-b5b9-41ef329f81d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:44.129385 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d3593-36d1-40f6-b5b9-41ef329f81d5 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:44.129671 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d3593-36d1-40f6-b5b9-41ef329f81d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:44.129949 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d3593-36d1-40f6-b5b9-41ef329f81d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:44.130805 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d3593-36d1-40f6-b5b9-41ef329f81d5 None admin] RBAC: Adding query filter params (role.id=d1698ed994954594a9c70a2580f34a85, scope.project.id=c75e3b6b026f4fe9874853759e673fd6, user.id=8cd08420291f4825bc1ee53760214ee0) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:44.131128 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d3593-36d1-40f6-b5b9-41ef329f81d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:44.132605 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d3593-36d1-40f6-b5b9-41ef329f81d5 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:44.139405 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 71/137] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:49:43 2022] GET /identity/v3/role_assignments?user.id=8cd08420291f4825bc1ee53760214ee0&scope.project.id=c75e3b6b026f4fe9874853759e673fd6&role.id=d1698ed994954594a9c70a2580f34a85 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:49:44.143761 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791d3cb-140f-4940-b513-94575bb42e89 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:44.144275 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791d3cb-140f-4940-b513-94575bb42e89 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:44.144348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791d3cb-140f-4940-b513-94575bb42e89 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:44.146086 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 67/138] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:44.152674 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f65569-254f-4922-a511-a5d6af34d179 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:44.152969 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f65569-254f-4922-a511-a5d6af34d179 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:44.153241 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f65569-254f-4922-a511-a5d6af34d179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:44.177440 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-45f65569-254f-4922-a511-a5d6af34d179 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:44.178749 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-45f65569-254f-4922-a511-a5d6af34d179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:44.235656 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:44.263540 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 72/139] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:49:44.311929 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791d3cb-140f-4940-b513-94575bb42e89 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:44.498597 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791d3cb-140f-4940-b513-94575bb42e89 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:44.551653 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc83254-181c-4bf8-a60d-33e421d31cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:44.552324 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc83254-181c-4bf8-a60d-33e421d31cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:44.552610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc83254-181c-4bf8-a60d-33e421d31cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:44.552886 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc83254-181c-4bf8-a60d-33e421d31cd2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:44.569727 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc83254-181c-4bf8-a60d-33e421d31cd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:49:44.574914 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-8fc83254-181c-4bf8-a60d-33e421d31cd2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:49:44.574914 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:49:44.574914 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:49:44.574914 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:49:44.574914 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:49:44.574914 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:49:44.574914 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:49:44.574914 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:49:44.574914 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:49:44.574914 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:49:44.574914 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:49:44.574914 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:49:44.574914 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:49:44.574914 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:49:44.574914 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:49:44.574914 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:49:44.575810 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:49:44.575810 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:49:44.575810 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:49:44.575810 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:49:44.575810 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:49:44.575810 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:49:44.575810 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:49:44.575810 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:49:44.575810 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:49:44.575810 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:49:44.575810 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:49:44.575810 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:49:44.575810 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:49:44.575810 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:49:44.575810 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:49:44.575810 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:49:44.577019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:49:44.577019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:49:44.577019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:49:44.577019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:49:44.577019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:49:44.577019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:49:44.577019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:49:44.577019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:49:44.577019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:49:44.577019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:49:44.577019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:49:44.577019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:49:44.577019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 68/140] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:49:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:49:44.583739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f65569-254f-4922-a511-a5d6af34d179 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:44.603050 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80aade-4e47-4ef7-8cc3-17ddc9a0386f None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:44.603050 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80aade-4e47-4ef7-8cc3-17ddc9a0386f None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:44.603050 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80aade-4e47-4ef7-8cc3-17ddc9a0386f None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:44.603050 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 69/141] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:44.612205 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af188268-5488-47cd-997d-9063e9e0f151 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:44.612492 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af188268-5488-47cd-997d-9063e9e0f151 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:44.612772 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af188268-5488-47cd-997d-9063e9e0f151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:44.653477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-af188268-5488-47cd-997d-9063e9e0f151 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:44.654836 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-af188268-5488-47cd-997d-9063e9e0f151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:44.690730 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:44.797430 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 70/142] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:49:44.799872 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f65569-254f-4922-a511-a5d6af34d179 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:44.842814 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af188268-5488-47cd-997d-9063e9e0f151 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:44.861882 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1fdc3-8340-48ca-a8ae-b4148e16a60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:44.862900 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1fdc3-8340-48ca-a8ae-b4148e16a60a None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:44.863375 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1fdc3-8340-48ca-a8ae-b4148e16a60a None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:44.863858 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1fdc3-8340-48ca-a8ae-b4148e16a60a None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:44.864792 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1fdc3-8340-48ca-a8ae-b4148e16a60a None admin] RBAC: Adding query filter params (name=member) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:44.865372 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1fdc3-8340-48ca-a8ae-b4148e16a60a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:44.866997 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1fdc3-8340-48ca-a8ae-b4148e16a60a None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:44.883561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 73/143] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 08:49:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:44.891253 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1fdc3-8340-48ca-a8ae-b4148e16a60a None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:44.947747 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:45.022168 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af188268-5488-47cd-997d-9063e9e0f151 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:45.055077 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1fdc3-8340-48ca-a8ae-b4148e16a60a None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:45.061486 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d063246-0ce7-4068-a962-d4fc8e6840ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:45.062488 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d063246-0ce7-4068-a962-d4fc8e6840ea None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:45.062972 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d063246-0ce7-4068-a962-d4fc8e6840ea None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:45.063550 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d063246-0ce7-4068-a962-d4fc8e6840ea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:45.076345 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d063246-0ce7-4068-a962-d4fc8e6840ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:49:45.082447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-0d063246-0ce7-4068-a962-d4fc8e6840ea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:49:45.082447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:49:45.082447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:49:45.082447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:49:45.082447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:49:45.082447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:49:45.082447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:49:45.082447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:49:45.082447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:49:45.082447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:49:45.082447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:49:45.082447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:49:45.082447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:49:45.082447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:49:45.082447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:49:45.082447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:49:45.083336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:49:45.083336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:49:45.083336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:49:45.083336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:49:45.083336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:49:45.083336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:49:45.083336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:49:45.083336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:49:45.083336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:49:45.083336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:49:45.083336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:49:45.083336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:49:45.083336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:49:45.083336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:49:45.083336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:49:45.083336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:49:45.084090 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:49:45.084090 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:49:45.084090 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:49:45.084090 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:49:45.084090 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:49:45.084090 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:49:45.084090 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:49:45.084090 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:49:45.084090 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:49:45.084090 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:49:45.084090 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:49:45.084090 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:49:45.087196 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 71/144] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 08:49:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:49:45.099496 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d063246-0ce7-4068-a962-d4fc8e6840ea None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:45.142347 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:45.142539 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c2a50-2ee3-4f46-9607-94edd418ec82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:45.142539 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c2a50-2ee3-4f46-9607-94edd418ec82 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:45.142539 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c2a50-2ee3-4f46-9607-94edd418ec82 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:45.142539 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c2a50-2ee3-4f46-9607-94edd418ec82 None admin] PATH_INFO: `/v3/users/d01f9e38b5a34766b5dd6418b0516320` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:45.142834 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c2a50-2ee3-4f46-9607-94edd418ec82 None admin] RBAC: Authorizing `identity:get_user(user_id=d01f9e38b5a34766b5dd6418b0516320)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:45.143252 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c2a50-2ee3-4f46-9607-94edd418ec82 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:45.145325 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 74/145] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:49:44 2022] GET /identity/v3/users/d01f9e38b5a34766b5dd6418b0516320 => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:49:45.155389 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c2a50-2ee3-4f46-9607-94edd418ec82 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:45.325684 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c2a50-2ee3-4f46-9607-94edd418ec82 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:45.358351 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:45.387457 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b473af-27cc-4014-93e0-f264a1b7c2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:45.388097 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b473af-27cc-4014-93e0-f264a1b7c2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:45.388377 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b473af-27cc-4014-93e0-f264a1b7c2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:45.388645 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b473af-27cc-4014-93e0-f264a1b7c2d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:45.425810 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d063246-0ce7-4068-a962-d4fc8e6840ea None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:45.505346 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b473af-27cc-4014-93e0-f264a1b7c2d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:45.507287 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b473af-27cc-4014-93e0-f264a1b7c2d1 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:45.603863 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99537fb2-1c94-47ad-adc5-3d2f9e216027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:45.604870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99537fb2-1c94-47ad-adc5-3d2f9e216027 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:45.605371 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99537fb2-1c94-47ad-adc5-3d2f9e216027 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:45.605841 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99537fb2-1c94-47ad-adc5-3d2f9e216027 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:45.606818 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99537fb2-1c94-47ad-adc5-3d2f9e216027 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:45.607345 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99537fb2-1c94-47ad-adc5-3d2f9e216027 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:45.608934 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99537fb2-1c94-47ad-adc5-3d2f9e216027 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:45.626486 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 72/146] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:49:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 528 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:45.644435 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99537fb2-1c94-47ad-adc5-3d2f9e216027 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:45.688440 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 75/147] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:49:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:45.694072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b473af-27cc-4014-93e0-f264a1b7c2d1 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:45.719135 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:45.794704 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:45.847847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99537fb2-1c94-47ad-adc5-3d2f9e216027 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:45.877500 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b473af-27cc-4014-93e0-f264a1b7c2d1 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:45.920443 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d392ceb-d3b8-467e-9131-7c792a8dd0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:45.921116 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d392ceb-d3b8-467e-9131-7c792a8dd0fe None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:45.921401 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d392ceb-d3b8-467e-9131-7c792a8dd0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:45.921681 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d392ceb-d3b8-467e-9131-7c792a8dd0fe None admin] PATH_INFO: `/v3/users/d01f9e38b5a34766b5dd6418b0516320` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:45.922955 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d392ceb-d3b8-467e-9131-7c792a8dd0fe None admin] RBAC: Authorizing `identity:get_user(user_id=d01f9e38b5a34766b5dd6418b0516320)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:45.924426 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d392ceb-d3b8-467e-9131-7c792a8dd0fe None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:45.926052 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 73/148] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:49:45 2022] GET /identity/v3/users/d01f9e38b5a34766b5dd6418b0516320 => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:49:45.927281 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24654523-7d78-49f4-8ff7-5bd676cbee44 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:45.927548 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24654523-7d78-49f4-8ff7-5bd676cbee44 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:45.927801 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24654523-7d78-49f4-8ff7-5bd676cbee44 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:45.929037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 74/149] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:45.938489 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24654523-7d78-49f4-8ff7-5bd676cbee44 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:45.956526 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80a5cb-f73f-4c9d-9032-600f1568ac3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:45.957216 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80a5cb-f73f-4c9d-9032-600f1568ac3f None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:45.957471 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80a5cb-f73f-4c9d-9032-600f1568ac3f None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:45.957746 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80a5cb-f73f-4c9d-9032-600f1568ac3f None admin] PATH_INFO: `/v3/projects/c75e3b6b026f4fe9874853759e673fd6` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:45.958965 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80a5cb-f73f-4c9d-9032-600f1568ac3f None admin] RBAC: Authorizing `identity:get_project(project_id=c75e3b6b026f4fe9874853759e673fd6)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:45.960442 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80a5cb-f73f-4c9d-9032-600f1568ac3f None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:45.963172 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 76/150] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:49:45 2022] GET /identity/v3/projects/c75e3b6b026f4fe9874853759e673fd6 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:49:45.964108 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec08d8-19ad-401e-bd3d-a539aacd0125 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:45.964393 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec08d8-19ad-401e-bd3d-a539aacd0125 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:45.964672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec08d8-19ad-401e-bd3d-a539aacd0125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:46.006578 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-3eec08d8-19ad-401e-bd3d-a539aacd0125 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:46.007841 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-3eec08d8-19ad-401e-bd3d-a539aacd0125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:46.111341 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 77/151] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:49:46.112276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec08d8-19ad-401e-bd3d-a539aacd0125 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:46.136524 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:46.158857 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24654523-7d78-49f4-8ff7-5bd676cbee44 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:46.221977 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce965e-d49d-4934-9717-be19e31de286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:46.223398 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce965e-d49d-4934-9717-be19e31de286 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:46.223840 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce965e-d49d-4934-9717-be19e31de286 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:46.224267 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce965e-d49d-4934-9717-be19e31de286 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:46.251398 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:46.288692 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec08d8-19ad-401e-bd3d-a539aacd0125 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:46.341294 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce965e-d49d-4934-9717-be19e31de286 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:46.343074 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce965e-d49d-4934-9717-be19e31de286 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:46.344118 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02695903-6650-442a-bbf9-dfcb70894372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:46.345119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02695903-6650-442a-bbf9-dfcb70894372 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:46.346132 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02695903-6650-442a-bbf9-dfcb70894372 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:46.347940 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02695903-6650-442a-bbf9-dfcb70894372 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:46.348947 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02695903-6650-442a-bbf9-dfcb70894372 None admin] RBAC: Adding query filter params (role.id=87d42817a302438b93da02bfed3f6781, scope.project.id=c75e3b6b026f4fe9874853759e673fd6, user.id=d01f9e38b5a34766b5dd6418b0516320) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:46.349615 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02695903-6650-442a-bbf9-dfcb70894372 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:46.352145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02695903-6650-442a-bbf9-dfcb70894372 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:46.365461 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 78/152] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:49:46 2022] GET /identity/v3/role_assignments?user.id=d01f9e38b5a34766b5dd6418b0516320&scope.project.id=c75e3b6b026f4fe9874853759e673fd6&role.id=87d42817a302438b93da02bfed3f6781 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:46.370829 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fe715-8cce-438b-bd2a-4de26509d010 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:46.370829 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fe715-8cce-438b-bd2a-4de26509d010 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:46.370829 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fe715-8cce-438b-bd2a-4de26509d010 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:46.371202 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 79/153] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:46.375414 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fe715-8cce-438b-bd2a-4de26509d010 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:46.504582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:46.559924 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fe715-8cce-438b-bd2a-4de26509d010 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:46.594945 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 75/154] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:49:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:46.597335 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832d929-8c02-4690-b96c-0f64bd0813f2 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:46.597821 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832d929-8c02-4690-b96c-0f64bd0813f2 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:46.598350 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832d929-8c02-4690-b96c-0f64bd0813f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:46.620783 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9134fb0-0398-4682-8d3d-a643572f032e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:46.621861 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9134fb0-0398-4682-8d3d-a643572f032e None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:46.622285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9134fb0-0398-4682-8d3d-a643572f032e None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:46.622737 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9134fb0-0398-4682-8d3d-a643572f032e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:46.625024 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9134fb0-0398-4682-8d3d-a643572f032e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:46.626724 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9134fb0-0398-4682-8d3d-a643572f032e None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:46.628740 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 80/155] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:49:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:46.629656 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-d832d929-8c02-4690-b96c-0f64bd0813f2 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:46.629830 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9134fb0-0398-4682-8d3d-a643572f032e None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:46.631454 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d832d929-8c02-4690-b96c-0f64bd0813f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:46.683686 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:46.734139 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 76/156] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:49:46.735295 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832d929-8c02-4690-b96c-0f64bd0813f2 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:46.756738 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9134fb0-0398-4682-8d3d-a643572f032e None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:46.810893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddf3a6-7641-460f-88b6-f09aa4ae89cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:46.812295 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddf3a6-7641-460f-88b6-f09aa4ae89cc None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:46.812646 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddf3a6-7641-460f-88b6-f09aa4ae89cc None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:46.812939 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddf3a6-7641-460f-88b6-f09aa4ae89cc None admin] PATH_INFO: `/v3/projects/c75e3b6b026f4fe9874853759e673fd6` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:46.814311 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ddf3a6-7641-460f-88b6-f09aa4ae89cc None admin] RBAC: Authorizing `identity:get_project(project_id=c75e3b6b026f4fe9874853759e673fd6)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:46.817010 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ddf3a6-7641-460f-88b6-f09aa4ae89cc None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:46.819862 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 81/157] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:49:46 2022] GET /identity/v3/projects/c75e3b6b026f4fe9874853759e673fd6 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:46.820908 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddf3a6-7641-460f-88b6-f09aa4ae89cc None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:46.847774 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:46.885178 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832d929-8c02-4690-b96c-0f64bd0813f2 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:46.925108 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331ced4-843b-4f66-a25d-5d78f148b551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:46.925912 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331ced4-843b-4f66-a25d-5d78f148b551 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:46.926158 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331ced4-843b-4f66-a25d-5d78f148b551 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:46.926456 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331ced4-843b-4f66-a25d-5d78f148b551 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:46.927173 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331ced4-843b-4f66-a25d-5d78f148b551 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:46.928718 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331ced4-843b-4f66-a25d-5d78f148b551 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:46.955426 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddf3a6-7641-460f-88b6-f09aa4ae89cc None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:46.957989 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 77/158] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 08:49:46 2022] POST /identity/v3/users => generated 283 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:49:46.958942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331ced4-843b-4f66-a25d-5d78f148b551 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:46.993934 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:47.005157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f75b3-bfb7-4fa9-89d1-9964802b771a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:47.006658 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f75b3-bfb7-4fa9-89d1-9964802b771a None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:47.007161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f75b3-bfb7-4fa9-89d1-9964802b771a None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:47.007601 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f75b3-bfb7-4fa9-89d1-9964802b771a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:47.026571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f75b3-bfb7-4fa9-89d1-9964802b771a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:49:47.033475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-fb9f75b3-bfb7-4fa9-89d1-9964802b771a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:49:47.033475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:49:47.033475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:49:47.033475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:49:47.033475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:49:47.033475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:49:47.033475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:49:47.033475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:49:47.033475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:49:47.033475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:49:47.033475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:49:47.033475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:49:47.033475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:49:47.033475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:49:47.033475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:49:47.033475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:49:47.034639 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:49:47.034639 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:49:47.034639 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:49:47.034639 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:49:47.034639 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:49:47.034639 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:49:47.034639 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:49:47.034639 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:49:47.034639 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:49:47.034639 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:49:47.034639 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:49:47.034639 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:49:47.034639 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:49:47.034639 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:49:47.034639 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:49:47.034639 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:49:47.035577 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:49:47.035577 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:49:47.035577 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:49:47.035577 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:49:47.035577 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:49:47.035577 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:49:47.035577 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:49:47.035577 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:49:47.035577 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:49:47.035577 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:49:47.035577 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:49:47.035577 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:49:47.037683 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 82/159] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:49:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:49:47.039363 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac593337-7991-4f87-91aa-ef49b372309b None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:47.039816 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac593337-7991-4f87-91aa-ef49b372309b None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:47.040415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac593337-7991-4f87-91aa-ef49b372309b None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:47.045994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 83/160] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:47.047670 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac593337-7991-4f87-91aa-ef49b372309b None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:47.095299 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331ced4-843b-4f66-a25d-5d78f148b551 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:47.148558 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:47.155096 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be4c02-5afb-4ba4-b04c-cb56e485df38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:47.156042 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be4c02-5afb-4ba4-b04c-cb56e485df38 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:47.156544 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be4c02-5afb-4ba4-b04c-cb56e485df38 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:47.157167 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be4c02-5afb-4ba4-b04c-cb56e485df38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:47.158071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be4c02-5afb-4ba4-b04c-cb56e485df38 None admin] RBAC: Adding query filter params (role.id=07fbbf1ea87a40f791466f0c934b4183, scope.project.id=c75e3b6b026f4fe9874853759e673fd6, user.id=d01f9e38b5a34766b5dd6418b0516320) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:47.158502 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be4c02-5afb-4ba4-b04c-cb56e485df38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:47.160670 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be4c02-5afb-4ba4-b04c-cb56e485df38 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:47.168346 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 78/161] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:49:46 2022] GET /identity/v3/role_assignments?user.id=d01f9e38b5a34766b5dd6418b0516320&scope.project.id=c75e3b6b026f4fe9874853759e673fd6&role.id=07fbbf1ea87a40f791466f0c934b4183 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:47.170234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbcac1-ad3f-458d-90a7-86dbcfa7f8f0 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:47.170234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbcac1-ad3f-458d-90a7-86dbcfa7f8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:47.170234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbcac1-ad3f-458d-90a7-86dbcfa7f8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:47.190161 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-a7cbcac1-ad3f-458d-90a7-86dbcfa7f8f0 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:47.191603 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a7cbcac1-ad3f-458d-90a7-86dbcfa7f8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:47.194827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac593337-7991-4f87-91aa-ef49b372309b None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:47.257775 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee08d1-7880-43a0-91d3-f5e6c5bede40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:47.260141 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee08d1-7880-43a0-91d3-f5e6c5bede40 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:47.260910 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee08d1-7880-43a0-91d3-f5e6c5bede40 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:47.261442 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee08d1-7880-43a0-91d3-f5e6c5bede40 None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:47.262958 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee08d1-7880-43a0-91d3-f5e6c5bede40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:47.263582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee08d1-7880-43a0-91d3-f5e6c5bede40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:47.266021 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee08d1-7880-43a0-91d3-f5e6c5bede40 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:47.282221 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 84/162] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:49:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:47.285033 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 79/163] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:49:47.285418 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9c8f0-8702-41e7-9a9b-86ed2307d132 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:47.285954 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9c8f0-8702-41e7-9a9b-86ed2307d132 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:47.286482 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9c8f0-8702-41e7-9a9b-86ed2307d132 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:47.288047 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 85/164] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:47.291442 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbcac1-ad3f-458d-90a7-86dbcfa7f8f0 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:47.296066 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73899fe4-6bfb-4004-9ba2-7825dc5ddca8 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:47.296393 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73899fe4-6bfb-4004-9ba2-7825dc5ddca8 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:47.298570 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73899fe4-6bfb-4004-9ba2-7825dc5ddca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:47.319560 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-73899fe4-6bfb-4004-9ba2-7825dc5ddca8 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:47.321476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-73899fe4-6bfb-4004-9ba2-7825dc5ddca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:47.327247 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:47.419812 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 86/165] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:49:47.421103 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73899fe4-6bfb-4004-9ba2-7825dc5ddca8 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:47.430107 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbcac1-ad3f-458d-90a7-86dbcfa7f8f0 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:47.478498 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ab6ee-c520-4011-a3dc-b3bc71159fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:47.479164 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ab6ee-c520-4011-a3dc-b3bc71159fae None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:47.479448 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ab6ee-c520-4011-a3dc-b3bc71159fae None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:47.479837 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ab6ee-c520-4011-a3dc-b3bc71159fae None admin] PATH_INFO: `/v3/users/3e18e0dcebec4953bb7ade2050d92c39` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:47.481062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ab6ee-c520-4011-a3dc-b3bc71159fae None admin] RBAC: Authorizing `identity:get_user(user_id=3e18e0dcebec4953bb7ade2050d92c39)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:47.482694 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ab6ee-c520-4011-a3dc-b3bc71159fae None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:47.484753 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 80/166] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:49:47 2022] GET /identity/v3/users/3e18e0dcebec4953bb7ade2050d92c39 => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:47.485551 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ab6ee-c520-4011-a3dc-b3bc71159fae None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:47.507474 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:47.566935 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73899fe4-6bfb-4004-9ba2-7825dc5ddca8 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:47.612529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:47.617820 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9928870-0c14-4870-9cd7-0bab444a7fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:47.618829 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9928870-0c14-4870-9cd7-0bab444a7fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:47.619312 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9928870-0c14-4870-9cd7-0bab444a7fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:47.619803 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9928870-0c14-4870-9cd7-0bab444a7fa2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:47.624984 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ab6ee-c520-4011-a3dc-b3bc71159fae None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:47.632535 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9928870-0c14-4870-9cd7-0bab444a7fa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:49:47.638448 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-c9928870-0c14-4870-9cd7-0bab444a7fa2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:49:47.638448 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:49:47.638448 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:49:47.638448 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:49:47.638448 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:49:47.638448 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:49:47.638448 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:49:47.638448 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:49:47.638448 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:49:47.638448 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:49:47.638448 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:49:47.638448 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:49:47.638448 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:49:47.638448 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:49:47.638448 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:49:47.638448 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:49:47.639431 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:49:47.639431 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:49:47.639431 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:49:47.639431 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:49:47.639431 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:49:47.639431 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:49:47.639431 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:49:47.639431 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:49:47.639431 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:49:47.639431 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:49:47.639431 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:49:47.639431 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:49:47.639431 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:49:47.639431 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:49:47.639431 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:49:47.639431 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:49:47.640449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:49:47.640449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:49:47.640449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:49:47.640449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:49:47.640449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:49:47.640449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:49:47.640449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:49:47.640449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:49:47.640449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:49:47.640449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:49:47.640449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:49:47.640449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:49:47.643377 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 87/167] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:49:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:49:47.644762 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9928870-0c14-4870-9cd7-0bab444a7fa2 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:47.674562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b3713-2c25-477d-9acd-865fd40a1ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:47.675221 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b3713-2c25-477d-9acd-865fd40a1ddc None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:47.675507 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b3713-2c25-477d-9acd-865fd40a1ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:47.675784 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b3713-2c25-477d-9acd-865fd40a1ddc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:47.688713 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b3713-2c25-477d-9acd-865fd40a1ddc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:49:47.694249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-de6b3713-2c25-477d-9acd-865fd40a1ddc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:49:47.694249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:49:47.694249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:49:47.694249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:49:47.694249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:49:47.694249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:49:47.694249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:49:47.694249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:49:47.694249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:49:47.694249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:49:47.694249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:49:47.694249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:49:47.694249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:49:47.694249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:49:47.694249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:49:47.694249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:49:47.695228 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:49:47.695228 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:49:47.695228 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:49:47.695228 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:49:47.695228 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:49:47.695228 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:49:47.695228 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:49:47.695228 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:49:47.695228 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:49:47.695228 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:49:47.695228 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:49:47.695228 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:49:47.695228 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:49:47.695228 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:49:47.695228 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:49:47.695228 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:49:47.696596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:49:47.696596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:49:47.696596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:49:47.696596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:49:47.696596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:49:47.696596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:49:47.696596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:49:47.696596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:49:47.696596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:49:47.696596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:49:47.696596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:49:47.696596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:49:47.696596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 81/168] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:49:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:49:47.697253 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b3713-2c25-477d-9acd-865fd40a1ddc None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:47.793284 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9928870-0c14-4870-9cd7-0bab444a7fa2 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:47.823728 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b3713-2c25-477d-9acd-865fd40a1ddc None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:47.833293 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:47.858878 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c156899-ca45-40b8-a621-25bbeabd4e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:47.859673 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c156899-ca45-40b8-a621-25bbeabd4e1a None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:47.860110 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c156899-ca45-40b8-a621-25bbeabd4e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:47.860481 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c156899-ca45-40b8-a621-25bbeabd4e1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:47.864126 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235096c-5aa9-425a-a1aa-b5a0279011e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:47.865110 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235096c-5aa9-425a-a1aa-b5a0279011e4 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:47.865570 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235096c-5aa9-425a-a1aa-b5a0279011e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:47.866021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235096c-5aa9-425a-a1aa-b5a0279011e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:47.866984 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235096c-5aa9-425a-a1aa-b5a0279011e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:47.867739 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235096c-5aa9-425a-a1aa-b5a0279011e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:47.869432 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235096c-5aa9-425a-a1aa-b5a0279011e4 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:47.878746 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 82/169] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 08:49:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:47.879898 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235096c-5aa9-425a-a1aa-b5a0279011e4 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:47.898935 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:47.971018 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c156899-ca45-40b8-a621-25bbeabd4e1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:47.972967 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c156899-ca45-40b8-a621-25bbeabd4e1a None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:48.023602 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235096c-5aa9-425a-a1aa-b5a0279011e4 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:48.059972 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7309f-013e-4578-990d-f8569171c6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:48.060607 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7309f-013e-4578-990d-f8569171c6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:48.060893 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7309f-013e-4578-990d-f8569171c6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:48.061173 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7309f-013e-4578-990d-f8569171c6f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:48.066350 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7309f-013e-4578-990d-f8569171c6f1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:48.066350 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7309f-013e-4578-990d-f8569171c6f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:48.066350 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7309f-013e-4578-990d-f8569171c6f1 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:48.078414 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 83/170] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 08:49:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:48.078414 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7309f-013e-4578-990d-f8569171c6f1 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:48.207775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:48.229093 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 88/171] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:49:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:48.229971 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c156899-ca45-40b8-a621-25bbeabd4e1a None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:48.233465 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7309f-013e-4578-990d-f8569171c6f1 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:48.280371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:48.287283 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25835a-0523-4d61-9de5-a47d85ddff18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:48.287946 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25835a-0523-4d61-9de5-a47d85ddff18 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:48.288231 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25835a-0523-4d61-9de5-a47d85ddff18 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:48.288510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25835a-0523-4d61-9de5-a47d85ddff18 None admin] PATH_INFO: `/v3/users/d01f9e38b5a34766b5dd6418b0516320` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:48.290540 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25835a-0523-4d61-9de5-a47d85ddff18 None admin] RBAC: Authorizing `identity:get_user(user_id=d01f9e38b5a34766b5dd6418b0516320)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:48.292023 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25835a-0523-4d61-9de5-a47d85ddff18 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:48.293661 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 84/172] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:49:48 2022] GET /identity/v3/users/d01f9e38b5a34766b5dd6418b0516320 => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:48.300018 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25835a-0523-4d61-9de5-a47d85ddff18 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:48.413085 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25835a-0523-4d61-9de5-a47d85ddff18 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:48.449838 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468db051-811e-42fd-bfdb-b45d6a761b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:48.450550 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468db051-811e-42fd-bfdb-b45d6a761b74 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:48.450887 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468db051-811e-42fd-bfdb-b45d6a761b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:48.451171 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468db051-811e-42fd-bfdb-b45d6a761b74 None admin] PATH_INFO: `/v3/projects/c75e3b6b026f4fe9874853759e673fd6` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:48.452364 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468db051-811e-42fd-bfdb-b45d6a761b74 None admin] RBAC: Authorizing `identity:get_project(project_id=c75e3b6b026f4fe9874853759e673fd6)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:48.453832 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468db051-811e-42fd-bfdb-b45d6a761b74 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:48.462435 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 85/173] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:49:48 2022] GET /identity/v3/projects/c75e3b6b026f4fe9874853759e673fd6 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:48.462435 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468db051-811e-42fd-bfdb-b45d6a761b74 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:48.473214 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:48.536254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c156899-ca45-40b8-a621-25bbeabd4e1a None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:48.570290 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468db051-811e-42fd-bfdb-b45d6a761b74 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:48.607621 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc9be8-cbc2-484b-a81a-424a8c1a8323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:48.608252 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc9be8-cbc2-484b-a81a-424a8c1a8323 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:48.608541 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc9be8-cbc2-484b-a81a-424a8c1a8323 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:48.608865 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc9be8-cbc2-484b-a81a-424a8c1a8323 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:48.651760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f88ddf-092e-4047-9873-41a14044ef2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:48.653395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f88ddf-092e-4047-9873-41a14044ef2b None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:48.654182 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f88ddf-092e-4047-9873-41a14044ef2b None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:48.654949 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f88ddf-092e-4047-9873-41a14044ef2b None admin] PATH_INFO: `/v3/users/8cd08420291f4825bc1ee53760214ee0` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:48.663279 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f88ddf-092e-4047-9873-41a14044ef2b None admin] RBAC: Authorizing `identity:get_user(user_id=8cd08420291f4825bc1ee53760214ee0)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:48.666332 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f88ddf-092e-4047-9873-41a14044ef2b None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:48.668294 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 89/174] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:49:48 2022] GET /identity/v3/users/8cd08420291f4825bc1ee53760214ee0 => generated 289 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:48.669313 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f88ddf-092e-4047-9873-41a14044ef2b None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:48.690367 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc9be8-cbc2-484b-a81a-424a8c1a8323 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:48.690367 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc9be8-cbc2-484b-a81a-424a8c1a8323 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:48.702718 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:48.861859 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:48.863346 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 86/175] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:49:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:48.864234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc9be8-cbc2-484b-a81a-424a8c1a8323 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:48.881871 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f88ddf-092e-4047-9873-41a14044ef2b None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:48.959197 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063cf980-199f-4951-999f-daee7defaa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:48.960183 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cf980-199f-4951-999f-daee7defaa69 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:48.960658 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cf980-199f-4951-999f-daee7defaa69 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:48.961232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cf980-199f-4951-999f-daee7defaa69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:48.962732 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063cf980-199f-4951-999f-daee7defaa69 None admin] RBAC: Adding query filter params (role.id=20bc872844094480b9dca67a25b69e84, scope.project.id=c75e3b6b026f4fe9874853759e673fd6, user.id=3e18e0dcebec4953bb7ade2050d92c39) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:48.963266 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063cf980-199f-4951-999f-daee7defaa69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:48.964925 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063cf980-199f-4951-999f-daee7defaa69 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:48.975133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 90/176] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:49:48 2022] GET /identity/v3/role_assignments?user.id=3e18e0dcebec4953bb7ade2050d92c39&scope.project.id=c75e3b6b026f4fe9874853759e673fd6&role.id=20bc872844094480b9dca67a25b69e84 => generated 608 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:48.976242 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063cf980-199f-4951-999f-daee7defaa69 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:49.012417 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc9be8-cbc2-484b-a81a-424a8c1a8323 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:49.033934 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:49.053658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74dd67e-3787-45f5-b072-33f007d28669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:49.054418 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74dd67e-3787-45f5-b072-33f007d28669 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:49.055226 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74dd67e-3787-45f5-b072-33f007d28669 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:49.055718 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74dd67e-3787-45f5-b072-33f007d28669 None admin] PATH_INFO: `/v3/projects/c75e3b6b026f4fe9874853759e673fd6` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:49.057155 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74dd67e-3787-45f5-b072-33f007d28669 None admin] RBAC: Authorizing `identity:get_project(project_id=c75e3b6b026f4fe9874853759e673fd6)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:49.058826 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74dd67e-3787-45f5-b072-33f007d28669 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:49.060958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 87/177] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:49:48 2022] GET /identity/v3/projects/c75e3b6b026f4fe9874853759e673fd6 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:49.067389 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74dd67e-3787-45f5-b072-33f007d28669 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:49.204532 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74dd67e-3787-45f5-b072-33f007d28669 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:49.252989 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7ca65-7d40-4d0c-aecd-8e1d46fb877c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:49.254645 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7ca65-7d40-4d0c-aecd-8e1d46fb877c None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:49.254931 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7ca65-7d40-4d0c-aecd-8e1d46fb877c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:49.255211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7ca65-7d40-4d0c-aecd-8e1d46fb877c None admin] PATH_INFO: `/v3/projects/c75e3b6b026f4fe9874853759e673fd6/users/8cd08420291f4825bc1ee53760214ee0/roles/d1698ed994954594a9c70a2580f34a85` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:49.263341 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7ca65-7d40-4d0c-aecd-8e1d46fb877c None admin] RBAC: Authorizing `identity:create_grant(project_id=c75e3b6b026f4fe9874853759e673fd6, user_id=8cd08420291f4825bc1ee53760214ee0, role_id=d1698ed994954594a9c70a2580f34a85)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:49.265175 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7ca65-7d40-4d0c-aecd-8e1d46fb877c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:49.278520 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063cf980-199f-4951-999f-daee7defaa69 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:49.289406 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 88/178] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 08:49:49 2022] PUT /identity/v3/projects/c75e3b6b026f4fe9874853759e673fd6/users/8cd08420291f4825bc1ee53760214ee0/roles/d1698ed994954594a9c70a2580f34a85 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:49:49.328577 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50d016-2579-4058-9c6e-4d3850d4a320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:49.329358 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50d016-2579-4058-9c6e-4d3850d4a320 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:49.329648 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50d016-2579-4058-9c6e-4d3850d4a320 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:49.329981 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50d016-2579-4058-9c6e-4d3850d4a320 None admin] PATH_INFO: `/v3/projects/72394fbb315448a09ffaf744734203f3` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:49.331539 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50d016-2579-4058-9c6e-4d3850d4a320 None admin] RBAC: Authorizing `identity:get_project(project_id=72394fbb315448a09ffaf744734203f3)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:49.333251 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50d016-2579-4058-9c6e-4d3850d4a320 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:49.335270 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 91/179] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:49:48 2022] GET /identity/v3/projects/72394fbb315448a09ffaf744734203f3 => generated 312 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:49.342108 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7ca65-7d40-4d0c-aecd-8e1d46fb877c None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:49.416643 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:49.502796 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7ca65-7d40-4d0c-aecd-8e1d46fb877c None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:49.544882 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765879c8-2bd3-4271-abcb-b5b55c28f93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:49.545826 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765879c8-2bd3-4271-abcb-b5b55c28f93e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:49.546241 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765879c8-2bd3-4271-abcb-b5b55c28f93e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:49.546692 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765879c8-2bd3-4271-abcb-b5b55c28f93e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:49.547658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765879c8-2bd3-4271-abcb-b5b55c28f93e None admin] RBAC: Adding query filter params (role.id=87d42817a302438b93da02bfed3f6781, scope.project.id=72394fbb315448a09ffaf744734203f3, user.id=d01f9e38b5a34766b5dd6418b0516320) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:49.548108 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765879c8-2bd3-4271-abcb-b5b55c28f93e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:49.549699 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765879c8-2bd3-4271-abcb-b5b55c28f93e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:49.560135 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 89/180] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:49:49 2022] GET /identity/v3/role_assignments?user.id=d01f9e38b5a34766b5dd6418b0516320&scope.project.id=72394fbb315448a09ffaf744734203f3&role.id=87d42817a302438b93da02bfed3f6781 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:49.772941 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1ed13-73c9-4f21-aa61-0a0d4b4a6c7e None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:49.773236 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1ed13-73c9-4f21-aa61-0a0d4b4a6c7e None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:49.774047 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1ed13-73c9-4f21-aa61-0a0d4b4a6c7e None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:49.775751 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 92/181] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:49.781623 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9786d0b-f368-41e7-b9e0-d3701b6e9649 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:49.782572 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9786d0b-f368-41e7-b9e0-d3701b6e9649 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:49.783069 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9786d0b-f368-41e7-b9e0-d3701b6e9649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:49.804550 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-e9786d0b-f368-41e7-b9e0-d3701b6e9649 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:49.806154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e9786d0b-f368-41e7-b9e0-d3701b6e9649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:49.890417 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 90/182] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:49:49.916630 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1ed13-73c9-4f21-aa61-0a0d4b4a6c7e None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:49.943508 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:49.948475 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b4ef1-f1a2-4f1e-9acf-c77804875493 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:49.948759 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b4ef1-f1a2-4f1e-9acf-c77804875493 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:49.949023 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b4ef1-f1a2-4f1e-9acf-c77804875493 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:49.950579 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 91/183] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:49.957330 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3917c-0636-4506-83d1-99e29d459974 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:49.957665 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3917c-0636-4506-83d1-99e29d459974 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:49.957867 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3917c-0636-4506-83d1-99e29d459974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:49.981986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-faf3917c-0636-4506-83d1-99e29d459974 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:49.983600 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-faf3917c-0636-4506-83d1-99e29d459974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:50.028360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:50.056733 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1ed13-73c9-4f21-aa61-0a0d4b4a6c7e None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:50.083247 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 92/184] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:49:50.094607 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226e677-d906-4161-9d89-3e258486f3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:50.095258 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226e677-d906-4161-9d89-3e258486f3fe None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:50.095538 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226e677-d906-4161-9d89-3e258486f3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:50.095809 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226e677-d906-4161-9d89-3e258486f3fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:50.108553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226e677-d906-4161-9d89-3e258486f3fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:49:50.110647 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3917c-0636-4506-83d1-99e29d459974 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:50.115486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-5226e677-d906-4161-9d89-3e258486f3fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:49:50.115486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:49:50.115486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:49:50.115486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:49:50.115486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:49:50.115486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:49:50.115486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:49:50.115486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:49:50.115486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:49:50.115486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:49:50.115486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:49:50.115486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:49:50.115486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:49:50.115486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:49:50.115486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:49:50.115486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:49:50.116415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:49:50.116415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:49:50.116415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:49:50.116415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:49:50.116415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:49:50.116415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:49:50.116415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:49:50.116415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:49:50.116415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:49:50.116415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:49:50.116415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:49:50.116415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:49:50.116415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:49:50.116415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:49:50.116415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:49:50.116415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:49:50.117197 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:49:50.117197 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:49:50.117197 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:49:50.117197 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:49:50.117197 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:49:50.117197 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:49:50.117197 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:49:50.117197 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:49:50.117197 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:49:50.117197 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:49:50.117197 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:49:50.117197 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:49:50.118546 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 93/185] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:49:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:49:50.125042 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226e677-d906-4161-9d89-3e258486f3fe None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:50.229632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:50.247043 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3917c-0636-4506-83d1-99e29d459974 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:50.251696 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226e677-d906-4161-9d89-3e258486f3fe None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:50.292427 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86509dce-08ee-4fe6-b9bf-d425ff9c2c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:50.292740 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd2983-7357-4778-ab6b-5a97c1a1fbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:50.293421 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86509dce-08ee-4fe6-b9bf-d425ff9c2c7a None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:50.293421 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86509dce-08ee-4fe6-b9bf-d425ff9c2c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:50.293666 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd2983-7357-4778-ab6b-5a97c1a1fbe0 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:50.293807 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86509dce-08ee-4fe6-b9bf-d425ff9c2c7a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:50.293937 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd2983-7357-4778-ab6b-5a97c1a1fbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:50.294403 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd2983-7357-4778-ab6b-5a97c1a1fbe0 None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:50.295352 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd2983-7357-4778-ab6b-5a97c1a1fbe0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:50.295915 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd2983-7357-4778-ab6b-5a97c1a1fbe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:50.297888 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd2983-7357-4778-ab6b-5a97c1a1fbe0 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:50.306463 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86509dce-08ee-4fe6-b9bf-d425ff9c2c7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:49:50.313780 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 94/186] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:49:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:49:50.313780 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab906e3-e540-499e-9bfe-c6f5dc2fb907 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:50.313780 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab906e3-e540-499e-9bfe-c6f5dc2fb907 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:50.313780 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab906e3-e540-499e-9bfe-c6f5dc2fb907 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:50.314121 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-86509dce-08ee-4fe6-b9bf-d425ff9c2c7a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:49:50.314121 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:49:50.314121 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:49:50.314121 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:49:50.314121 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:49:50.314121 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:49:50.314121 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:49:50.314121 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:49:50.314121 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:49:50.314121 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:49:50.314121 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:49:50.314121 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:49:50.314121 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:49:50.314121 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:49:50.314121 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:49:50.314121 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:49:50.315201 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:49:50.315201 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:49:50.315201 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:49:50.315201 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:49:50.315201 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:49:50.315201 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:49:50.315201 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:49:50.315201 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:49:50.315201 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:49:50.315201 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:49:50.315201 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:49:50.315201 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:49:50.315201 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:49:50.315201 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:49:50.315201 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:49:50.315201 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:49:50.315969 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:49:50.315969 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:49:50.315969 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:49:50.315969 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:49:50.315969 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:49:50.315969 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:49:50.315969 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:49:50.315969 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:49:50.315969 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:49:50.315969 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:49:50.315969 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:49:50.315969 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:49:50.316554 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 95/187] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:50.316619 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 93/188] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 08:49:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:49:50.318197 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab906e3-e540-499e-9bfe-c6f5dc2fb907 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:50.318847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846a640-ed9d-4304-a316-51623fa67bc2 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:50.319134 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846a640-ed9d-4304-a316-51623fa67bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:50.319413 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846a640-ed9d-4304-a316-51623fa67bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:50.344425 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-d846a640-ed9d-4304-a316-51623fa67bc2 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:50.345643 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d846a640-ed9d-4304-a316-51623fa67bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:50.365833 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:50.440596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 94/189] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:49:50.443550 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846a640-ed9d-4304-a316-51623fa67bc2 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:50.454585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab906e3-e540-499e-9bfe-c6f5dc2fb907 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:50.494078 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e62508-cc57-4eeb-b510-993b5f5395be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:50.495139 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e62508-cc57-4eeb-b510-993b5f5395be None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:50.495556 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e62508-cc57-4eeb-b510-993b5f5395be None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:50.495959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e62508-cc57-4eeb-b510-993b5f5395be None admin] PATH_INFO: `/v3/users/68c7d37760e545148c612bb8db15da6b` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:50.514034 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e62508-cc57-4eeb-b510-993b5f5395be None admin] RBAC: Authorizing `identity:get_user(user_id=68c7d37760e545148c612bb8db15da6b)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:50.515807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e62508-cc57-4eeb-b510-993b5f5395be None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:50.517732 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 96/190] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:49:50 2022] GET /identity/v3/users/68c7d37760e545148c612bb8db15da6b => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:50.518769 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e62508-cc57-4eeb-b510-993b5f5395be None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:50.521791 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:50.589588 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846a640-ed9d-4304-a316-51623fa67bc2 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:50.630367 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f05038-afaa-47dc-b4d4-21d65897b829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:50.630973 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f05038-afaa-47dc-b4d4-21d65897b829 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:50.631248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f05038-afaa-47dc-b4d4-21d65897b829 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:50.631514 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f05038-afaa-47dc-b4d4-21d65897b829 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:50.632259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f05038-afaa-47dc-b4d4-21d65897b829 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:50.632564 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f05038-afaa-47dc-b4d4-21d65897b829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:50.634547 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f05038-afaa-47dc-b4d4-21d65897b829 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:50.644843 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 95/191] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:49:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:50.651937 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f05038-afaa-47dc-b4d4-21d65897b829 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:50.673649 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:50.678717 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e62508-cc57-4eeb-b510-993b5f5395be None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:50.741840 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056e01a-46b8-4c58-951d-55649ea9a396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:50.743750 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056e01a-46b8-4c58-951d-55649ea9a396 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:50.744200 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056e01a-46b8-4c58-951d-55649ea9a396 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:50.745447 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056e01a-46b8-4c58-951d-55649ea9a396 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:50.747485 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a056e01a-46b8-4c58-951d-55649ea9a396 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:50.749994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a056e01a-46b8-4c58-951d-55649ea9a396 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:50.760902 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 97/192] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:49:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:50.760902 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056e01a-46b8-4c58-951d-55649ea9a396 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:50.792117 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f05038-afaa-47dc-b4d4-21d65897b829 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:50.836957 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ded129-1231-4bc5-a8b7-84c085949800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:50.837816 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ded129-1231-4bc5-a8b7-84c085949800 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:50.838238 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ded129-1231-4bc5-a8b7-84c085949800 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:50.838668 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ded129-1231-4bc5-a8b7-84c085949800 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:50.893343 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:50.949412 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ded129-1231-4bc5-a8b7-84c085949800 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:50.952206 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ded129-1231-4bc5-a8b7-84c085949800 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:50.952523 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056e01a-46b8-4c58-951d-55649ea9a396 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:50.982224 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:51.026831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1b683-ad98-4e87-9a8d-e5f6d8b62745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:51.027930 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1b683-ad98-4e87-9a8d-e5f6d8b62745 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:51.028413 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1b683-ad98-4e87-9a8d-e5f6d8b62745 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:51.028855 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1b683-ad98-4e87-9a8d-e5f6d8b62745 None admin] PATH_INFO: `/v3/users/68c7d37760e545148c612bb8db15da6b` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:51.030751 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1b683-ad98-4e87-9a8d-e5f6d8b62745 None admin] RBAC: Authorizing `identity:get_user(user_id=68c7d37760e545148c612bb8db15da6b)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:51.032983 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1b683-ad98-4e87-9a8d-e5f6d8b62745 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:51.035560 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 98/193] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:49:50 2022] GET /identity/v3/users/68c7d37760e545148c612bb8db15da6b => generated 283 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:51.036690 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1b683-ad98-4e87-9a8d-e5f6d8b62745 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:51.129794 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 96/194] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:49:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:51.129794 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ded129-1231-4bc5-a8b7-84c085949800 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:51.179002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1b683-ad98-4e87-9a8d-e5f6d8b62745 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:51.240222 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3bd29-d924-4358-9c1b-b4da3efe92e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:51.241131 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3bd29-d924-4358-9c1b-b4da3efe92e9 None admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:51.241579 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3bd29-d924-4358-9c1b-b4da3efe92e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:51.242039 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3bd29-d924-4358-9c1b-b4da3efe92e9 None admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:51.244079 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3bd29-d924-4358-9c1b-b4da3efe92e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:51.245760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3bd29-d924-4358-9c1b-b4da3efe92e9 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:51.261752 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:51.281381 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 99/195] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 08:49:51 2022] POST /identity/v3/users => generated 297 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:49:51.285013 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3bd29-d924-4358-9c1b-b4da3efe92e9 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:51.309168 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ded129-1231-4bc5-a8b7-84c085949800 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:51.343139 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:51.386444 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7c808-7bc3-4f58-bcfa-b91fa29e7b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:51.387664 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7c808-7bc3-4f58-bcfa-b91fa29e7b5a None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:51.388165 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7c808-7bc3-4f58-bcfa-b91fa29e7b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:51.388721 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7c808-7bc3-4f58-bcfa-b91fa29e7b5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:51.531792 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3bd29-d924-4358-9c1b-b4da3efe92e9 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:51.536742 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7c808-7bc3-4f58-bcfa-b91fa29e7b5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:51.540064 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7c808-7bc3-4f58-bcfa-b91fa29e7b5a None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:51.600803 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ca7df-978d-48f0-be63-217a484fe633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:51.602444 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ca7df-978d-48f0-be63-217a484fe633 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:51.602937 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ca7df-978d-48f0-be63-217a484fe633 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:51.603396 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ca7df-978d-48f0-be63-217a484fe633 None admin] PATH_INFO: `/v3/projects/0601c68bf9ab41768a485e3991efe411` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:51.605459 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ca7df-978d-48f0-be63-217a484fe633 None admin] RBAC: Authorizing `identity:get_project(project_id=0601c68bf9ab41768a485e3991efe411)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:51.608687 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ca7df-978d-48f0-be63-217a484fe633 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:51.612673 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 100/196] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:49:51 2022] GET /identity/v3/projects/0601c68bf9ab41768a485e3991efe411 => generated 302 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:51.622350 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ca7df-978d-48f0-be63-217a484fe633 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:51.707429 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:51.718265 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 97/197] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:49:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:51.727394 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7c808-7bc3-4f58-bcfa-b91fa29e7b5a None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:51.747364 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:51.783483 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ca7df-978d-48f0-be63-217a484fe633 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:51.826868 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052790e6-0907-4d5b-b5aa-9c14eb2b6ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:51.827517 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052790e6-0907-4d5b-b5aa-9c14eb2b6ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:51.827804 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052790e6-0907-4d5b-b5aa-9c14eb2b6ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:51.828064 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052790e6-0907-4d5b-b5aa-9c14eb2b6ac7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:51.828897 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052790e6-0907-4d5b-b5aa-9c14eb2b6ac7 None admin] RBAC: Adding query filter params (role.id=20bc872844094480b9dca67a25b69e84, scope.project.id=0601c68bf9ab41768a485e3991efe411, user.id=68c7d37760e545148c612bb8db15da6b) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:51.829210 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052790e6-0907-4d5b-b5aa-9c14eb2b6ac7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:51.830803 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052790e6-0907-4d5b-b5aa-9c14eb2b6ac7 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:51.846442 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 101/198] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:49:51 2022] GET /identity/v3/role_assignments?user.id=68c7d37760e545148c612bb8db15da6b&scope.project.id=0601c68bf9ab41768a485e3991efe411&role.id=20bc872844094480b9dca67a25b69e84 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:49:51.875023 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7c808-7bc3-4f58-bcfa-b91fa29e7b5a None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:51.925072 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e672c48-8baa-4d67-9046-19a0ceec94e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:51.925773 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e672c48-8baa-4d67-9046-19a0ceec94e8 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:51.926050 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e672c48-8baa-4d67-9046-19a0ceec94e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:51.926393 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e672c48-8baa-4d67-9046-19a0ceec94e8 None admin] PATH_INFO: `/v3/projects/0601c68bf9ab41768a485e3991efe411` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:51.931492 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e672c48-8baa-4d67-9046-19a0ceec94e8 None admin] RBAC: Authorizing `identity:get_project(project_id=0601c68bf9ab41768a485e3991efe411)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:51.933038 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e672c48-8baa-4d67-9046-19a0ceec94e8 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:51.934920 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 98/199] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:49:51 2022] GET /identity/v3/projects/0601c68bf9ab41768a485e3991efe411 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:49:51.941441 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052790e6-0907-4d5b-b5aa-9c14eb2b6ac7 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:52.026362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a256a-abdb-4cb2-b302-fe2c74e4b380 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:52.026362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a256a-abdb-4cb2-b302-fe2c74e4b380 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:52.026362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a256a-abdb-4cb2-b302-fe2c74e4b380 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:52.026362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 99/200] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:49:52.042469 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5dad58-94cd-4afa-a332-1a78d3bd742d None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:52.042812 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5dad58-94cd-4afa-a332-1a78d3bd742d None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:52.043069 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5dad58-94cd-4afa-a332-1a78d3bd742d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:52.073257 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-9c5dad58-94cd-4afa-a332-1a78d3bd742d None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:52.074744 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9c5dad58-94cd-4afa-a332-1a78d3bd742d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:52.132589 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052790e6-0907-4d5b-b5aa-9c14eb2b6ac7 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:52.170855 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:52.186274 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85aaad-cdaa-4e0c-8806-15988f1fbab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:52.186925 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85aaad-cdaa-4e0c-8806-15988f1fbab9 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:52.187200 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85aaad-cdaa-4e0c-8806-15988f1fbab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:52.187481 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85aaad-cdaa-4e0c-8806-15988f1fbab9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:52.188267 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85aaad-cdaa-4e0c-8806-15988f1fbab9 None admin] RBAC: Adding query filter params (role.id=07fbbf1ea87a40f791466f0c934b4183, scope.project.id=0601c68bf9ab41768a485e3991efe411, user.id=68c7d37760e545148c612bb8db15da6b) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:52.188569 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85aaad-cdaa-4e0c-8806-15988f1fbab9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:52.190037 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85aaad-cdaa-4e0c-8806-15988f1fbab9 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:52.197862 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 102/201] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:49:51 2022] GET /identity/v3/role_assignments?user.id=68c7d37760e545148c612bb8db15da6b&scope.project.id=0601c68bf9ab41768a485e3991efe411&role.id=07fbbf1ea87a40f791466f0c934b4183 => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:49:52.202422 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 100/202] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:49:52.247126 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85aaad-cdaa-4e0c-8806-15988f1fbab9 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:52.408355 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85aaad-cdaa-4e0c-8806-15988f1fbab9 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:52.465803 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68041ab5-1a0d-457a-9e6b-07f6e16cd3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:52.466497 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68041ab5-1a0d-457a-9e6b-07f6e16cd3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:52.466810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68041ab5-1a0d-457a-9e6b-07f6e16cd3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:52.467059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68041ab5-1a0d-457a-9e6b-07f6e16cd3b8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:52.488110 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68041ab5-1a0d-457a-9e6b-07f6e16cd3b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:49:52.494633 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-68041ab5-1a0d-457a-9e6b-07f6e16cd3b8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:49:52.494633 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:49:52.494633 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:49:52.494633 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:49:52.494633 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:49:52.494633 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:49:52.494633 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:49:52.494633 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:49:52.494633 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:49:52.494633 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:49:52.494633 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:49:52.494633 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:49:52.494633 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:49:52.494633 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:49:52.494633 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:49:52.494633 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:49:52.496394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:49:52.496394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:49:52.496394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:49:52.496394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:49:52.496394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:49:52.496394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:49:52.496394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:49:52.496394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:49:52.496394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:49:52.496394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:49:52.496394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:49:52.496394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:49:52.496394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:49:52.496394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:49:52.496394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:49:52.496394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:49:52.498023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:49:52.498023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:49:52.498023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:49:52.498023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:49:52.498023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:49:52.498023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:49:52.498023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:49:52.498023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:49:52.498023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:49:52.498023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:49:52.498023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:49:52.498023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:49:52.498023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 103/203] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:49:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:49:52.512876 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5dad58-94cd-4afa-a332-1a78d3bd742d None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:52.546598 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:52.736889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5dad58-94cd-4afa-a332-1a78d3bd742d None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:52.804571 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7b515-1f8a-4f8b-83db-e456cf2ce8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:52.807380 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7b515-1f8a-4f8b-83db-e456cf2ce8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:52.808179 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7b515-1f8a-4f8b-83db-e456cf2ce8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:52.808943 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7b515-1f8a-4f8b-83db-e456cf2ce8e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:52.810601 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7b515-1f8a-4f8b-83db-e456cf2ce8e8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:52.811433 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7b515-1f8a-4f8b-83db-e456cf2ce8e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:52.814716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7b515-1f8a-4f8b-83db-e456cf2ce8e8 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:52.831687 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 101/204] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 08:49:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:52.841275 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68041ab5-1a0d-457a-9e6b-07f6e16cd3b8 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:52.935739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:53.021471 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68041ab5-1a0d-457a-9e6b-07f6e16cd3b8 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:53.081127 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49746506-1304-4777-8814-f69580db19c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:53.081786 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49746506-1304-4777-8814-f69580db19c3 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:53.082068 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49746506-1304-4777-8814-f69580db19c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:53.082368 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49746506-1304-4777-8814-f69580db19c3 None admin] PATH_INFO: `/v3/users/8cd08420291f4825bc1ee53760214ee0` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:53.087903 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49746506-1304-4777-8814-f69580db19c3 None admin] RBAC: Authorizing `identity:get_user(user_id=8cd08420291f4825bc1ee53760214ee0)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:53.089393 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49746506-1304-4777-8814-f69580db19c3 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:53.091140 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 104/205] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:49:52 2022] GET /identity/v3/users/8cd08420291f4825bc1ee53760214ee0 => generated 289 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:53.100678 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7b515-1f8a-4f8b-83db-e456cf2ce8e8 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:53.286367 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:53.338532 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7b515-1f8a-4f8b-83db-e456cf2ce8e8 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:53.409075 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2d062-d1f5-4414-89aa-7c13ed9445fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:53.410169 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2d062-d1f5-4414-89aa-7c13ed9445fd None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:53.410710 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2d062-d1f5-4414-89aa-7c13ed9445fd None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:53.411218 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2d062-d1f5-4414-89aa-7c13ed9445fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:53.558495 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2d062-d1f5-4414-89aa-7c13ed9445fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:53.561253 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2d062-d1f5-4414-89aa-7c13ed9445fd None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:53.718333 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:53.776688 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 102/206] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:49:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:53.785847 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49746506-1304-4777-8814-f69580db19c3 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:53.973491 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49746506-1304-4777-8814-f69580db19c3 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:54.001277 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:54.027545 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a4d72-0b59-4849-9173-bae0737463de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:54.028216 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a4d72-0b59-4849-9173-bae0737463de None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:54.028497 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a4d72-0b59-4849-9173-bae0737463de None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:54.028771 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a4d72-0b59-4849-9173-bae0737463de None admin] PATH_INFO: `/v3/projects/c75e3b6b026f4fe9874853759e673fd6` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:54.029973 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a4d72-0b59-4849-9173-bae0737463de None admin] RBAC: Authorizing `identity:get_project(project_id=c75e3b6b026f4fe9874853759e673fd6)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:54.031469 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a4d72-0b59-4849-9173-bae0737463de None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:54.033160 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 105/207] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:49:53 2022] GET /identity/v3/projects/c75e3b6b026f4fe9874853759e673fd6 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:54.039074 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2d062-d1f5-4414-89aa-7c13ed9445fd None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:54.060296 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0770778-06e0-43e8-90be-3aeb61e3f7b0 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:54.060578 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0770778-06e0-43e8-90be-3aeb61e3f7b0 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:54.061043 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0770778-06e0-43e8-90be-3aeb61e3f7b0 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:54.062615 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 106/208] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:49:54.082424 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85958a4a-0d11-4d2e-ae63-48f7c2d8bfcd None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:54.082930 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85958a4a-0d11-4d2e-ae63-48f7c2d8bfcd None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:54.083342 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85958a4a-0d11-4d2e-ae63-48f7c2d8bfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:54.106158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-85958a4a-0d11-4d2e-ae63-48f7c2d8bfcd None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:54.107641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-85958a4a-0d11-4d2e-ae63-48f7c2d8bfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:54.233377 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 107/209] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:49:54.259768 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85958a4a-0d11-4d2e-ae63-48f7c2d8bfcd None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:54.260738 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2d062-d1f5-4414-89aa-7c13ed9445fd None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:54.325163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b0674-3585-4019-878d-848a4fb77f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:54.328260 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b0674-3585-4019-878d-848a4fb77f64 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:54.328756 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b0674-3585-4019-878d-848a4fb77f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:54.329220 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b0674-3585-4019-878d-848a4fb77f64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:54.331659 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b0674-3585-4019-878d-848a4fb77f64 None admin] RBAC: Adding query filter params (role.id=d1698ed994954594a9c70a2580f34a85, scope.project.id=c75e3b6b026f4fe9874853759e673fd6, user.id=8cd08420291f4825bc1ee53760214ee0) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:54.333873 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b0674-3585-4019-878d-848a4fb77f64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:54.339633 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b0674-3585-4019-878d-848a4fb77f64 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:54.351735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 103/210] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:49:54 2022] GET /identity/v3/role_assignments?user.id=8cd08420291f4825bc1ee53760214ee0&scope.project.id=c75e3b6b026f4fe9874853759e673fd6&role.id=d1698ed994954594a9c70a2580f34a85 => generated 608 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:54.418536 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85958a4a-0d11-4d2e-ae63-48f7c2d8bfcd None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:54.437571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:54.476055 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcfd01-ba6e-4eab-b01b-204ab587c8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:54.477026 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcfd01-ba6e-4eab-b01b-204ab587c8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:54.477302 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcfd01-ba6e-4eab-b01b-204ab587c8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:54.477600 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcfd01-ba6e-4eab-b01b-204ab587c8d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:54.479008 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcfd01-ba6e-4eab-b01b-204ab587c8d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:54.480892 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcfd01-ba6e-4eab-b01b-204ab587c8d2 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:54.483094 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 108/211] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:49:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:49:54.489364 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b0674-3585-4019-878d-848a4fb77f64 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:54.545615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:54.681520 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b0674-3585-4019-878d-848a4fb77f64 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:54.745121 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656e184-8cd4-46e7-9ab5-018bf144d8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:54.745789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656e184-8cd4-46e7-9ab5-018bf144d8e3 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:54.746112 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656e184-8cd4-46e7-9ab5-018bf144d8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:54.746588 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656e184-8cd4-46e7-9ab5-018bf144d8e3 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:54.747790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656e184-8cd4-46e7-9ab5-018bf144d8e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:54.750522 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656e184-8cd4-46e7-9ab5-018bf144d8e3 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:54.780246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 104/212] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 08:49:54 2022] POST /identity/v3/users => generated 297 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:49:54.940555 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558a5f4-ee6d-40c7-8ecf-d42d7e445e45 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:54.940922 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558a5f4-ee6d-40c7-8ecf-d42d7e445e45 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:54.941118 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558a5f4-ee6d-40c7-8ecf-d42d7e445e45 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:54.942503 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 109/213] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:54.948247 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c8246-d4ab-4d11-9588-0e869be13ed3 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:54.948792 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c8246-d4ab-4d11-9588-0e869be13ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:54.949239 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c8246-d4ab-4d11-9588-0e869be13ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:54.957786 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac7588-a0c0-4b6e-8315-4729423372f4 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:54.958350 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac7588-a0c0-4b6e-8315-4729423372f4 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:54.958474 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac7588-a0c0-4b6e-8315-4729423372f4 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:54.959925 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 110/214] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:49:54.967724 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696106b-339e-491d-9b8f-8e51a3204554 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:54.968455 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696106b-339e-491d-9b8f-8e51a3204554 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:54.968933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696106b-339e-491d-9b8f-8e51a3204554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:54.969246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-b30c8246-d4ab-4d11-9588-0e869be13ed3 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:54.970494 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b30c8246-d4ab-4d11-9588-0e869be13ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:54.999482 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-7696106b-339e-491d-9b8f-8e51a3204554 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:55.000221 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-7696106b-339e-491d-9b8f-8e51a3204554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:55.069239 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 105/215] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:49:55.105412 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c8246-d4ab-4d11-9588-0e869be13ed3 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:55.123888 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 111/216] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:49:55.138872 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:55.155409 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696106b-339e-491d-9b8f-8e51a3204554 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:55.264443 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c8246-d4ab-4d11-9588-0e869be13ed3 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:55.316106 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3936c5-9253-4136-9146-7e833c50fefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:55.316889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3936c5-9253-4136-9146-7e833c50fefb None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:55.317244 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3936c5-9253-4136-9146-7e833c50fefb None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:55.317583 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3936c5-9253-4136-9146-7e833c50fefb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:55.330132 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3936c5-9253-4136-9146-7e833c50fefb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:49:55.336775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-fe3936c5-9253-4136-9146-7e833c50fefb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:49:55.336775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:49:55.336775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:49:55.336775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:49:55.336775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:49:55.336775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:49:55.336775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:49:55.336775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:49:55.336775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:49:55.336775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:49:55.336775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:49:55.336775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:49:55.336775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:49:55.336775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:49:55.336775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:49:55.336775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:49:55.338381 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:49:55.338381 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:49:55.338381 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:49:55.338381 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:49:55.338381 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:49:55.338381 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:49:55.338381 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:49:55.338381 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:49:55.338381 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:49:55.338381 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:49:55.338381 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:49:55.338381 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:49:55.338381 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:49:55.338381 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:49:55.338381 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:49:55.338381 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:49:55.339172 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:49:55.339172 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:49:55.339172 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:49:55.339172 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:49:55.339172 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:49:55.339172 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:49:55.339172 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:49:55.339172 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:49:55.339172 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:49:55.339172 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:49:55.339172 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:49:55.339172 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:49:55.339172 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 106/217] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:49:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:49:55.339805 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a2db9-f4c8-421d-a698-da15c6669d48 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:55.339869 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a2db9-f4c8-421d-a698-da15c6669d48 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:55.340661 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a2db9-f4c8-421d-a698-da15c6669d48 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:55.347347 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 107/218] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:55.347347 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a2db9-f4c8-421d-a698-da15c6669d48 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:55.348420 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696106b-339e-491d-9b8f-8e51a3204554 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:55.370354 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:55.400759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795dd5f5-82ab-47dd-a6ec-32f2d7119a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:55.401630 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795dd5f5-82ab-47dd-a6ec-32f2d7119a74 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:55.402018 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795dd5f5-82ab-47dd-a6ec-32f2d7119a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:55.402479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795dd5f5-82ab-47dd-a6ec-32f2d7119a74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:55.417079 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795dd5f5-82ab-47dd-a6ec-32f2d7119a74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:49:55.424009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-795dd5f5-82ab-47dd-a6ec-32f2d7119a74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:49:55.424009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:49:55.424009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:49:55.424009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:49:55.424009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:49:55.424009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:49:55.424009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:49:55.424009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:49:55.424009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:49:55.424009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:49:55.424009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:49:55.424009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:49:55.424009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:49:55.424009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:49:55.424009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:49:55.424009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:49:55.424979 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:49:55.424979 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:49:55.424979 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:49:55.424979 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:49:55.424979 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:49:55.424979 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:49:55.424979 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:49:55.424979 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:49:55.424979 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:49:55.424979 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:49:55.424979 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:49:55.424979 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:49:55.424979 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:49:55.424979 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:49:55.424979 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:49:55.424979 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:49:55.425757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:49:55.425757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:49:55.425757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:49:55.425757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:49:55.425757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:49:55.425757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:49:55.425757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:49:55.425757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:49:55.425757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:49:55.425757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:49:55.425757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:49:55.425757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:49:55.425757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 112/219] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:49:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:49:55.428687 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bf45d-26a3-40fc-b1b2-1852229ea2b9 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:55.428687 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bf45d-26a3-40fc-b1b2-1852229ea2b9 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:55.428687 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bf45d-26a3-40fc-b1b2-1852229ea2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:55.452665 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-1c8bf45d-26a3-40fc-b1b2-1852229ea2b9 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:55.453982 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-1c8bf45d-26a3-40fc-b1b2-1852229ea2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:55.534931 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:55.558903 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 113/220] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:49:55.561386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bf45d-26a3-40fc-b1b2-1852229ea2b9 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:55.570278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a2db9-f4c8-421d-a698-da15c6669d48 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:55.653620 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa0bac-ba2d-45c1-bd90-6c0f92819ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:55.654499 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa0bac-ba2d-45c1-bd90-6c0f92819ebb None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:55.654960 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa0bac-ba2d-45c1-bd90-6c0f92819ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:55.655392 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa0bac-ba2d-45c1-bd90-6c0f92819ebb None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:55.656150 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa0bac-ba2d-45c1-bd90-6c0f92819ebb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:55.656458 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa0bac-ba2d-45c1-bd90-6c0f92819ebb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:55.659557 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa0bac-ba2d-45c1-bd90-6c0f92819ebb None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:55.679318 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 108/221] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:49:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:49:55.686682 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa0bac-ba2d-45c1-bd90-6c0f92819ebb None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:55.787731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bf45d-26a3-40fc-b1b2-1852229ea2b9 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:55.792694 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:55.858400 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e18b5-8f40-44a6-a313-68b939b370f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:55.859476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e18b5-8f40-44a6-a313-68b939b370f2 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:55.859972 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e18b5-8f40-44a6-a313-68b939b370f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:55.860454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e18b5-8f40-44a6-a313-68b939b370f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:55.861604 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e18b5-8f40-44a6-a313-68b939b370f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:55.862151 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e18b5-8f40-44a6-a313-68b939b370f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:55.864873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e18b5-8f40-44a6-a313-68b939b370f2 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:55.884579 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 114/222] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 08:49:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:55.890513 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e18b5-8f40-44a6-a313-68b939b370f2 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:55.890761 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa0bac-ba2d-45c1-bd90-6c0f92819ebb None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:55.960142 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f47d2b-5221-4635-a368-2934dcb24af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:55.961829 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f47d2b-5221-4635-a368-2934dcb24af4 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:55.962892 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f47d2b-5221-4635-a368-2934dcb24af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:55.963703 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f47d2b-5221-4635-a368-2934dcb24af4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:55.986059 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f47d2b-5221-4635-a368-2934dcb24af4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:49:55.999351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-b1f47d2b-5221-4635-a368-2934dcb24af4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:49:55.999351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:49:55.999351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:49:55.999351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:49:55.999351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:49:55.999351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:49:55.999351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:49:55.999351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:49:55.999351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:49:55.999351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:49:55.999351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:49:55.999351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:49:55.999351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:49:55.999351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:49:55.999351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:49:55.999351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:49:56.001184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:49:56.001184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:49:56.001184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:49:56.001184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:49:56.001184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:49:56.001184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:49:56.001184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:49:56.001184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:49:56.001184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:49:56.001184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:49:56.001184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:49:56.001184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:49:56.001184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:49:56.001184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:49:56.001184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:49:56.001184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:49:56.003429 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:49:56.003429 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:49:56.003429 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:49:56.003429 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:49:56.003429 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:49:56.003429 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:49:56.003429 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:49:56.003429 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:49:56.003429 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:49:56.003429 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:49:56.003429 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:49:56.003429 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:49:56.007417 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 109/223] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 08:49:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:49:56.009770 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f47d2b-5221-4635-a368-2934dcb24af4 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:56.038663 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:56.129331 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e18b5-8f40-44a6-a313-68b939b370f2 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:56.199978 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3f54d-b418-4fd2-82e2-f52c99ef56dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:56.201525 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3f54d-b418-4fd2-82e2-f52c99ef56dd None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:56.202356 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3f54d-b418-4fd2-82e2-f52c99ef56dd None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:56.203116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3f54d-b418-4fd2-82e2-f52c99ef56dd None admin] PATH_INFO: `/v3/users/68c7d37760e545148c612bb8db15da6b` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:56.205598 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3f54d-b418-4fd2-82e2-f52c99ef56dd None admin] RBAC: Authorizing `identity:get_user(user_id=68c7d37760e545148c612bb8db15da6b)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:56.208810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3f54d-b418-4fd2-82e2-f52c99ef56dd None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:56.212889 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 115/224] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:49:55 2022] GET /identity/v3/users/68c7d37760e545148c612bb8db15da6b => generated 283 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:56.214757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3f54d-b418-4fd2-82e2-f52c99ef56dd None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:56.250095 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f47d2b-5221-4635-a368-2934dcb24af4 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:56.295558 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:56.333021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0880c-bfab-4e9f-a68c-d7adcd7456be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:56.334142 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0880c-bfab-4e9f-a68c-d7adcd7456be None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:56.334676 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0880c-bfab-4e9f-a68c-d7adcd7456be None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:56.335179 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0880c-bfab-4e9f-a68c-d7adcd7456be None admin] PATH_INFO: `/v3/users/74b3403c6d4e401692686fde9e249ccd` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:56.363214 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0880c-bfab-4e9f-a68c-d7adcd7456be None admin] RBAC: Authorizing `identity:get_user(user_id=74b3403c6d4e401692686fde9e249ccd)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:56.366358 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0880c-bfab-4e9f-a68c-d7adcd7456be None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:56.377281 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 110/225] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:49:56 2022] GET /identity/v3/users/74b3403c6d4e401692686fde9e249ccd => generated 297 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:56.379329 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0880c-bfab-4e9f-a68c-d7adcd7456be None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:56.442734 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3f54d-b418-4fd2-82e2-f52c99ef56dd None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:56.512140 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d41a50-9fa3-4620-a548-9570b04d6ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:56.513706 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d41a50-9fa3-4620-a548-9570b04d6ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:56.514585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d41a50-9fa3-4620-a548-9570b04d6ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:56.515379 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d41a50-9fa3-4620-a548-9570b04d6ca2 None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:56.517022 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d41a50-9fa3-4620-a548-9570b04d6ca2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:56.518099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d41a50-9fa3-4620-a548-9570b04d6ca2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:56.521267 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d41a50-9fa3-4620-a548-9570b04d6ca2 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:56.530624 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:56.541467 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 116/226] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:49:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:56.543567 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d41a50-9fa3-4620-a548-9570b04d6ca2 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:56.605592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0880c-bfab-4e9f-a68c-d7adcd7456be None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:56.670959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:56.673341 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e45e8-ac9c-4a3f-89fd-ea4010c7d7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:56.675983 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e45e8-ac9c-4a3f-89fd-ea4010c7d7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:56.676835 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e45e8-ac9c-4a3f-89fd-ea4010c7d7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:56.677610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e45e8-ac9c-4a3f-89fd-ea4010c7d7f4 None admin] PATH_INFO: `/v3/projects/0601c68bf9ab41768a485e3991efe411` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:56.678534 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d41a50-9fa3-4620-a548-9570b04d6ca2 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:56.680936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e45e8-ac9c-4a3f-89fd-ea4010c7d7f4 None admin] RBAC: Authorizing `identity:get_project(project_id=0601c68bf9ab41768a485e3991efe411)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:56.684512 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e45e8-ac9c-4a3f-89fd-ea4010c7d7f4 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:56.694363 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 111/227] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:49:56 2022] GET /identity/v3/projects/0601c68bf9ab41768a485e3991efe411 => generated 302 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:56.697503 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e45e8-ac9c-4a3f-89fd-ea4010c7d7f4 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:56.718030 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f0088-2d3e-44a6-9123-5b94189961b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:56.718679 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f0088-2d3e-44a6-9123-5b94189961b2 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:56.718960 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f0088-2d3e-44a6-9123-5b94189961b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:56.719236 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f0088-2d3e-44a6-9123-5b94189961b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:56.814161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f0088-2d3e-44a6-9123-5b94189961b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:56.816250 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f0088-2d3e-44a6-9123-5b94189961b2 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:56.904830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e45e8-ac9c-4a3f-89fd-ea4010c7d7f4 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:56.947728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:56.965814 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 117/228] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:49:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:56.968158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f0088-2d3e-44a6-9123-5b94189961b2 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:56.968927 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:56.975192 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246cfad1-b390-4ccb-b07a-a1ad77d33b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:56.976305 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cfad1-b390-4ccb-b07a-a1ad77d33b9f None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:56.978111 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cfad1-b390-4ccb-b07a-a1ad77d33b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:56.978534 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cfad1-b390-4ccb-b07a-a1ad77d33b9f None admin] PATH_INFO: `/v3/users/68c7d37760e545148c612bb8db15da6b` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:56.981174 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246cfad1-b390-4ccb-b07a-a1ad77d33b9f None admin] RBAC: Authorizing `identity:get_user(user_id=68c7d37760e545148c612bb8db15da6b)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:56.982856 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246cfad1-b390-4ccb-b07a-a1ad77d33b9f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:56.984761 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 112/229] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:49:56 2022] GET /identity/v3/users/68c7d37760e545148c612bb8db15da6b => generated 283 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:56.991052 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246cfad1-b390-4ccb-b07a-a1ad77d33b9f None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:57.145970 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f0088-2d3e-44a6-9123-5b94189961b2 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:57.185788 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246cfad1-b390-4ccb-b07a-a1ad77d33b9f None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:57.193652 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f9670-9165-47a2-b2b0-96d44da5cf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:57.194536 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f9670-9165-47a2-b2b0-96d44da5cf0d None admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:57.194919 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f9670-9165-47a2-b2b0-96d44da5cf0d None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:57.195295 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f9670-9165-47a2-b2b0-96d44da5cf0d None admin] PATH_INFO: `/v3/projects/0601c68bf9ab41768a485e3991efe411/users/68c7d37760e545148c612bb8db15da6b/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:57.198005 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f9670-9165-47a2-b2b0-96d44da5cf0d None admin] RBAC: Authorizing `identity:create_grant(project_id=0601c68bf9ab41768a485e3991efe411, user_id=68c7d37760e545148c612bb8db15da6b, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:57.199685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f9670-9165-47a2-b2b0-96d44da5cf0d None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:57.224836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 118/230] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 08:49:56 2022] PUT /identity/v3/projects/0601c68bf9ab41768a485e3991efe411/users/68c7d37760e545148c612bb8db15da6b/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:49:57.230475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f9670-9165-47a2-b2b0-96d44da5cf0d None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:57.249737 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd702e-a5a9-484e-aa75-69f196555a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:57.250450 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd702e-a5a9-484e-aa75-69f196555a4e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:57.250733 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd702e-a5a9-484e-aa75-69f196555a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:57.251011 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd702e-a5a9-484e-aa75-69f196555a4e None admin] PATH_INFO: `/v3/projects/0601c68bf9ab41768a485e3991efe411` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:57.252289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd702e-a5a9-484e-aa75-69f196555a4e None admin] RBAC: Authorizing `identity:get_project(project_id=0601c68bf9ab41768a485e3991efe411)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:57.253820 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd702e-a5a9-484e-aa75-69f196555a4e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:57.261678 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 113/231] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:49:56 2022] GET /identity/v3/projects/0601c68bf9ab41768a485e3991efe411 => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:57.263183 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38af03-ece5-4496-a821-ac110d0606e4 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:57.263469 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38af03-ece5-4496-a821-ac110d0606e4 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:57.263743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38af03-ece5-4496-a821-ac110d0606e4 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:57.265429 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 114/232] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:57.266221 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38af03-ece5-4496-a821-ac110d0606e4 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:57.360452 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:57.376402 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:57.438904 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f9670-9165-47a2-b2b0-96d44da5cf0d None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:57.447641 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38af03-ece5-4496-a821-ac110d0606e4 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:57.492934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d7184-cfd3-4b33-8416-78895776c652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:57.493620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d7184-cfd3-4b33-8416-78895776c652 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:57.493933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d7184-cfd3-4b33-8416-78895776c652 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:57.494415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d7184-cfd3-4b33-8416-78895776c652 None admin] PATH_INFO: `/v3/projects/0601c68bf9ab41768a485e3991efe411` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:57.495726 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d7184-cfd3-4b33-8416-78895776c652 None admin] RBAC: Authorizing `identity:get_project(project_id=0601c68bf9ab41768a485e3991efe411)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:57.497221 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d7184-cfd3-4b33-8416-78895776c652 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:57.499059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 119/233] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:49:57 2022] GET /identity/v3/projects/0601c68bf9ab41768a485e3991efe411 => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:57.500451 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fec97-a8ec-4709-86ea-cd5771678c9a None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:57.500737 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fec97-a8ec-4709-86ea-cd5771678c9a None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:57.501014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fec97-a8ec-4709-86ea-cd5771678c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:57.523086 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-766fec97-a8ec-4709-86ea-cd5771678c9a None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:57.523449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-766fec97-a8ec-4709-86ea-cd5771678c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:57.546098 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc092a3-a0ca-4c9c-9d59-c787589ec1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:57.548297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc092a3-a0ca-4c9c-9d59-c787589ec1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:57.549004 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc092a3-a0ca-4c9c-9d59-c787589ec1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:57.549691 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc092a3-a0ca-4c9c-9d59-c787589ec1d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:57.552416 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc092a3-a0ca-4c9c-9d59-c787589ec1d9 None admin] RBAC: Adding query filter params (role.id=87d42817a302438b93da02bfed3f6781, scope.project.id=0601c68bf9ab41768a485e3991efe411, user.id=74b3403c6d4e401692686fde9e249ccd) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:57.553511 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc092a3-a0ca-4c9c-9d59-c787589ec1d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:57.558559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc092a3-a0ca-4c9c-9d59-c787589ec1d9 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:57.572295 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 115/234] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:49:57 2022] GET /identity/v3/role_assignments?user.id=74b3403c6d4e401692686fde9e249ccd&scope.project.id=0601c68bf9ab41768a485e3991efe411&role.id=87d42817a302438b93da02bfed3f6781 => generated 259 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:57.578490 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc092a3-a0ca-4c9c-9d59-c787589ec1d9 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:57.634540 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 120/235] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:49:57.636892 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68433f-3abc-4c57-9094-a33bba5e78fe None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:57.637380 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68433f-3abc-4c57-9094-a33bba5e78fe None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:57.637886 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68433f-3abc-4c57-9094-a33bba5e78fe None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:57.640689 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 121/236] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:49:57.653670 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f6907-5f6f-4544-af21-065d7bf1509a None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:57.654354 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f6907-5f6f-4544-af21-065d7bf1509a None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:57.654843 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f6907-5f6f-4544-af21-065d7bf1509a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:57.692260 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-021f6907-5f6f-4544-af21-065d7bf1509a None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:57.693926 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-021f6907-5f6f-4544-af21-065d7bf1509a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:57.795850 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:57.828019 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 122/237] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:49:57.829048 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f6907-5f6f-4544-af21-065d7bf1509a None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:57.842464 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc092a3-a0ca-4c9c-9d59-c787589ec1d9 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:57.893142 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:57.901209 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd5ba4-48c9-4563-9282-0c089ad77901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:57.902103 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd5ba4-48c9-4563-9282-0c089ad77901 None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:57.902517 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd5ba4-48c9-4563-9282-0c089ad77901 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:57.902896 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd5ba4-48c9-4563-9282-0c089ad77901 None admin] PATH_INFO: `/v3/projects/0601c68bf9ab41768a485e3991efe411/users/68c7d37760e545148c612bb8db15da6b/roles/07fbbf1ea87a40f791466f0c934b4183` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:57.905752 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd5ba4-48c9-4563-9282-0c089ad77901 None admin] RBAC: Authorizing `identity:create_grant(project_id=0601c68bf9ab41768a485e3991efe411, user_id=68c7d37760e545148c612bb8db15da6b, role_id=07fbbf1ea87a40f791466f0c934b4183)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:57.907615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd5ba4-48c9-4563-9282-0c089ad77901 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:57.928021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 116/238] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 08:49:57 2022] PUT /identity/v3/projects/0601c68bf9ab41768a485e3991efe411/users/68c7d37760e545148c612bb8db15da6b/roles/07fbbf1ea87a40f791466f0c934b4183 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:49:57.935419 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd5ba4-48c9-4563-9282-0c089ad77901 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:58.117462 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f6907-5f6f-4544-af21-065d7bf1509a None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:58.189573 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003cdf9a-0e71-4d87-970e-6fd8c750e56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:58.191558 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cdf9a-0e71-4d87-970e-6fd8c750e56b None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:58.192052 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cdf9a-0e71-4d87-970e-6fd8c750e56b None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:58.192531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cdf9a-0e71-4d87-970e-6fd8c750e56b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:58.196131 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003cdf9a-0e71-4d87-970e-6fd8c750e56b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:58.198305 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003cdf9a-0e71-4d87-970e-6fd8c750e56b None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:58.200521 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 123/239] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:49:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:58.216035 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003cdf9a-0e71-4d87-970e-6fd8c750e56b None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:58.238000 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd5ba4-48c9-4563-9282-0c089ad77901 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:58.288257 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:58.303033 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe854dc-5688-4234-bc05-c9e69739884e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:58.304543 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe854dc-5688-4234-bc05-c9e69739884e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:58.305459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe854dc-5688-4234-bc05-c9e69739884e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:58.306237 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe854dc-5688-4234-bc05-c9e69739884e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:58.324836 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe854dc-5688-4234-bc05-c9e69739884e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:49:58.336142 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-dfe854dc-5688-4234-bc05-c9e69739884e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:49:58.336142 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:49:58.336142 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:49:58.336142 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:49:58.336142 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:49:58.336142 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:49:58.336142 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:49:58.336142 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:49:58.336142 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:49:58.336142 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:49:58.336142 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:49:58.336142 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:49:58.336142 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:49:58.336142 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:49:58.336142 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:49:58.336142 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:49:58.337882 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:49:58.337882 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:49:58.337882 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:49:58.337882 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:49:58.337882 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:49:58.337882 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:49:58.337882 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:49:58.337882 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:49:58.337882 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:49:58.337882 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:49:58.337882 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:49:58.337882 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:49:58.337882 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:49:58.337882 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:49:58.337882 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:49:58.337882 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:49:58.339339 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:49:58.339339 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:49:58.339339 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:49:58.339339 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:49:58.339339 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:49:58.339339 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:49:58.339339 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:49:58.339339 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:49:58.339339 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:49:58.339339 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:49:58.339339 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:49:58.339339 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:49:58.343654 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 117/240] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:49:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 415 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:49:58.350482 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003cdf9a-0e71-4d87-970e-6fd8c750e56b None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:58.355033 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe854dc-5688-4234-bc05-c9e69739884e None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:58.403034 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98973e75-ebe0-45e7-8c81-1947fd4115bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:58.407017 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98973e75-ebe0-45e7-8c81-1947fd4115bc None admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:58.407804 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98973e75-ebe0-45e7-8c81-1947fd4115bc None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:58.408586 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98973e75-ebe0-45e7-8c81-1947fd4115bc None admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:58.410151 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98973e75-ebe0-45e7-8c81-1947fd4115bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:58.417964 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98973e75-ebe0-45e7-8c81-1947fd4115bc None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:58.485169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 124/241] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 08:49:58 2022] POST /identity/v3/users => generated 293 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:49:58.487807 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:58.639533 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe854dc-5688-4234-bc05-c9e69739884e None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:58.707078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169e23b-2778-4bc8-921c-329fa066ca2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:58.707989 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169e23b-2778-4bc8-921c-329fa066ca2c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:58.708536 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169e23b-2778-4bc8-921c-329fa066ca2c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:58.709038 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169e23b-2778-4bc8-921c-329fa066ca2c None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:58.710533 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169e23b-2778-4bc8-921c-329fa066ca2c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:49:58.711134 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169e23b-2778-4bc8-921c-329fa066ca2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:58.713800 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169e23b-2778-4bc8-921c-329fa066ca2c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:58.730462 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 118/242] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 08:49:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:58.739280 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98973e75-ebe0-45e7-8c81-1947fd4115bc None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:58.942183 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98973e75-ebe0-45e7-8c81-1947fd4115bc None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:58.965029 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:59.032510 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38f957-3fe7-4664-a0be-7f0bf2cf5e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:59.033623 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38f957-3fe7-4664-a0be-7f0bf2cf5e5d None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:59.034111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38f957-3fe7-4664-a0be-7f0bf2cf5e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:59.034676 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38f957-3fe7-4664-a0be-7f0bf2cf5e5d None admin] PATH_INFO: `/v3/users/5ac57aa6362c4ba3829e46a32b8919e4` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:59.069786 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38f957-3fe7-4664-a0be-7f0bf2cf5e5d None admin] RBAC: Authorizing `identity:get_user(user_id=5ac57aa6362c4ba3829e46a32b8919e4)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:59.073391 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38f957-3fe7-4664-a0be-7f0bf2cf5e5d None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:59.076821 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 125/243] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:49:58 2022] GET /identity/v3/users/5ac57aa6362c4ba3829e46a32b8919e4 => generated 297 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:49:59.087663 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169e23b-2778-4bc8-921c-329fa066ca2c None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:59.272836 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169e23b-2778-4bc8-921c-329fa066ca2c None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:49:59.290525 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:59.319049 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bbc0f-93f6-4af9-9aa6-96201511b5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:49:59.319695 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bbc0f-93f6-4af9-9aa6-96201511b5d4 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:59.319971 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bbc0f-93f6-4af9-9aa6-96201511b5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:59.320255 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bbc0f-93f6-4af9-9aa6-96201511b5d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:59.412766 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447bbc0f-93f6-4af9-9aa6-96201511b5d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:49:59.414385 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447bbc0f-93f6-4af9-9aa6-96201511b5d4 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:49:59.662634 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 119/244] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:49:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:49:59.673582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38f957-3fe7-4664-a0be-7f0bf2cf5e5d None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:49:59.736843 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ad67d-dc97-4547-a8d9-a867d547d54b None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:59.737329 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ad67d-dc97-4547-a8d9-a867d547d54b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:59.737796 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ad67d-dc97-4547-a8d9-a867d547d54b None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:59.740499 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 120/245] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:49:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:49:59.746557 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244c3c7-2091-477c-ab6a-cd84bb5561d2 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:49:59.746963 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244c3c7-2091-477c-ab6a-cd84bb5561d2 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:49:59.747390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244c3c7-2091-477c-ab6a-cd84bb5561d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:49:59.820062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-b244c3c7-2091-477c-ab6a-cd84bb5561d2 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:49:59.822840 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b244c3c7-2091-477c-ab6a-cd84bb5561d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:49:59.854960 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:49:59.946132 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38f957-3fe7-4664-a0be-7f0bf2cf5e5d None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:00.035273 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef3fe9-fd7d-42dc-8149-cb277e97620a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:00.036339 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef3fe9-fd7d-42dc-8149-cb277e97620a None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:00.036759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef3fe9-fd7d-42dc-8149-cb277e97620a None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:00.037245 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef3fe9-fd7d-42dc-8149-cb277e97620a None admin] PATH_INFO: `/v3/projects/0601c68bf9ab41768a485e3991efe411` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:00.043417 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef3fe9-fd7d-42dc-8149-cb277e97620a None admin] RBAC: Authorizing `identity:get_project(project_id=0601c68bf9ab41768a485e3991efe411)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:00.046133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef3fe9-fd7d-42dc-8149-cb277e97620a None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:00.046303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 121/246] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:50:00.049405 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 126/247] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:49:59 2022] GET /identity/v3/projects/0601c68bf9ab41768a485e3991efe411 => generated 302 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:00.057061 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244c3c7-2091-477c-ab6a-cd84bb5561d2 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:00.082605 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef3fe9-fd7d-42dc-8149-cb277e97620a None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:00.170780 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:00.313163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244c3c7-2091-477c-ab6a-cd84bb5561d2 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:00.353464 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aefa67f-412e-42d1-a906-d8c913ef0d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:00.354105 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefa67f-412e-42d1-a906-d8c913ef0d9e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:00.354423 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefa67f-412e-42d1-a906-d8c913ef0d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:00.354697 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefa67f-412e-42d1-a906-d8c913ef0d9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:00.355512 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aefa67f-412e-42d1-a906-d8c913ef0d9e None admin] RBAC: Adding query filter params (role.id=d1698ed994954594a9c70a2580f34a85, scope.project.id=0601c68bf9ab41768a485e3991efe411, user.id=5ac57aa6362c4ba3829e46a32b8919e4) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:00.355824 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aefa67f-412e-42d1-a906-d8c913ef0d9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:00.357443 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aefa67f-412e-42d1-a906-d8c913ef0d9e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:00.363898 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 122/248] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:50:00 2022] GET /identity/v3/role_assignments?user.id=5ac57aa6362c4ba3829e46a32b8919e4&scope.project.id=0601c68bf9ab41768a485e3991efe411&role.id=d1698ed994954594a9c70a2580f34a85 => generated 259 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:00.378402 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef3fe9-fd7d-42dc-8149-cb277e97620a None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:00.457971 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24b562-1d34-46f9-9d63-a317434494ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:00.459157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24b562-1d34-46f9-9d63-a317434494ff None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:00.459628 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24b562-1d34-46f9-9d63-a317434494ff None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:00.460084 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24b562-1d34-46f9-9d63-a317434494ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:00.486784 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24b562-1d34-46f9-9d63-a317434494ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:00.501595 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-cd24b562-1d34-46f9-9d63-a317434494ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:50:00.501595 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:00.501595 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:00.501595 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:00.501595 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:00.501595 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:00.501595 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:00.501595 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:00.501595 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:00.501595 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:00.501595 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:00.501595 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:00.501595 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:00.501595 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:00.501595 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:00.501595 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:00.502632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:00.502632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:00.502632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:00.502632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:00.502632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:00.502632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:00.502632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:00.502632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:00.502632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:00.502632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:00.502632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:00.502632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:00.502632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:00.502632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:00.502632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:00.502632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:00.503506 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:00.503506 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:00.503506 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:00.503506 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:00.503506 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:00.503506 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:00.503506 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:00.503506 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:00.503506 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:00.503506 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:00.503506 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:50:00.503506 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:00.505527 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 127/249] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:50:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 422 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:00.511199 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aefa67f-412e-42d1-a906-d8c913ef0d9e None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:00.546749 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:00.790258 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aefa67f-412e-42d1-a906-d8c913ef0d9e None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:00.839071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf6b51-0fe7-49ab-b0a5-1af53837ddb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:00.840081 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf6b51-0fe7-49ab-b0a5-1af53837ddb2 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:00.840558 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf6b51-0fe7-49ab-b0a5-1af53837ddb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:00.841047 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf6b51-0fe7-49ab-b0a5-1af53837ddb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:00.841989 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf6b51-0fe7-49ab-b0a5-1af53837ddb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:00.842515 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf6b51-0fe7-49ab-b0a5-1af53837ddb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:00.844125 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf6b51-0fe7-49ab-b0a5-1af53837ddb2 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:00.854781 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 123/250] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:50:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:00.860149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24b562-1d34-46f9-9d63-a317434494ff None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:01.013294 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:01.027047 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24b562-1d34-46f9-9d63-a317434494ff None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:01.076217 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1e675-c904-479d-99d7-8635793de9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:01.076798 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1e675-c904-479d-99d7-8635793de9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:01.077079 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1e675-c904-479d-99d7-8635793de9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:01.077359 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1e675-c904-479d-99d7-8635793de9e1 None admin] PATH_INFO: `/v3/users/68c7d37760e545148c612bb8db15da6b` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:01.083195 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1e675-c904-479d-99d7-8635793de9e1 None admin] RBAC: Authorizing `identity:get_user(user_id=68c7d37760e545148c612bb8db15da6b)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:01.084689 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1e675-c904-479d-99d7-8635793de9e1 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:01.086901 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 128/251] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:50:00 2022] GET /identity/v3/users/68c7d37760e545148c612bb8db15da6b => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:01.095559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf6b51-0fe7-49ab-b0a5-1af53837ddb2 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:01.181376 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb78837-668e-4df2-9cc1-3838cff358ca None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:01.182017 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb78837-668e-4df2-9cc1-3838cff358ca None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:01.182533 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb78837-668e-4df2-9cc1-3838cff358ca None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:01.184506 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 129/252] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:50:01.191817 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c3d68-9387-4619-9df0-5713aa07b023 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:01.192426 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c3d68-9387-4619-9df0-5713aa07b023 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:01.192897 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c3d68-9387-4619-9df0-5713aa07b023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:01.207587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:01.235437 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-215c3d68-9387-4619-9df0-5713aa07b023 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:01.237053 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-215c3d68-9387-4619-9df0-5713aa07b023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:01.246945 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf6b51-0fe7-49ab-b0a5-1af53837ddb2 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:01.287022 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bea40-40c7-4aca-89f5-30bd71e71055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:01.287659 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bea40-40c7-4aca-89f5-30bd71e71055 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:01.287936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bea40-40c7-4aca-89f5-30bd71e71055 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:01.288209 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bea40-40c7-4aca-89f5-30bd71e71055 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:01.372215 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bea40-40c7-4aca-89f5-30bd71e71055 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:01.373665 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bea40-40c7-4aca-89f5-30bd71e71055 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:01.377138 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 130/253] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:01.400179 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c3d68-9387-4619-9df0-5713aa07b023 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:01.456054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:01.497879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 124/254] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:50:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:50:01.504152 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bea40-40c7-4aca-89f5-30bd71e71055 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:01.651202 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:01.668850 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c3d68-9387-4619-9df0-5713aa07b023 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:01.709337 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bea40-40c7-4aca-89f5-30bd71e71055 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:01.777604 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3309c4a-ec32-4a17-b043-4b8a86a3275b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:01.779361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3309c4a-ec32-4a17-b043-4b8a86a3275b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:01.780104 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3309c4a-ec32-4a17-b043-4b8a86a3275b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:01.780848 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3309c4a-ec32-4a17-b043-4b8a86a3275b None admin] PATH_INFO: `/v3/projects/0601c68bf9ab41768a485e3991efe411` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:01.783483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3309c4a-ec32-4a17-b043-4b8a86a3275b None admin] RBAC: Authorizing `identity:get_project(project_id=0601c68bf9ab41768a485e3991efe411)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:01.786274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3309c4a-ec32-4a17-b043-4b8a86a3275b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:01.791158 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 125/255] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:50:01 2022] GET /identity/v3/projects/0601c68bf9ab41768a485e3991efe411 => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:01.795997 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9d744-9e0c-43d0-95d4-dc52af26e125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:01.796889 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9d744-9e0c-43d0-95d4-dc52af26e125 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:01.797371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9d744-9e0c-43d0-95d4-dc52af26e125 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:01.797838 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9d744-9e0c-43d0-95d4-dc52af26e125 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:01.798971 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3309c4a-ec32-4a17-b043-4b8a86a3275b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:01.851369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9d744-9e0c-43d0-95d4-dc52af26e125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:01.861265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-67f9d744-9e0c-43d0-95d4-dc52af26e125 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:50:01.861265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:01.861265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:01.861265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:01.861265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:01.861265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:01.861265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:01.861265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:01.861265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:01.861265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:01.861265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:01.861265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:01.861265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:01.861265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:01.861265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:01.861265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:01.871316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:01.871316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:01.871316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:01.871316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:01.871316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:01.871316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:01.871316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:01.871316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:01.871316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:01.871316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:01.871316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:01.871316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:01.871316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:01.871316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:01.871316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:01.871316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:01.872107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:01.872107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:01.872107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:01.872107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:01.872107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:01.872107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:01.872107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:01.872107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:01.872107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:01.872107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:01.872107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:50:01.872107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:01.872107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 131/256] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:50:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 471 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:50:01.878816 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:01.884795 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9d744-9e0c-43d0-95d4-dc52af26e125 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:01.982133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3309c4a-ec32-4a17-b043-4b8a86a3275b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:02.021847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e4128-fa06-4892-9e18-a5b119131018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:02.022889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e4128-fa06-4892-9e18-a5b119131018 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:02.023368 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e4128-fa06-4892-9e18-a5b119131018 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:02.023873 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e4128-fa06-4892-9e18-a5b119131018 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:02.025570 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e4128-fa06-4892-9e18-a5b119131018 None admin] RBAC: Adding query filter params (role.id=20bc872844094480b9dca67a25b69e84, scope.project.id=0601c68bf9ab41768a485e3991efe411, user.id=68c7d37760e545148c612bb8db15da6b) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:02.026092 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e4128-fa06-4892-9e18-a5b119131018 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:02.027908 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e4128-fa06-4892-9e18-a5b119131018 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:02.035240 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 126/257] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:50:01 2022] GET /identity/v3/role_assignments?user.id=68c7d37760e545148c612bb8db15da6b&scope.project.id=0601c68bf9ab41768a485e3991efe411&role.id=20bc872844094480b9dca67a25b69e84 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:02.124161 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea8333-f905-46f7-a38c-5bab1c3896d2 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:02.124161 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea8333-f905-46f7-a38c-5bab1c3896d2 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:02.124161 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea8333-f905-46f7-a38c-5bab1c3896d2 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:02.126369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 127/258] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:50:02.133704 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12574d-f7bd-4fb7-9f63-dd0164e430b9 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:02.134186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12574d-f7bd-4fb7-9f63-dd0164e430b9 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:02.134503 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12574d-f7bd-4fb7-9f63-dd0164e430b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:02.170823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-ad12574d-f7bd-4fb7-9f63-dd0164e430b9 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:02.172063 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ad12574d-f7bd-4fb7-9f63-dd0164e430b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:02.217863 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9d744-9e0c-43d0-95d4-dc52af26e125 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:02.308099 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 128/259] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:02.336179 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5647e-bd6a-4ac5-af2a-57f6892cb3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:02.337656 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5647e-bd6a-4ac5-af2a-57f6892cb3a4 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:02.338377 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5647e-bd6a-4ac5-af2a-57f6892cb3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:02.339055 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5647e-bd6a-4ac5-af2a-57f6892cb3a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:02.340610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5647e-bd6a-4ac5-af2a-57f6892cb3a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:02.341348 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5647e-bd6a-4ac5-af2a-57f6892cb3a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:02.344262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5647e-bd6a-4ac5-af2a-57f6892cb3a4 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:02.362196 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 132/260] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 08:50:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 479 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:02.371032 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12574d-f7bd-4fb7-9f63-dd0164e430b9 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:02.386310 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5647e-bd6a-4ac5-af2a-57f6892cb3a4 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:02.425540 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:02.438442 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:02.514767 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12574d-f7bd-4fb7-9f63-dd0164e430b9 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:02.556965 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35286178-1e31-439f-af17-d2de3213ed02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:02.557631 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35286178-1e31-439f-af17-d2de3213ed02 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:02.557910 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35286178-1e31-439f-af17-d2de3213ed02 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:02.558258 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35286178-1e31-439f-af17-d2de3213ed02 None admin] PATH_INFO: `/v3/users/74b3403c6d4e401692686fde9e249ccd` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:02.559499 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35286178-1e31-439f-af17-d2de3213ed02 None admin] RBAC: Authorizing `identity:get_user(user_id=74b3403c6d4e401692686fde9e249ccd)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:02.561186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35286178-1e31-439f-af17-d2de3213ed02 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:02.562756 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 129/261] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:50:02 2022] GET /identity/v3/users/74b3403c6d4e401692686fde9e249ccd => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:02.571898 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35286178-1e31-439f-af17-d2de3213ed02 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:02.700948 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:02.706244 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35286178-1e31-439f-af17-d2de3213ed02 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:02.735026 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5647e-bd6a-4ac5-af2a-57f6892cb3a4 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:02.751191 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae192921-383a-407f-8150-354899df8319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:02.752125 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae192921-383a-407f-8150-354899df8319 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:02.752549 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae192921-383a-407f-8150-354899df8319 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:02.752960 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae192921-383a-407f-8150-354899df8319 None admin] PATH_INFO: `/v3/projects/0601c68bf9ab41768a485e3991efe411` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:02.755137 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae192921-383a-407f-8150-354899df8319 None admin] RBAC: Authorizing `identity:get_project(project_id=0601c68bf9ab41768a485e3991efe411)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:02.756797 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae192921-383a-407f-8150-354899df8319 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:02.759512 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 130/262] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:50:02 2022] GET /identity/v3/projects/0601c68bf9ab41768a485e3991efe411 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:02.767935 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae192921-383a-407f-8150-354899df8319 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:02.819921 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1ffc7-7201-482e-8c1c-e89bac29bf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:02.820973 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1ffc7-7201-482e-8c1c-e89bac29bf26 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:02.830345 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1ffc7-7201-482e-8c1c-e89bac29bf26 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:02.830345 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1ffc7-7201-482e-8c1c-e89bac29bf26 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:02.855461 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1ffc7-7201-482e-8c1c-e89bac29bf26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:02.877398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-b8f1ffc7-7201-482e-8c1c-e89bac29bf26 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:50:02.877398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:02.877398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:02.877398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:02.877398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:02.877398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:02.877398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:02.877398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:02.877398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:02.877398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:02.877398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:02.877398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:02.877398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:02.877398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:02.877398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:02.877398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:02.878806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:02.878806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:02.878806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:02.878806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:02.878806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:02.878806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:02.878806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:02.878806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:02.878806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:02.878806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:02.878806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:02.878806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:02.878806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:02.878806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:02.878806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:02.878806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:02.879690 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:02.879690 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:02.879690 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:02.879690 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:02.879690 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:02.879690 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:02.879690 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:02.879690 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:02.879690 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:02.879690 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:02.879690 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:50:02.879690 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:02.885761 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 133/263] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 08:50:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 501 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:50:02.894721 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1ffc7-7201-482e-8c1c-e89bac29bf26 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:02.959593 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae192921-383a-407f-8150-354899df8319 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:03.041891 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be137c-bfdb-4f15-88c6-9dd54c78bb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:03.043308 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be137c-bfdb-4f15-88c6-9dd54c78bb8b None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:03.043791 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be137c-bfdb-4f15-88c6-9dd54c78bb8b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:03.044354 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be137c-bfdb-4f15-88c6-9dd54c78bb8b None admin] PATH_INFO: `/v3/projects/0601c68bf9ab41768a485e3991efe411/users/74b3403c6d4e401692686fde9e249ccd/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:03.048053 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be137c-bfdb-4f15-88c6-9dd54c78bb8b None admin] RBAC: Authorizing `identity:create_grant(project_id=0601c68bf9ab41768a485e3991efe411, user_id=74b3403c6d4e401692686fde9e249ccd, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:03.051013 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be137c-bfdb-4f15-88c6-9dd54c78bb8b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:03.076664 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 131/264] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 08:50:02 2022] PUT /identity/v3/projects/0601c68bf9ab41768a485e3991efe411/users/74b3403c6d4e401692686fde9e249ccd/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:50:03.076972 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:03.112092 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1ffc7-7201-482e-8c1c-e89bac29bf26 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:03.175017 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2fdd2-15ae-4734-98e0-adf09847cf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:03.175719 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2fdd2-15ae-4734-98e0-adf09847cf58 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:03.175993 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2fdd2-15ae-4734-98e0-adf09847cf58 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:03.176268 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2fdd2-15ae-4734-98e0-adf09847cf58 None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:03.177069 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2fdd2-15ae-4734-98e0-adf09847cf58 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:03.177376 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2fdd2-15ae-4734-98e0-adf09847cf58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:03.178805 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2fdd2-15ae-4734-98e0-adf09847cf58 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:03.198367 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 134/265] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:50:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:50:03.207928 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be137c-bfdb-4f15-88c6-9dd54c78bb8b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:03.296575 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:03.414926 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be137c-bfdb-4f15-88c6-9dd54c78bb8b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:03.465047 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1465e8-40ef-4001-980a-2050e7201031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:03.466695 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1465e8-40ef-4001-980a-2050e7201031 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:03.467485 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1465e8-40ef-4001-980a-2050e7201031 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:03.468220 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1465e8-40ef-4001-980a-2050e7201031 None admin] PATH_INFO: `/v3/users/68c7d37760e545148c612bb8db15da6b` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:03.474064 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1465e8-40ef-4001-980a-2050e7201031 None admin] RBAC: Authorizing `identity:get_user(user_id=68c7d37760e545148c612bb8db15da6b)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:03.477223 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1465e8-40ef-4001-980a-2050e7201031 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:03.481258 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 132/266] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:50:03 2022] GET /identity/v3/users/68c7d37760e545148c612bb8db15da6b => generated 283 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:50:03.490763 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2fdd2-15ae-4734-98e0-adf09847cf58 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:03.589523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa65536-469f-4925-a01c-275d925bf85a None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:03.590215 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa65536-469f-4925-a01c-275d925bf85a None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:03.595168 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa65536-469f-4925-a01c-275d925bf85a None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:03.597970 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 133/267] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:03 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:03.604002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df19d7-8315-4dfc-9f1e-2c7d99bcd2c1 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:03.604911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df19d7-8315-4dfc-9f1e-2c7d99bcd2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:03.605478 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df19d7-8315-4dfc-9f1e-2c7d99bcd2c1 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:03.609019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 134/268] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:03.611417 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9809ef7-92eb-4e33-8699-1fc6bd42ea50 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:03.612011 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9809ef7-92eb-4e33-8699-1fc6bd42ea50 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:03.612561 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9809ef7-92eb-4e33-8699-1fc6bd42ea50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:03.655515 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-d9809ef7-92eb-4e33-8699-1fc6bd42ea50 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:03.658283 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d9809ef7-92eb-4e33-8699-1fc6bd42ea50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:03.693290 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2fdd2-15ae-4734-98e0-adf09847cf58 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:03.751515 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f6361-5826-40eb-8c65-49d8af4877cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:03.752568 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f6361-5826-40eb-8c65-49d8af4877cd None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:03.753102 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f6361-5826-40eb-8c65-49d8af4877cd None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:03.753640 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f6361-5826-40eb-8c65-49d8af4877cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:03.760681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:03.788030 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 135/269] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:03.795982 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31669fdb-3b3b-4411-be72-e826c4aecc9a None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:03.796517 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31669fdb-3b3b-4411-be72-e826c4aecc9a None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:03.796961 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31669fdb-3b3b-4411-be72-e826c4aecc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:03.830517 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-31669fdb-3b3b-4411-be72-e826c4aecc9a None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:03.832345 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-31669fdb-3b3b-4411-be72-e826c4aecc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:03.866138 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:03.895403 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f6361-5826-40eb-8c65-49d8af4877cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:03.899391 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f6361-5826-40eb-8c65-49d8af4877cd None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:03.972628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 136/270] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:03.972628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31669fdb-3b3b-4411-be72-e826c4aecc9a None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:04.123322 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 135/271] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:50:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:50:04.124255 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f6361-5826-40eb-8c65-49d8af4877cd None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:04.158234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31669fdb-3b3b-4411-be72-e826c4aecc9a None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:04.171404 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:04.228038 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd464cb-598e-482b-aff9-5afb8d6cf19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:04.229566 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd464cb-598e-482b-aff9-5afb8d6cf19b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:04.230309 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd464cb-598e-482b-aff9-5afb8d6cf19b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:04.231073 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd464cb-598e-482b-aff9-5afb8d6cf19b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:04.233667 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd464cb-598e-482b-aff9-5afb8d6cf19b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:04.236696 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd464cb-598e-482b-aff9-5afb8d6cf19b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:04.240422 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 137/272] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:50:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:04.242950 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd464cb-598e-482b-aff9-5afb8d6cf19b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:04.257588 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f6361-5826-40eb-8c65-49d8af4877cd None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:04.294514 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:04.308769 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8d795-2fb9-4d7b-a579-cbab186e8dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:04.310114 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8d795-2fb9-4d7b-a579-cbab186e8dfe None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:04.310655 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8d795-2fb9-4d7b-a579-cbab186e8dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:04.311348 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8d795-2fb9-4d7b-a579-cbab186e8dfe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:04.336931 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8d795-2fb9-4d7b-a579-cbab186e8dfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:04.350125 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-d5c8d795-2fb9-4d7b-a579-cbab186e8dfe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:50:04.350125 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:04.350125 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:04.350125 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:04.350125 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:04.350125 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:04.350125 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:04.350125 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:04.350125 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:04.350125 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:04.350125 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:04.350125 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:04.350125 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:04.350125 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:04.350125 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:04.350125 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:04.352564 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:04.352564 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:04.352564 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:04.352564 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:04.352564 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:04.352564 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:04.352564 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:04.352564 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:04.352564 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:04.352564 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:04.352564 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:04.352564 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:04.352564 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:04.352564 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:04.352564 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:04.352564 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:04.354060 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:04.354060 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:04.354060 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:04.354060 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:04.354060 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:04.354060 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:04.354060 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:04.354060 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:04.354060 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:04.354060 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:04.354060 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:50:04.354060 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:04.357139 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 136/273] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:50:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:04.360308 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8d795-2fb9-4d7b-a579-cbab186e8dfe None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:04.477384 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd464cb-598e-482b-aff9-5afb8d6cf19b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:04.545188 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7277173-e661-4021-b34f-81abfbbcdc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:04.546289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7277173-e661-4021-b34f-81abfbbcdc54 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:04.546844 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7277173-e661-4021-b34f-81abfbbcdc54 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:04.547299 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7277173-e661-4021-b34f-81abfbbcdc54 None admin] PATH_INFO: `/v3/projects/0601c68bf9ab41768a485e3991efe411` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:04.549311 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7277173-e661-4021-b34f-81abfbbcdc54 None admin] RBAC: Authorizing `identity:get_project(project_id=0601c68bf9ab41768a485e3991efe411)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:04.552055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7277173-e661-4021-b34f-81abfbbcdc54 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:04.553610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:04.556217 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 138/274] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:50:04 2022] GET /identity/v3/projects/0601c68bf9ab41768a485e3991efe411 => generated 302 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:04.557816 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7277173-e661-4021-b34f-81abfbbcdc54 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:04.568002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8d795-2fb9-4d7b-a579-cbab186e8dfe None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:04.633632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79982b25-0cba-4a3f-b317-0372c6bb8a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:04.635141 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79982b25-0cba-4a3f-b317-0372c6bb8a98 None admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:04.635877 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79982b25-0cba-4a3f-b317-0372c6bb8a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:04.636580 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79982b25-0cba-4a3f-b317-0372c6bb8a98 None admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:04.638078 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79982b25-0cba-4a3f-b317-0372c6bb8a98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:04.641211 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79982b25-0cba-4a3f-b317-0372c6bb8a98 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:04.690365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 137/275] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 08:50:04 2022] POST /identity/v3/users => generated 293 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:50:04.690365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79982b25-0cba-4a3f-b317-0372c6bb8a98 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:04.802304 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7277173-e661-4021-b34f-81abfbbcdc54 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:04.858772 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:04.876918 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d706e6-6af8-4048-9714-760e0f97a945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:04.877896 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d706e6-6af8-4048-9714-760e0f97a945 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:04.878349 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d706e6-6af8-4048-9714-760e0f97a945 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:04.878811 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d706e6-6af8-4048-9714-760e0f97a945 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:04.879987 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d706e6-6af8-4048-9714-760e0f97a945 None admin] RBAC: Adding query filter params (name=member) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:04.880457 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d706e6-6af8-4048-9714-760e0f97a945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:04.882882 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d706e6-6af8-4048-9714-760e0f97a945 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:04.903290 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 139/276] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 08:50:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:04.905257 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6f33d-c934-4ecd-918e-5faaf8a8d464 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:04.905548 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6f33d-c934-4ecd-918e-5faaf8a8d464 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:04.905808 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6f33d-c934-4ecd-918e-5faaf8a8d464 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:04.907580 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 140/277] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:04.918772 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6f33d-c934-4ecd-918e-5faaf8a8d464 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:04.947389 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79982b25-0cba-4a3f-b317-0372c6bb8a98 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:05.009067 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f15e28-51b9-4ad2-9a1b-abddafe3fd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:05.009714 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f15e28-51b9-4ad2-9a1b-abddafe3fd5c None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:05.009995 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f15e28-51b9-4ad2-9a1b-abddafe3fd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:05.010544 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f15e28-51b9-4ad2-9a1b-abddafe3fd5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:05.011188 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f15e28-51b9-4ad2-9a1b-abddafe3fd5c None admin] RBAC: Adding query filter params (role.id=07fbbf1ea87a40f791466f0c934b4183, scope.project.id=0601c68bf9ab41768a485e3991efe411, user.id=68c7d37760e545148c612bb8db15da6b) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:05.011505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f15e28-51b9-4ad2-9a1b-abddafe3fd5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:05.012991 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f15e28-51b9-4ad2-9a1b-abddafe3fd5c None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:05.027190 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 138/278] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:50:04 2022] GET /identity/v3/role_assignments?user.id=68c7d37760e545148c612bb8db15da6b&scope.project.id=0601c68bf9ab41768a485e3991efe411&role.id=07fbbf1ea87a40f791466f0c934b4183 => generated 608 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:05.029193 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b320c91-a57c-4885-b5c0-e6b43c0bdf56 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:05.029645 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b320c91-a57c-4885-b5c0-e6b43c0bdf56 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:05.029923 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b320c91-a57c-4885-b5c0-e6b43c0bdf56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:05.057014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-4b320c91-a57c-4885-b5c0-e6b43c0bdf56 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:05.058245 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-4b320c91-a57c-4885-b5c0-e6b43c0bdf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:05.075018 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:05.097175 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6f33d-c934-4ecd-918e-5faaf8a8d464 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:05.157528 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b90eb1-02ec-44bf-8b15-d30f146808a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:05.158209 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b90eb1-02ec-44bf-8b15-d30f146808a9 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:05.158547 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b90eb1-02ec-44bf-8b15-d30f146808a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:05.158935 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b90eb1-02ec-44bf-8b15-d30f146808a9 None admin] PATH_INFO: `/v3/users/365f3982249e417c80801db387fbfa33` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:05.168739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 139/279] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:05.176995 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b90eb1-02ec-44bf-8b15-d30f146808a9 None admin] RBAC: Authorizing `identity:get_user(user_id=365f3982249e417c80801db387fbfa33)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:05.181118 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b90eb1-02ec-44bf-8b15-d30f146808a9 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:05.181118 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 141/280] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:50:04 2022] GET /identity/v3/users/365f3982249e417c80801db387fbfa33 => generated 293 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:50:05.191827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b320c91-a57c-4885-b5c0-e6b43c0bdf56 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:05.209540 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b90eb1-02ec-44bf-8b15-d30f146808a9 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:05.234711 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:05.370580 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b320c91-a57c-4885-b5c0-e6b43c0bdf56 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:05.391800 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b90eb1-02ec-44bf-8b15-d30f146808a9 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:05.419356 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b2f9e-2c2f-45be-9707-45920e725053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:05.420168 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b2f9e-2c2f-45be-9707-45920e725053 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:05.420599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b2f9e-2c2f-45be-9707-45920e725053 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:05.420885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b2f9e-2c2f-45be-9707-45920e725053 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:05.421697 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b2f9e-2c2f-45be-9707-45920e725053 None admin] RBAC: Adding query filter params (role.id=87d42817a302438b93da02bfed3f6781, user.id=365f3982249e417c80801db387fbfa33, scope.system=all) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:05.422016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b2f9e-2c2f-45be-9707-45920e725053 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:05.425838 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b2f9e-2c2f-45be-9707-45920e725053 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:05.434856 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 140/281] 10.222.0.65 () {56 vars in 1308 bytes} [Wed Jul 27 08:50:05 2022] GET /identity/v3/role_assignments?user.id=365f3982249e417c80801db387fbfa33&scope.system=all&role.id=87d42817a302438b93da02bfed3f6781 => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:05.443335 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c3ae0-e875-4308-82a8-ada4a2eec1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:05.444286 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c3ae0-e875-4308-82a8-ada4a2eec1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:05.444717 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c3ae0-e875-4308-82a8-ada4a2eec1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:05.445135 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c3ae0-e875-4308-82a8-ada4a2eec1f3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:05.458595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c3ae0-e875-4308-82a8-ada4a2eec1f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:05.464176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-755c3ae0-e875-4308-82a8-ada4a2eec1f3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:50:05.464176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:05.464176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:05.464176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:05.464176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:05.464176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:05.464176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:05.464176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:05.464176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:05.464176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:05.464176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:05.464176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:05.464176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:05.464176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:05.464176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:05.464176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:05.465158 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:05.465158 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:05.465158 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:05.465158 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:05.465158 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:05.465158 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:05.465158 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:05.465158 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:05.465158 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:05.465158 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:05.465158 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:05.465158 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:05.465158 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:05.465158 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:05.465158 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:05.465158 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:05.465936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:05.465936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:05.465936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:05.465936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:05.465936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:05.465936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:05.465936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:05.465936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:05.465936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:05.465936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:05.465936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:50:05.465936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:05.468383 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 142/282] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:50:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:50:05.474026 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b2f9e-2c2f-45be-9707-45920e725053 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:05.489880 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:05.605328 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b2f9e-2c2f-45be-9707-45920e725053 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:05.650232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124d7e5-f935-4228-82df-960c8e143e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:05.651161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124d7e5-f935-4228-82df-960c8e143e0f None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:05.651448 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124d7e5-f935-4228-82df-960c8e143e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:05.651730 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124d7e5-f935-4228-82df-960c8e143e0f None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:05.652501 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b124d7e5-f935-4228-82df-960c8e143e0f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:05.652811 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b124d7e5-f935-4228-82df-960c8e143e0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:05.654624 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b124d7e5-f935-4228-82df-960c8e143e0f None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:05.665960 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 141/283] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 08:50:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:50:05.671823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c3ae0-e875-4308-82a8-ada4a2eec1f3 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:05.767275 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:05.806700 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c3ae0-e875-4308-82a8-ada4a2eec1f3 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:05.848589 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafbca5e-88b6-455e-ba16-673f1a35e94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:05.849268 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbca5e-88b6-455e-ba16-673f1a35e94f None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:05.849599 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbca5e-88b6-455e-ba16-673f1a35e94f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:05.849889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbca5e-88b6-455e-ba16-673f1a35e94f None admin] PATH_INFO: `/v3/users/5ac57aa6362c4ba3829e46a32b8919e4` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:05.851341 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafbca5e-88b6-455e-ba16-673f1a35e94f None admin] RBAC: Authorizing `identity:get_user(user_id=5ac57aa6362c4ba3829e46a32b8919e4)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:05.853519 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafbca5e-88b6-455e-ba16-673f1a35e94f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:05.855556 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 143/284] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:50:05 2022] GET /identity/v3/users/5ac57aa6362c4ba3829e46a32b8919e4 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:05.861442 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124d7e5-f935-4228-82df-960c8e143e0f None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:05.946927 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:05.985711 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124d7e5-f935-4228-82df-960c8e143e0f None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:06.067168 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93470da-37d3-4261-ac62-0b13a8c97d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:06.068209 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93470da-37d3-4261-ac62-0b13a8c97d16 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:06.068727 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93470da-37d3-4261-ac62-0b13a8c97d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:06.069198 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93470da-37d3-4261-ac62-0b13a8c97d16 None admin] PATH_INFO: `/v3/projects/0601c68bf9ab41768a485e3991efe411` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:06.071328 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93470da-37d3-4261-ac62-0b13a8c97d16 None admin] RBAC: Authorizing `identity:get_project(project_id=0601c68bf9ab41768a485e3991efe411)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:06.073190 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93470da-37d3-4261-ac62-0b13a8c97d16 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:06.075403 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 142/285] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:50:05 2022] GET /identity/v3/projects/0601c68bf9ab41768a485e3991efe411 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:06.081465 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafbca5e-88b6-455e-ba16-673f1a35e94f None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:06.204083 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2379587-c93f-4e4e-aeac-a15d23f4180e None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:06.204446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2379587-c93f-4e4e-aeac-a15d23f4180e None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:06.204891 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2379587-c93f-4e4e-aeac-a15d23f4180e None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:06.207677 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 143/286] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:50:06.217267 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151d02c-33f2-4862-9322-f84a69320b9a None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:06.217742 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151d02c-33f2-4862-9322-f84a69320b9a None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:06.218216 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151d02c-33f2-4862-9322-f84a69320b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:06.249368 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-2151d02c-33f2-4862-9322-f84a69320b9a None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:06.251744 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-2151d02c-33f2-4862-9322-f84a69320b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:06.338950 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafbca5e-88b6-455e-ba16-673f1a35e94f None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:06.385760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3158d-8d32-48c5-a920-d9204a25ef28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:06.386872 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3158d-8d32-48c5-a920-d9204a25ef28 None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:06.387382 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3158d-8d32-48c5-a920-d9204a25ef28 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:06.387878 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3158d-8d32-48c5-a920-d9204a25ef28 None admin] PATH_INFO: `/v3/projects/0601c68bf9ab41768a485e3991efe411/users/5ac57aa6362c4ba3829e46a32b8919e4/roles/d1698ed994954594a9c70a2580f34a85` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:06.390199 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3158d-8d32-48c5-a920-d9204a25ef28 None admin] RBAC: Authorizing `identity:create_grant(project_id=0601c68bf9ab41768a485e3991efe411, user_id=5ac57aa6362c4ba3829e46a32b8919e4, role_id=d1698ed994954594a9c70a2580f34a85)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:06.392049 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3158d-8d32-48c5-a920-d9204a25ef28 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:06.406783 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:06.409593 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 144/287] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 08:50:06 2022] PUT /identity/v3/projects/0601c68bf9ab41768a485e3991efe411/users/5ac57aa6362c4ba3829e46a32b8919e4/roles/d1698ed994954594a9c70a2580f34a85 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:50:06.460937 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 144/288] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:50:06.522779 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3158d-8d32-48c5-a920-d9204a25ef28 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:06.693733 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3158d-8d32-48c5-a920-d9204a25ef28 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:06.741981 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41c0d3-d22b-4aff-8863-7698d5698d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:06.743151 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41c0d3-d22b-4aff-8863-7698d5698d80 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:06.743644 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41c0d3-d22b-4aff-8863-7698d5698d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:06.744116 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41c0d3-d22b-4aff-8863-7698d5698d80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:06.757902 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41c0d3-d22b-4aff-8863-7698d5698d80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:06.765439 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-4c41c0d3-d22b-4aff-8863-7698d5698d80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:50:06.765439 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:06.765439 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:06.765439 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:06.765439 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:06.765439 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:06.765439 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:06.765439 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:06.765439 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:06.765439 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:06.765439 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:06.765439 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:06.765439 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:06.765439 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:06.765439 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:06.765439 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:06.766436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:06.766436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:06.766436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:06.766436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:06.766436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:06.766436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:06.766436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:06.766436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:06.766436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:06.766436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:06.766436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:06.766436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:06.766436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:06.766436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:06.766436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:06.766436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:06.767496 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:06.767496 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:06.767496 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:06.767496 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:06.767496 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:06.767496 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:06.767496 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:06.767496 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:06.767496 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:06.767496 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:06.767496 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:50:06.767496 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:06.770753 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 145/289] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:50:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:06.782174 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151d02c-33f2-4862-9322-f84a69320b9a None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:06.917086 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:06.994879 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151d02c-33f2-4862-9322-f84a69320b9a None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:07.088129 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad2236-b483-4f49-99d7-e072f2c1bd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:07.089180 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad2236-b483-4f49-99d7-e072f2c1bd1f None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:07.089664 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad2236-b483-4f49-99d7-e072f2c1bd1f None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:07.090150 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad2236-b483-4f49-99d7-e072f2c1bd1f None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:07.091497 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad2236-b483-4f49-99d7-e072f2c1bd1f None admin] RBAC: Adding query filter params (name=member) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:07.092020 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad2236-b483-4f49-99d7-e072f2c1bd1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:07.094602 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad2236-b483-4f49-99d7-e072f2c1bd1f None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:07.116849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 145/290] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 08:50:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:50:07.127445 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41c0d3-d22b-4aff-8863-7698d5698d80 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:07.286013 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:07.398628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41c0d3-d22b-4aff-8863-7698d5698d80 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:07.491486 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1246716-e55a-4d07-b5e5-192066e33b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:07.492652 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1246716-e55a-4d07-b5e5-192066e33b0c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:07.493140 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1246716-e55a-4d07-b5e5-192066e33b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:07.493624 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1246716-e55a-4d07-b5e5-192066e33b0c None admin] PATH_INFO: `/v3/users/74b3403c6d4e401692686fde9e249ccd` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:07.495903 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1246716-e55a-4d07-b5e5-192066e33b0c None admin] RBAC: Authorizing `identity:get_user(user_id=74b3403c6d4e401692686fde9e249ccd)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:07.498683 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1246716-e55a-4d07-b5e5-192066e33b0c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:07.502143 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 146/291] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:50:07 2022] GET /identity/v3/users/74b3403c6d4e401692686fde9e249ccd => generated 297 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:07.508603 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad2236-b483-4f49-99d7-e072f2c1bd1f None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:07.731213 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad2236-b483-4f49-99d7-e072f2c1bd1f None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:07.799255 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:07.809177 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea63b6a-4673-429e-8967-4f10f629838b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:07.810211 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea63b6a-4673-429e-8967-4f10f629838b None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:07.810723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea63b6a-4673-429e-8967-4f10f629838b None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:07.811201 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea63b6a-4673-429e-8967-4f10f629838b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:07.966527 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea63b6a-4673-429e-8967-4f10f629838b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:07.968032 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea63b6a-4673-429e-8967-4f10f629838b None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:08.192262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 146/292] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:50:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 08:50:08.199092 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1246716-e55a-4d07-b5e5-192066e33b0c None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:08.434930 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbbef4-9295-4fde-ad7a-01763b14023c None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:08.435155 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbbef4-9295-4fde-ad7a-01763b14023c None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:08.435535 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbbef4-9295-4fde-ad7a-01763b14023c None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:08.437002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 147/293] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:08.454861 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b7ba8-3044-4b93-a683-4966fb438ef6 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:08.455140 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b7ba8-3044-4b93-a683-4966fb438ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:08.455576 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b7ba8-3044-4b93-a683-4966fb438ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:08.463194 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1246716-e55a-4d07-b5e5-192066e33b0c None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:08.502395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-bf2b7ba8-3044-4b93-a683-4966fb438ef6 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:08.503896 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-bf2b7ba8-3044-4b93-a683-4966fb438ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:08.528025 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:08.542783 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d213a95-1707-4fd6-8954-51411babcfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:08.543784 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d213a95-1707-4fd6-8954-51411babcfe1 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:08.544215 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d213a95-1707-4fd6-8954-51411babcfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:08.544635 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d213a95-1707-4fd6-8954-51411babcfe1 None admin] PATH_INFO: `/v3/projects/0601c68bf9ab41768a485e3991efe411` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:08.546285 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d213a95-1707-4fd6-8954-51411babcfe1 None admin] RBAC: Authorizing `identity:get_project(project_id=0601c68bf9ab41768a485e3991efe411)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:08.549208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d213a95-1707-4fd6-8954-51411babcfe1 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:08.558105 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 147/294] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:50:08 2022] GET /identity/v3/projects/0601c68bf9ab41768a485e3991efe411 => generated 302 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:08.568255 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d213a95-1707-4fd6-8954-51411babcfe1 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:08.582900 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:08.665949 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 148/295] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:08.667732 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ea25a-4d7c-451e-9a1e-1ec660aba5fc None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:08.668199 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ea25a-4d7c-451e-9a1e-1ec660aba5fc None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:08.668869 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ea25a-4d7c-451e-9a1e-1ec660aba5fc None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:08.671422 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 149/296] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:08.679000 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc2f6d-27af-4672-9ca1-f402ad7f21c9 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:08.679528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc2f6d-27af-4672-9ca1-f402ad7f21c9 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:08.679974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc2f6d-27af-4672-9ca1-f402ad7f21c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:08.719939 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-81bc2f6d-27af-4672-9ca1-f402ad7f21c9 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:08.722006 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-81bc2f6d-27af-4672-9ca1-f402ad7f21c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:08.736013 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d213a95-1707-4fd6-8954-51411babcfe1 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:08.778009 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6fe4d-e58b-4fcb-aaaf-5a86240e7424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:08.778670 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6fe4d-e58b-4fcb-aaaf-5a86240e7424 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:08.778978 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6fe4d-e58b-4fcb-aaaf-5a86240e7424 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:08.779251 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6fe4d-e58b-4fcb-aaaf-5a86240e7424 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:08.780058 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6fe4d-e58b-4fcb-aaaf-5a86240e7424 None admin] RBAC: Adding query filter params (role.id=87d42817a302438b93da02bfed3f6781, scope.project.id=0601c68bf9ab41768a485e3991efe411, user.id=74b3403c6d4e401692686fde9e249ccd) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:08.780363 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6fe4d-e58b-4fcb-aaaf-5a86240e7424 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:08.781822 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6fe4d-e58b-4fcb-aaaf-5a86240e7424 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:08.789316 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 148/297] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:50:08 2022] GET /identity/v3/role_assignments?user.id=74b3403c6d4e401692686fde9e249ccd&scope.project.id=0601c68bf9ab41768a485e3991efe411&role.id=87d42817a302438b93da02bfed3f6781 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:50:08.790792 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6fe4d-e58b-4fcb-aaaf-5a86240e7424 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:08.861813 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 150/298] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:50:08.864351 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7871a-0a39-4301-b182-e68567efdcd6 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:08.864856 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7871a-0a39-4301-b182-e68567efdcd6 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:08.865349 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7871a-0a39-4301-b182-e68567efdcd6 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:08.874100 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 151/299] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:08 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:08.879930 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf7588-f491-4754-a55d-a3729e4578b6 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:08.880507 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf7588-f491-4754-a55d-a3729e4578b6 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:08.880925 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf7588-f491-4754-a55d-a3729e4578b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:08.903699 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-1aaf7588-f491-4754-a55d-a3729e4578b6 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:08.905214 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-1aaf7588-f491-4754-a55d-a3729e4578b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:08.937780 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:08.999185 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6fe4d-e58b-4fcb-aaaf-5a86240e7424 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:09.033758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 152/300] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:09.035746 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf7588-f491-4754-a55d-a3729e4578b6 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:09.054233 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576265ac-0149-4748-a29e-444d9a600278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:09.055296 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576265ac-0149-4748-a29e-444d9a600278 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:09.056021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576265ac-0149-4748-a29e-444d9a600278 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:09.056487 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576265ac-0149-4748-a29e-444d9a600278 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:09.071646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576265ac-0149-4748-a29e-444d9a600278 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:09.077261 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-576265ac-0149-4748-a29e-444d9a600278 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:50:09.077261 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:09.077261 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:09.077261 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:09.077261 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:09.077261 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:09.077261 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:09.077261 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:09.077261 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:09.077261 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:09.077261 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:09.077261 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:09.077261 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:09.077261 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:09.077261 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:09.077261 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:09.078192 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:09.078192 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:09.078192 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:09.078192 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:09.078192 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:09.078192 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:09.078192 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:09.078192 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:09.078192 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:09.078192 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:09.078192 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:09.078192 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:09.078192 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:09.078192 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:09.078192 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:09.078192 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:09.079483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:09.079483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:09.079483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:09.079483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:09.079483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:09.079483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:09.079483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:09.079483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:09.079483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:09.079483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:09.079483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:50:09.079483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:09.079483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 149/301] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:50:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:09.079483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576265ac-0149-4748-a29e-444d9a600278 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:09.094920 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:09.203847 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf7588-f491-4754-a55d-a3729e4578b6 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:09.236730 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576265ac-0149-4748-a29e-444d9a600278 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:09.251320 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2462145-e7ff-4fcd-b35f-f8e262d06e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:09.252209 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2462145-e7ff-4fcd-b35f-f8e262d06e48 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:09.252637 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2462145-e7ff-4fcd-b35f-f8e262d06e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:09.253068 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2462145-e7ff-4fcd-b35f-f8e262d06e48 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:09.263126 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:09.265560 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2462145-e7ff-4fcd-b35f-f8e262d06e48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:09.270798 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-c2462145-e7ff-4fcd-b35f-f8e262d06e48 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:50:09.270798 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:09.270798 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:09.270798 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:09.270798 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:09.270798 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:09.270798 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:09.270798 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:09.270798 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:09.270798 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:09.270798 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:09.270798 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:09.270798 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:09.270798 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:09.270798 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:09.270798 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:09.271837 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:09.271837 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:09.271837 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:09.271837 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:09.271837 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:09.271837 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:09.271837 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:09.271837 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:09.271837 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:09.271837 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:09.271837 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:09.271837 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:09.271837 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:09.271837 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:09.271837 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:09.271837 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:09.272664 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:09.272664 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:09.272664 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:09.272664 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:09.272664 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:09.272664 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:09.272664 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:09.272664 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:09.272664 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:09.272664 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:09.272664 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:50:09.272664 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:09.281315 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 153/302] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:50:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:09.282307 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2462145-e7ff-4fcd-b35f-f8e262d06e48 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:09.292516 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdbe9b-c96e-408d-99cc-e2f46979f7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:09.293186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdbe9b-c96e-408d-99cc-e2f46979f7b0 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:09.293586 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdbe9b-c96e-408d-99cc-e2f46979f7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:09.293864 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdbe9b-c96e-408d-99cc-e2f46979f7b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:09.295126 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbdbe9b-c96e-408d-99cc-e2f46979f7b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:09.296609 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbdbe9b-c96e-408d-99cc-e2f46979f7b0 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:09.298231 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 150/303] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:50:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:09.299194 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdbe9b-c96e-408d-99cc-e2f46979f7b0 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:09.415885 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdbe9b-c96e-408d-99cc-e2f46979f7b0 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:09.419608 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:09.453460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2462145-e7ff-4fcd-b35f-f8e262d06e48 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:09.454581 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765eea1-737c-43fe-b914-6f21cf96243d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:09.455217 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765eea1-737c-43fe-b914-6f21cf96243d None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:09.455497 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765eea1-737c-43fe-b914-6f21cf96243d None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:09.455767 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765eea1-737c-43fe-b914-6f21cf96243d None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:09.456700 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765eea1-737c-43fe-b914-6f21cf96243d None admin] RBAC: Adding query filter params (name=member) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:09.457003 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765eea1-737c-43fe-b914-6f21cf96243d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:09.459683 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765eea1-737c-43fe-b914-6f21cf96243d None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:09.482614 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 151/304] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 08:50:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:09.484793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765eea1-737c-43fe-b914-6f21cf96243d None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:09.501431 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f69c56-636c-408b-a663-1dda72858bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:09.502458 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f69c56-636c-408b-a663-1dda72858bbc None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:09.502954 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f69c56-636c-408b-a663-1dda72858bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:09.503442 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f69c56-636c-408b-a663-1dda72858bbc None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:09.504785 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f69c56-636c-408b-a663-1dda72858bbc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:09.505325 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f69c56-636c-408b-a663-1dda72858bbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:09.508019 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f69c56-636c-408b-a663-1dda72858bbc None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:09.528556 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 154/305] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 08:50:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:09.528556 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f69c56-636c-408b-a663-1dda72858bbc None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:09.550365 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:09.609389 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765eea1-737c-43fe-b914-6f21cf96243d None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:09.654239 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f47e7-ed1a-40b0-b0c8-d6af581ef272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:09.654994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f47e7-ed1a-40b0-b0c8-d6af581ef272 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:09.655274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f47e7-ed1a-40b0-b0c8-d6af581ef272 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:09.655549 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f47e7-ed1a-40b0-b0c8-d6af581ef272 None admin] PATH_INFO: `/v3/groups` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:09.656234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f47e7-ed1a-40b0-b0c8-d6af581ef272 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:09.657747 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f47e7-ed1a-40b0-b0c8-d6af581ef272 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:09.678373 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 152/306] 10.222.0.65 () {60 vars in 1134 bytes} [Wed Jul 27 08:50:09 2022] POST /identity/v3/groups => generated 229 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:50:09.678373 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f47e7-ed1a-40b0-b0c8-d6af581ef272 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:09.712653 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f69c56-636c-408b-a663-1dda72858bbc None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:09.799347 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6694cb-d857-4186-bb36-c4c4852d51f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:09.800927 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6694cb-d857-4186-bb36-c4c4852d51f8 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:09.801632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6694cb-d857-4186-bb36-c4c4852d51f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:09.802308 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6694cb-d857-4186-bb36-c4c4852d51f8 None admin] PATH_INFO: `/v3/users/365f3982249e417c80801db387fbfa33` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:09.804914 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6694cb-d857-4186-bb36-c4c4852d51f8 None admin] RBAC: Authorizing `identity:get_user(user_id=365f3982249e417c80801db387fbfa33)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:09.808138 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6694cb-d857-4186-bb36-c4c4852d51f8 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:09.811675 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 155/307] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:50:09 2022] GET /identity/v3/users/365f3982249e417c80801db387fbfa33 => generated 293 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:09.821985 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6694cb-d857-4186-bb36-c4c4852d51f8 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:09.825995 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f47e7-ed1a-40b0-b0c8-d6af581ef272 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:09.839202 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:09.852484 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:09.872767 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb33e2-eb57-4cb9-9ff6-fe2411ad1b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:09.873520 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb33e2-eb57-4cb9-9ff6-fe2411ad1b09 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:09.873848 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb33e2-eb57-4cb9-9ff6-fe2411ad1b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:09.874204 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb33e2-eb57-4cb9-9ff6-fe2411ad1b09 None admin] PATH_INFO: `/v3/users/ba5c22c8349044a094cf9858a8cfec08` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:09.897715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb33e2-eb57-4cb9-9ff6-fe2411ad1b09 None admin] RBAC: Authorizing `identity:get_user(user_id=ba5c22c8349044a094cf9858a8cfec08)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:09.899643 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb33e2-eb57-4cb9-9ff6-fe2411ad1b09 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:09.901701 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 153/308] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:50:09 2022] GET /identity/v3/users/ba5c22c8349044a094cf9858a8cfec08 => generated 293 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:09.902998 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b680c7-e1a0-4c7c-8c4e-79cad9366cff None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:09.903283 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b680c7-e1a0-4c7c-8c4e-79cad9366cff None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:09.903558 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b680c7-e1a0-4c7c-8c4e-79cad9366cff None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:09.904958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 154/309] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:09.909646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b680c7-e1a0-4c7c-8c4e-79cad9366cff None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:09.975260 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6694cb-d857-4186-bb36-c4c4852d51f8 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:10.019888 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d9d4d-aaf8-432e-b9ac-cb59010cdfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:10.020570 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d9d4d-aaf8-432e-b9ac-cb59010cdfc3 None admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:10.020848 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d9d4d-aaf8-432e-b9ac-cb59010cdfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:10.021121 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d9d4d-aaf8-432e-b9ac-cb59010cdfc3 None admin] PATH_INFO: `/v3/system/users/365f3982249e417c80801db387fbfa33/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:10.022685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d9d4d-aaf8-432e-b9ac-cb59010cdfc3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=365f3982249e417c80801db387fbfa33, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:10.024785 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d9d4d-aaf8-432e-b9ac-cb59010cdfc3 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:10.042369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 156/310] 10.222.0.65 () {58 vars in 1334 bytes} [Wed Jul 27 08:50:09 2022] PUT /identity/v3/system/users/365f3982249e417c80801db387fbfa33/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:50:10.042369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b507c0-c71c-420f-b4e7-fff51776ee4d None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:10.042369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b507c0-c71c-420f-b4e7-fff51776ee4d None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:10.042369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b507c0-c71c-420f-b4e7-fff51776ee4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:10.066221 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b680c7-e1a0-4c7c-8c4e-79cad9366cff None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:10.069034 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-32b507c0-c71c-420f-b4e7-fff51776ee4d None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:10.071611 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-32b507c0-c71c-420f-b4e7-fff51776ee4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:10.135687 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f9a61-0b3c-4c43-b977-95655cb5eef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:10.138479 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f9a61-0b3c-4c43-b977-95655cb5eef7 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:10.139298 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f9a61-0b3c-4c43-b977-95655cb5eef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:10.140054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f9a61-0b3c-4c43-b977-95655cb5eef7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:10.141845 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f9a61-0b3c-4c43-b977-95655cb5eef7 None admin] RBAC: Adding query filter params (role.id=d1698ed994954594a9c70a2580f34a85, user.id=ba5c22c8349044a094cf9858a8cfec08, scope.system=all) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:10.142747 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f9a61-0b3c-4c43-b977-95655cb5eef7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:10.145787 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f9a61-0b3c-4c43-b977-95655cb5eef7 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:10.159881 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 155/311] 10.222.0.65 () {56 vars in 1308 bytes} [Wed Jul 27 08:50:09 2022] GET /identity/v3/role_assignments?user.id=ba5c22c8349044a094cf9858a8cfec08&scope.system=all&role.id=d1698ed994954594a9c70a2580f34a85 => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:10.212553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 157/312] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:10.236185 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f9a61-0b3c-4c43-b977-95655cb5eef7 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:10.278169 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:10.366157 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f9a61-0b3c-4c43-b977-95655cb5eef7 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:10.431565 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc49c7a-6de2-481f-b57d-2c65e4a24fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:10.433074 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc49c7a-6de2-481f-b57d-2c65e4a24fab None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:10.433840 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc49c7a-6de2-481f-b57d-2c65e4a24fab None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:10.434626 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc49c7a-6de2-481f-b57d-2c65e4a24fab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:10.455548 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc49c7a-6de2-481f-b57d-2c65e4a24fab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:10.466853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-dfc49c7a-6de2-481f-b57d-2c65e4a24fab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:50:10.466853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:10.466853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:10.466853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:10.466853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:10.466853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:10.466853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:10.466853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:10.466853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:10.466853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:10.466853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:10.466853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:10.466853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:10.466853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:10.466853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:10.466853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:10.468596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:10.468596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:10.468596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:10.468596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:10.468596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:10.468596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:10.468596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:10.468596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:10.468596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:10.468596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:10.468596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:10.468596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:10.468596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:10.468596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:10.468596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:10.468596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:10.470053 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:10.470053 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:10.470053 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:10.470053 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:10.470053 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:10.470053 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:10.470053 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:10.470053 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:10.470053 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:10.470053 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:10.470053 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:50:10.470053 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:10.474484 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 156/313] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:50:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:10.482629 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b507c0-c71c-420f-b4e7-fff51776ee4d None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:10.489180 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:10.598538 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b507c0-c71c-420f-b4e7-fff51776ee4d None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:10.638090 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bf45a-cdfb-4cb0-bb33-3cbaa881f5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:10.638659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bf45a-cdfb-4cb0-bb33-3cbaa881f5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:10.638916 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bf45a-cdfb-4cb0-bb33-3cbaa881f5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:10.639178 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bf45a-cdfb-4cb0-bb33-3cbaa881f5e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:10.639919 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bf45a-cdfb-4cb0-bb33-3cbaa881f5e6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:10.640226 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bf45a-cdfb-4cb0-bb33-3cbaa881f5e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:10.641701 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bf45a-cdfb-4cb0-bb33-3cbaa881f5e6 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:10.652767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 158/314] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 08:50:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:10.658487 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc49c7a-6de2-481f-b57d-2c65e4a24fab None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:10.791580 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:10.809208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc49c7a-6de2-481f-b57d-2c65e4a24fab None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:10.873712 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9c222-5318-404f-a2f8-c7ef8eb426c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:10.874850 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9c222-5318-404f-a2f8-c7ef8eb426c6 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:10.875333 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9c222-5318-404f-a2f8-c7ef8eb426c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:10.875809 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9c222-5318-404f-a2f8-c7ef8eb426c6 None admin] PATH_INFO: `/v3/users/5ac57aa6362c4ba3829e46a32b8919e4` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:10.877918 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9c222-5318-404f-a2f8-c7ef8eb426c6 None admin] RBAC: Authorizing `identity:get_user(user_id=5ac57aa6362c4ba3829e46a32b8919e4)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:10.880641 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9c222-5318-404f-a2f8-c7ef8eb426c6 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:10.884213 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 157/315] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:50:10 2022] GET /identity/v3/users/5ac57aa6362c4ba3829e46a32b8919e4 => generated 297 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:10.891507 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bf45a-cdfb-4cb0-bb33-3cbaa881f5e6 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:11.017588 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:11.062415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bf45a-cdfb-4cb0-bb33-3cbaa881f5e6 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:11.101798 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39419af2-92e5-4d83-909c-8db793af3cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:11.102982 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39419af2-92e5-4d83-909c-8db793af3cad None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:11.103261 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39419af2-92e5-4d83-909c-8db793af3cad None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:11.103696 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39419af2-92e5-4d83-909c-8db793af3cad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:11.184380 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39419af2-92e5-4d83-909c-8db793af3cad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:11.185807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39419af2-92e5-4d83-909c-8db793af3cad None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:11.263246 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:11.301823 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 159/316] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:50:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:50:11.308522 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9c222-5318-404f-a2f8-c7ef8eb426c6 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:11.428078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9c222-5318-404f-a2f8-c7ef8eb426c6 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:11.465681 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542bec4e-0b79-4c8d-814b-a7e3fd82e693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:11.466252 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bec4e-0b79-4c8d-814b-a7e3fd82e693 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:11.466557 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bec4e-0b79-4c8d-814b-a7e3fd82e693 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:11.466999 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bec4e-0b79-4c8d-814b-a7e3fd82e693 None admin] PATH_INFO: `/v3/projects/0601c68bf9ab41768a485e3991efe411` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:11.468204 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542bec4e-0b79-4c8d-814b-a7e3fd82e693 None admin] RBAC: Authorizing `identity:get_project(project_id=0601c68bf9ab41768a485e3991efe411)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:11.469665 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542bec4e-0b79-4c8d-814b-a7e3fd82e693 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:11.471728 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 158/317] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:50:11 2022] GET /identity/v3/projects/0601c68bf9ab41768a485e3991efe411 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:50:11.478055 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39419af2-92e5-4d83-909c-8db793af3cad None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:11.588486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39419af2-92e5-4d83-909c-8db793af3cad None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:11.625508 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7984178-814c-4956-9f98-a97a370c184a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:11.626176 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7984178-814c-4956-9f98-a97a370c184a None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:11.626488 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7984178-814c-4956-9f98-a97a370c184a None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:11.626764 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7984178-814c-4956-9f98-a97a370c184a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:11.627561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7984178-814c-4956-9f98-a97a370c184a None admin] RBAC: Adding query filter params (role.id=d1698ed994954594a9c70a2580f34a85, scope.project.id=0601c68bf9ab41768a485e3991efe411, user.id=5ac57aa6362c4ba3829e46a32b8919e4) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:11.627869 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7984178-814c-4956-9f98-a97a370c184a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:11.629320 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7984178-814c-4956-9f98-a97a370c184a None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:11.636177 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 160/318] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:50:11 2022] GET /identity/v3/role_assignments?user.id=5ac57aa6362c4ba3829e46a32b8919e4&scope.project.id=0601c68bf9ab41768a485e3991efe411&role.id=d1698ed994954594a9c70a2580f34a85 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:12.375136 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e12bb-a55e-4f50-a200-4c2c56e14ef8 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:12.375653 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e12bb-a55e-4f50-a200-4c2c56e14ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:12.376027 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e12bb-a55e-4f50-a200-4c2c56e14ef8 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:12.378604 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 159/319] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:12.387565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4ee49-66d8-42b6-93e1-0bd541f4f3cd None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:12.388070 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4ee49-66d8-42b6-93e1-0bd541f4f3cd None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:12.388156 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4ee49-66d8-42b6-93e1-0bd541f4f3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:12.407417 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-64b4ee49-66d8-42b6-93e1-0bd541f4f3cd None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:12.408617 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-64b4ee49-66d8-42b6-93e1-0bd541f4f3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:12.437552 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:12.462966 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb19b25-9247-4895-877c-bcf77bd0b117 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:12.463255 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb19b25-9247-4895-877c-bcf77bd0b117 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:12.463577 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb19b25-9247-4895-877c-bcf77bd0b117 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:12.465184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 160/320] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:50:12.470554 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90ee47-2815-4fc9-9562-99ba0a09a5fc None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:12.470922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90ee47-2815-4fc9-9562-99ba0a09a5fc None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:12.471095 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90ee47-2815-4fc9-9562-99ba0a09a5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:12.489585 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-de90ee47-2815-4fc9-9562-99ba0a09a5fc None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:12.490833 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-de90ee47-2815-4fc9-9562-99ba0a09a5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:12.495469 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 161/321] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:12.518414 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4ee49-66d8-42b6-93e1-0bd541f4f3cd None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:12.529353 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:12.598478 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 161/322] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:12.621859 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f5fc3-f420-4318-868b-bb9e93fa8553 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:12.622172 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f5fc3-f420-4318-868b-bb9e93fa8553 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:12.622447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f5fc3-f420-4318-868b-bb9e93fa8553 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:12.623913 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 162/323] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:50:12.624679 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f5fc3-f420-4318-868b-bb9e93fa8553 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:12.668535 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4ee49-66d8-42b6-93e1-0bd541f4f3cd None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:12.715083 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5800c-3def-442b-8f5e-eaa2e5aa69fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:12.715873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5800c-3def-442b-8f5e-eaa2e5aa69fb None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:12.716287 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5800c-3def-442b-8f5e-eaa2e5aa69fb None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:12.716660 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5800c-3def-442b-8f5e-eaa2e5aa69fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:12.717949 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5800c-3def-442b-8f5e-eaa2e5aa69fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:12.719478 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5800c-3def-442b-8f5e-eaa2e5aa69fb None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:12.721155 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 162/324] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:50:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:50:12.722382 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676efdd7-4636-42ac-8a95-c877eede6359 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:12.722661 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676efdd7-4636-42ac-8a95-c877eede6359 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:12.722935 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676efdd7-4636-42ac-8a95-c877eede6359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:12.741657 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-676efdd7-4636-42ac-8a95-c877eede6359 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:12.742955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-676efdd7-4636-42ac-8a95-c877eede6359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:12.757028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f5fc3-f420-4318-868b-bb9e93fa8553 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:12.786333 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:12.799748 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a26018-438f-45b9-9e56-d8e4c9aeafaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:12.800407 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a26018-438f-45b9-9e56-d8e4c9aeafaf None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:12.800690 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a26018-438f-45b9-9e56-d8e4c9aeafaf None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:12.801137 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a26018-438f-45b9-9e56-d8e4c9aeafaf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:12.812100 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a26018-438f-45b9-9e56-d8e4c9aeafaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:12.817149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-43a26018-438f-45b9-9e56-d8e4c9aeafaf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:50:12.817149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:12.817149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:12.817149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:12.817149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:12.817149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:12.817149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:12.817149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:12.817149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:12.817149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:12.817149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:12.817149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:12.817149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:12.817149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:12.817149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:12.817149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:12.827714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:12.827714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:12.827714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:12.827714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:12.827714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:12.827714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:12.827714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:12.827714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:12.827714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:12.827714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:12.827714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:12.827714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:12.827714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:12.827714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:12.827714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:12.827714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:12.829167 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:12.829167 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:12.829167 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:12.829167 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:12.829167 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:12.829167 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:12.829167 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:12.829167 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:12.829167 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:12.829167 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:12.829167 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:50:12.829167 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:12.829167 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 163/325] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:50:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:12.829167 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a26018-438f-45b9-9e56-d8e4c9aeafaf None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:12.840904 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:12.843535 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 163/326] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:12.844410 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676efdd7-4636-42ac-8a95-c877eede6359 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:12.953560 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a26018-438f-45b9-9e56-d8e4c9aeafaf None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:12.960054 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676efdd7-4636-42ac-8a95-c877eede6359 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:12.990378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cde192-3c29-4333-8947-3cfb6f3e3900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:12.991016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cde192-3c29-4333-8947-3cfb6f3e3900 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:12.991460 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cde192-3c29-4333-8947-3cfb6f3e3900 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:12.991767 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cde192-3c29-4333-8947-3cfb6f3e3900 None admin] PATH_INFO: `/v3/groups` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:12.993231 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cde192-3c29-4333-8947-3cfb6f3e3900 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:12.994922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cde192-3c29-4333-8947-3cfb6f3e3900 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:13.002335 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a97e8-b589-49d8-b716-5659128ff9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:13.002990 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a97e8-b589-49d8-b716-5659128ff9d1 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:13.003270 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a97e8-b589-49d8-b716-5659128ff9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:13.003536 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a97e8-b589-49d8-b716-5659128ff9d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:13.004398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a97e8-b589-49d8-b716-5659128ff9d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:13.004700 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a97e8-b589-49d8-b716-5659128ff9d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:13.006148 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a97e8-b589-49d8-b716-5659128ff9d1 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:13.011247 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 164/327] 10.222.0.65 () {60 vars in 1134 bytes} [Wed Jul 27 08:50:12 2022] POST /identity/v3/groups => generated 226 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:50:13.012096 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cde192-3c29-4333-8947-3cfb6f3e3900 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:13.016030 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 164/328] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 08:50:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:13.024177 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a97e8-b589-49d8-b716-5659128ff9d1 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:13.054584 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:13.161992 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:13.164954 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a97e8-b589-49d8-b716-5659128ff9d1 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:13.209039 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cde192-3c29-4333-8947-3cfb6f3e3900 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:13.221313 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4cfc3e-bc2c-451a-bafe-28762e0218a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:13.222002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4cfc3e-bc2c-451a-bafe-28762e0218a7 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:13.222279 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4cfc3e-bc2c-451a-bafe-28762e0218a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:13.222639 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4cfc3e-bc2c-451a-bafe-28762e0218a7 None admin] PATH_INFO: `/v3/users/365f3982249e417c80801db387fbfa33` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:13.224067 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4cfc3e-bc2c-451a-bafe-28762e0218a7 None admin] RBAC: Authorizing `identity:get_user(user_id=365f3982249e417c80801db387fbfa33)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:13.225577 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4cfc3e-bc2c-451a-bafe-28762e0218a7 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:13.227761 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 165/329] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:50:13 2022] GET /identity/v3/users/365f3982249e417c80801db387fbfa33 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:50:13.233936 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4cfc3e-bc2c-451a-bafe-28762e0218a7 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:13.262396 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db255c-e24d-4fbc-9ba2-0aa29e2cb7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:13.263373 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db255c-e24d-4fbc-9ba2-0aa29e2cb7aa None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:13.263810 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db255c-e24d-4fbc-9ba2-0aa29e2cb7aa None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:13.264233 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db255c-e24d-4fbc-9ba2-0aa29e2cb7aa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:13.280971 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db255c-e24d-4fbc-9ba2-0aa29e2cb7aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:13.287628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-63db255c-e24d-4fbc-9ba2-0aa29e2cb7aa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:50:13.287628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:13.287628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:13.287628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:13.287628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:13.287628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:13.287628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:13.287628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:13.287628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:13.287628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:13.287628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:13.287628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:13.287628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:13.287628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:13.287628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:13.287628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:13.288582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:13.288582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:13.288582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:13.288582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:13.288582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:13.288582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:13.288582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:13.288582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:13.288582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:13.288582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:13.288582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:13.288582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:13.288582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:13.288582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:13.288582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:13.288582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:13.290028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:13.290028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:13.290028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:13.290028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:13.290028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:13.290028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:13.290028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:13.290028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:13.290028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:13.290028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:13.290028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:50:13.290028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:13.290028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 165/330] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:50:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:13.296507 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db255c-e24d-4fbc-9ba2-0aa29e2cb7aa None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:13.389717 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:13.408348 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4cfc3e-bc2c-451a-bafe-28762e0218a7 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:13.462536 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9614cd6-fb8b-4108-966b-fee36b563f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:13.463215 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9614cd6-fb8b-4108-966b-fee36b563f15 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:13.463494 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9614cd6-fb8b-4108-966b-fee36b563f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:13.463759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9614cd6-fb8b-4108-966b-fee36b563f15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:13.464588 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9614cd6-fb8b-4108-966b-fee36b563f15 None admin] RBAC: Adding query filter params (role.id=87d42817a302438b93da02bfed3f6781, user.id=365f3982249e417c80801db387fbfa33, scope.system=all) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:13.464928 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9614cd6-fb8b-4108-966b-fee36b563f15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:13.466521 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9614cd6-fb8b-4108-966b-fee36b563f15 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:13.479207 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db255c-e24d-4fbc-9ba2-0aa29e2cb7aa None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:13.484392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 166/331] 10.222.0.65 () {56 vars in 1308 bytes} [Wed Jul 27 08:50:13 2022] GET /identity/v3/role_assignments?user.id=365f3982249e417c80801db387fbfa33&scope.system=all&role.id=87d42817a302438b93da02bfed3f6781 => generated 510 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:50:13.554773 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56576b8-ee56-47bf-8613-6e6e118a3ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:13.555953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56576b8-ee56-47bf-8613-6e6e118a3ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:13.555953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56576b8-ee56-47bf-8613-6e6e118a3ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:13.556230 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56576b8-ee56-47bf-8613-6e6e118a3ff7 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:13.556769 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56576b8-ee56-47bf-8613-6e6e118a3ff7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:13.557074 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56576b8-ee56-47bf-8613-6e6e118a3ff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:13.558587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56576b8-ee56-47bf-8613-6e6e118a3ff7 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:13.566553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:13.575749 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 166/332] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 08:50:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:13.581022 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9614cd6-fb8b-4108-966b-fee36b563f15 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:13.747965 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9614cd6-fb8b-4108-966b-fee36b563f15 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:13.809566 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a5170-6fb6-4e28-8ac1-61a1159a725c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:13.810690 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a5170-6fb6-4e28-8ac1-61a1159a725c None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:13.811192 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a5170-6fb6-4e28-8ac1-61a1159a725c None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:13.811684 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a5170-6fb6-4e28-8ac1-61a1159a725c None admin] PATH_INFO: `/v3/users/ba5c22c8349044a094cf9858a8cfec08` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:13.813359 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a5170-6fb6-4e28-8ac1-61a1159a725c None admin] RBAC: Authorizing `identity:get_user(user_id=ba5c22c8349044a094cf9858a8cfec08)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:13.815198 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a5170-6fb6-4e28-8ac1-61a1159a725c None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:13.817714 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 167/333] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:50:13 2022] GET /identity/v3/users/ba5c22c8349044a094cf9858a8cfec08 => generated 293 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:13.824972 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56576b8-ee56-47bf-8613-6e6e118a3ff7 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:13.974180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56576b8-ee56-47bf-8613-6e6e118a3ff7 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:14.050016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f40bb-d8a1-4c39-849b-31dad131865b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:14.051722 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f40bb-d8a1-4c39-849b-31dad131865b None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:14.052627 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f40bb-d8a1-4c39-849b-31dad131865b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:14.053480 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f40bb-d8a1-4c39-849b-31dad131865b None admin] PATH_INFO: `/v3/system/users/ba5c22c8349044a094cf9858a8cfec08/roles/d1698ed994954594a9c70a2580f34a85` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:14.056888 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f40bb-d8a1-4c39-849b-31dad131865b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ba5c22c8349044a094cf9858a8cfec08, role_id=d1698ed994954594a9c70a2580f34a85)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:14.060248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f40bb-d8a1-4c39-849b-31dad131865b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:14.082518 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 167/334] 10.222.0.65 () {58 vars in 1334 bytes} [Wed Jul 27 08:50:13 2022] PUT /identity/v3/system/users/ba5c22c8349044a094cf9858a8cfec08/roles/d1698ed994954594a9c70a2580f34a85 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:50:16.251946 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d8b89-8577-46ee-8ffd-862fa62be8e6 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:16.252488 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d8b89-8577-46ee-8ffd-862fa62be8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:16.252845 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d8b89-8577-46ee-8ffd-862fa62be8e6 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:16.255941 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 168/335] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:16.263433 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1142a-187e-428d-b229-be8baa489b5f None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:16.263975 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1142a-187e-428d-b229-be8baa489b5f None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:16.264435 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1142a-187e-428d-b229-be8baa489b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:16.301739 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-cdd1142a-187e-428d-b229-be8baa489b5f None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:16.306125 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-cdd1142a-187e-428d-b229-be8baa489b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:16.455185 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:16.459852 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 168/336] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:16.489954 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d8b89-8577-46ee-8ffd-862fa62be8e6 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:16.530539 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:16.717447 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d8b89-8577-46ee-8ffd-862fa62be8e6 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:16.792501 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff77bb-945f-4401-825c-b4f95a337f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:16.793551 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff77bb-945f-4401-825c-b4f95a337f81 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:16.794025 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff77bb-945f-4401-825c-b4f95a337f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:16.794528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff77bb-945f-4401-825c-b4f95a337f81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:16.804581 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f126ee6-f6f2-4add-8ac2-d722acbd7e80 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:16.805824 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f126ee6-f6f2-4add-8ac2-d722acbd7e80 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:16.806311 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f126ee6-f6f2-4add-8ac2-d722acbd7e80 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:16.809039 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 169/337] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:16.830197 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1cf8b-26a8-4c34-86d5-b666e16d57bc None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:16.830829 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1cf8b-26a8-4c34-86d5-b666e16d57bc None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:16.831309 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1cf8b-26a8-4c34-86d5-b666e16d57bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:16.841815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff77bb-945f-4401-825c-b4f95a337f81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:16.859759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-34ff77bb-945f-4401-825c-b4f95a337f81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:50:16.859759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:16.859759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:16.859759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:16.859759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:16.859759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:16.859759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:16.859759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:16.859759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:16.859759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:16.859759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:16.859759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:16.859759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:16.859759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:16.859759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:16.859759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:16.860703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:16.860703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:16.860703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:16.860703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:16.860703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:16.860703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:16.860703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:16.860703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:16.860703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:16.860703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:16.860703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:16.860703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:16.860703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:16.860703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:16.860703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:16.860703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:16.861505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:16.861505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:16.861505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:16.861505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:16.861505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:16.861505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:16.861505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:16.861505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:16.861505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:16.861505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:16.861505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:50:16.861505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:16.875573 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 169/338] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:50:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:16.882528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff77bb-945f-4401-825c-b4f95a337f81 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:16.894695 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-c5f1cf8b-26a8-4c34-86d5-b666e16d57bc None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:16.899974 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c5f1cf8b-26a8-4c34-86d5-b666e16d57bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:17.095534 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 170/339] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:17.115593 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:17.170406 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff77bb-945f-4401-825c-b4f95a337f81 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:17.242766 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80f91e-13e3-4eaa-a17c-b3550c15021b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:17.243810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80f91e-13e3-4eaa-a17c-b3550c15021b None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:17.244284 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80f91e-13e3-4eaa-a17c-b3550c15021b None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:17.244760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80f91e-13e3-4eaa-a17c-b3550c15021b None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:17.246052 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80f91e-13e3-4eaa-a17c-b3550c15021b None admin] RBAC: Adding query filter params (name=member) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:17.246608 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80f91e-13e3-4eaa-a17c-b3550c15021b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:17.248855 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1cf8b-26a8-4c34-86d5-b666e16d57bc None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:17.249180 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80f91e-13e3-4eaa-a17c-b3550c15021b None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:17.277414 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 170/340] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 08:50:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:50:17.279515 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80f91e-13e3-4eaa-a17c-b3550c15021b None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:17.517964 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1cf8b-26a8-4c34-86d5-b666e16d57bc None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:17.530553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80f91e-13e3-4eaa-a17c-b3550c15021b None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:17.565150 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:17.587149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d07c97-80a3-4309-b179-43e9b0b755ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:17.588690 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d07c97-80a3-4309-b179-43e9b0b755ac None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:17.589442 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d07c97-80a3-4309-b179-43e9b0b755ac None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:17.590177 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d07c97-80a3-4309-b179-43e9b0b755ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:17.611285 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d07c97-80a3-4309-b179-43e9b0b755ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:17.623284 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-93d07c97-80a3-4309-b179-43e9b0b755ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:50:17.623284 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:17.623284 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:17.623284 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:17.623284 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:17.623284 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:17.623284 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:17.623284 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:17.623284 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:17.623284 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:17.623284 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:17.623284 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:17.623284 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:17.623284 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:17.623284 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:17.623284 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:17.625028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:17.625028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:17.625028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:17.625028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:17.625028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:17.625028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:17.625028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:17.625028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:17.625028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:17.625028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:17.625028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:17.625028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:17.625028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:17.625028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:17.625028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:17.625028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:17.626599 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:17.626599 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:17.626599 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:17.626599 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:17.626599 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:17.626599 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:17.626599 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:17.626599 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:17.626599 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:17.626599 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:17.626599 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:50:17.626599 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:17.627816 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa5800-d33c-44d2-9c4b-a8229f099a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:17.629080 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa5800-d33c-44d2-9c4b-a8229f099a6f None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:17.629765 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa5800-d33c-44d2-9c4b-a8229f099a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:17.630498 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa5800-d33c-44d2-9c4b-a8229f099a6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:17.631671 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 171/341] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 08:50:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:17.636323 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab2ca0-b3cc-4447-87df-6f0b0bae74d3 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:17.636905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab2ca0-b3cc-4447-87df-6f0b0bae74d3 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:17.637458 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab2ca0-b3cc-4447-87df-6f0b0bae74d3 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:17.640453 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 172/342] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:17.642101 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab2ca0-b3cc-4447-87df-6f0b0bae74d3 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:17.650978 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:17.779205 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa5800-d33c-44d2-9c4b-a8229f099a6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:17.781822 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa5800-d33c-44d2-9c4b-a8229f099a6f None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:17.855130 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab2ca0-b3cc-4447-87df-6f0b0bae74d3 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:17.927918 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633470fc-4e70-4232-9a0e-4fb056746547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:17.929544 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633470fc-4e70-4232-9a0e-4fb056746547 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:17.930909 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633470fc-4e70-4232-9a0e-4fb056746547 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:17.931676 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633470fc-4e70-4232-9a0e-4fb056746547 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:17.933242 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633470fc-4e70-4232-9a0e-4fb056746547 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:17.934161 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633470fc-4e70-4232-9a0e-4fb056746547 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:17.937197 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633470fc-4e70-4232-9a0e-4fb056746547 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:17.954504 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 173/343] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:50:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:17.957360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5a323-f780-4c87-bec2-fac04e9ebed0 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:17.958142 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5a323-f780-4c87-bec2-fac04e9ebed0 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:17.959033 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5a323-f780-4c87-bec2-fac04e9ebed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:17.979598 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 171/344] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:50:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 701 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:50:17.981133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa5800-d33c-44d2-9c4b-a8229f099a6f None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:17.994232 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-bdc5a323-f780-4c87-bec2-fac04e9ebed0 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:17.996737 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-bdc5a323-f780-4c87-bec2-fac04e9ebed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:18.059216 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:18.090029 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:18.141669 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 174/345] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:18.143887 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5a323-f780-4c87-bec2-fac04e9ebed0 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:18.224859 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa5800-d33c-44d2-9c4b-a8229f099a6f None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:18.356252 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe7fb6-cfda-40cf-9c66-ae5eee2d4ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:18.357219 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe7fb6-cfda-40cf-9c66-ae5eee2d4ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:18.357219 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe7fb6-cfda-40cf-9c66-ae5eee2d4ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:18.357478 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe7fb6-cfda-40cf-9c66-ae5eee2d4ac5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:18.361047 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5a323-f780-4c87-bec2-fac04e9ebed0 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:18.441238 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f8105-1b69-4140-88ff-156beaf4793e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:18.442865 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f8105-1b69-4140-88ff-156beaf4793e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:18.443573 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f8105-1b69-4140-88ff-156beaf4793e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:18.444363 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f8105-1b69-4140-88ff-156beaf4793e None admin] PATH_INFO: `/v3/projects/c75e3b6b026f4fe9874853759e673fd6` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:18.447365 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f8105-1b69-4140-88ff-156beaf4793e None admin] RBAC: Authorizing `identity:get_project(project_id=c75e3b6b026f4fe9874853759e673fd6)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:18.450398 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f8105-1b69-4140-88ff-156beaf4793e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:18.462205 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 175/346] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:50:18 2022] GET /identity/v3/projects/c75e3b6b026f4fe9874853759e673fd6 => generated 298 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:18.464362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f8105-1b69-4140-88ff-156beaf4793e None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:18.498952 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe7fb6-cfda-40cf-9c66-ae5eee2d4ac5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:18.500716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe7fb6-cfda-40cf-9c66-ae5eee2d4ac5 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:18.554033 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:18.588386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:18.634580 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f8105-1b69-4140-88ff-156beaf4793e None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:18.681840 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587824ee-ea72-4797-8599-0546fc586625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:18.682824 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587824ee-ea72-4797-8599-0546fc586625 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:18.683260 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587824ee-ea72-4797-8599-0546fc586625 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:18.683680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587824ee-ea72-4797-8599-0546fc586625 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:18.701308 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587824ee-ea72-4797-8599-0546fc586625 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:18.706863 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-587824ee-ea72-4797-8599-0546fc586625 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:50:18.706863 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:18.706863 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:18.706863 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:18.706863 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:18.706863 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:18.706863 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:18.706863 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:18.706863 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:18.706863 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:18.706863 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:18.706863 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:18.706863 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:18.706863 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:18.706863 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:18.706863 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:18.707824 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:18.707824 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:18.707824 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:18.707824 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:18.707824 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:18.707824 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:18.707824 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:18.707824 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:18.707824 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:18.707824 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:18.707824 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:18.707824 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:18.707824 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:18.707824 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:18.707824 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:18.707824 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:18.708697 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:18.708697 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:18.708697 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:18.708697 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:18.708697 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:18.708697 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:18.708697 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:18.708697 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:18.708697 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:18.708697 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:18.708697 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:50:18.708697 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:18.711248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 176/347] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:50:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:18.712732 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587824ee-ea72-4797-8599-0546fc586625 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:18.746835 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 172/348] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:50:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 766 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:50:18.749843 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430f8d8-59c0-4510-8da3-933f5738f94a None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:18.750351 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430f8d8-59c0-4510-8da3-933f5738f94a None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:18.754824 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430f8d8-59c0-4510-8da3-933f5738f94a None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:18.756806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 173/349] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:18.759932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430f8d8-59c0-4510-8da3-933f5738f94a None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:18.908377 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587824ee-ea72-4797-8599-0546fc586625 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:18.913446 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:18.959832 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430f8d8-59c0-4510-8da3-933f5738f94a None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:19.000617 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872dd98-ee9c-409b-bca5-9c34c3c344e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:19.002493 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872dd98-ee9c-409b-bca5-9c34c3c344e4 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:19.003327 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872dd98-ee9c-409b-bca5-9c34c3c344e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:19.004338 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872dd98-ee9c-409b-bca5-9c34c3c344e4 None admin] PATH_INFO: `/v3/groups/2bf2b90562dc47e2a18a79b9e5344821` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:19.006909 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c326543-daa9-4059-b930-0a087ee9a7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:19.007703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c326543-daa9-4059-b930-0a087ee9a7be None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:19.008086 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c326543-daa9-4059-b930-0a087ee9a7be None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:19.008504 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c326543-daa9-4059-b930-0a087ee9a7be None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:19.009633 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c326543-daa9-4059-b930-0a087ee9a7be None admin] RBAC: Adding query filter params (name=member) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:19.009938 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c326543-daa9-4059-b930-0a087ee9a7be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:19.012306 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c326543-daa9-4059-b930-0a087ee9a7be None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:19.019682 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872dd98-ee9c-409b-bca5-9c34c3c344e4 None admin] RBAC: Authorizing `identity:get_group(group_id=2bf2b90562dc47e2a18a79b9e5344821)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:19.022020 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:19.022990 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872dd98-ee9c-409b-bca5-9c34c3c344e4 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:19.026424 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 177/350] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 08:50:18 2022] GET /identity/v3/groups/2bf2b90562dc47e2a18a79b9e5344821 => generated 226 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:19.028846 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872dd98-ee9c-409b-bca5-9c34c3c344e4 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:19.036121 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 174/351] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 08:50:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:19.040591 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318dfd0-7be0-45bd-9595-baa7d017041a None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:19.041435 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318dfd0-7be0-45bd-9595-baa7d017041a None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:19.042074 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318dfd0-7be0-45bd-9595-baa7d017041a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:19.072647 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-b318dfd0-7be0-45bd-9595-baa7d017041a None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:19.073869 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-b318dfd0-7be0-45bd-9595-baa7d017041a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:19.206735 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 175/352] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:19.209544 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf65f9-4300-4849-a381-a77b33367c65 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:19.210460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf65f9-4300-4849-a381-a77b33367c65 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:19.211771 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf65f9-4300-4849-a381-a77b33367c65 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:19.220312 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 176/353] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:19 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:19.221069 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf65f9-4300-4849-a381-a77b33367c65 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:19.239875 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872dd98-ee9c-409b-bca5-9c34c3c344e4 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:19.312888 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9369b12b-cfcc-4efe-85f2-3f3e975ed361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:19.314693 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369b12b-cfcc-4efe-85f2-3f3e975ed361 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:19.315497 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369b12b-cfcc-4efe-85f2-3f3e975ed361 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:19.315950 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369b12b-cfcc-4efe-85f2-3f3e975ed361 None admin] PATH_INFO: `/v3/projects/c75e3b6b026f4fe9874853759e673fd6` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:19.319569 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9369b12b-cfcc-4efe-85f2-3f3e975ed361 None admin] RBAC: Authorizing `identity:get_project(project_id=c75e3b6b026f4fe9874853759e673fd6)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:19.322422 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9369b12b-cfcc-4efe-85f2-3f3e975ed361 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:19.325505 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 178/354] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:50:19 2022] GET /identity/v3/projects/c75e3b6b026f4fe9874853759e673fd6 => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:19.326798 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9369b12b-cfcc-4efe-85f2-3f3e975ed361 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:19.395996 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:19.405490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf65f9-4300-4849-a381-a77b33367c65 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:19.462968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:19.471463 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79125ef2-5d52-472f-a442-9ac04718b883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:19.472800 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79125ef2-5d52-472f-a442-9ac04718b883 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:19.473522 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79125ef2-5d52-472f-a442-9ac04718b883 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:19.474182 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79125ef2-5d52-472f-a442-9ac04718b883 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:19.475678 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79125ef2-5d52-472f-a442-9ac04718b883 None admin] RBAC: Adding query filter params (group.id=2bf2b90562dc47e2a18a79b9e5344821, role.id=87d42817a302438b93da02bfed3f6781, scope.project.id=c75e3b6b026f4fe9874853759e673fd6) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:19.476324 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79125ef2-5d52-472f-a442-9ac04718b883 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:19.479456 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79125ef2-5d52-472f-a442-9ac04718b883 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:19.489988 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 177/355] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Jul 27 08:50:19 2022] GET /identity/v3/role_assignments?group.id=2bf2b90562dc47e2a18a79b9e5344821&scope.project.id=c75e3b6b026f4fe9874853759e673fd6&role.id=87d42817a302438b93da02bfed3f6781 => generated 260 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:19.492552 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b771d1d-7597-4605-a1f6-a324f3419877 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:19.493381 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b771d1d-7597-4605-a1f6-a324f3419877 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:19.493568 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b771d1d-7597-4605-a1f6-a324f3419877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:19.500149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9369b12b-cfcc-4efe-85f2-3f3e975ed361 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:19.527397 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-4b771d1d-7597-4605-a1f6-a324f3419877 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:19.529909 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-4b771d1d-7597-4605-a1f6-a324f3419877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:19.548657 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6946af-9a57-43d6-bb89-4cf40d45a97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:19.549292 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6946af-9a57-43d6-bb89-4cf40d45a97a None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:19.549781 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6946af-9a57-43d6-bb89-4cf40d45a97a None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:19.550211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6946af-9a57-43d6-bb89-4cf40d45a97a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:19.683453 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 178/356] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:19.684338 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b771d1d-7597-4605-a1f6-a324f3419877 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:19.693039 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6946af-9a57-43d6-bb89-4cf40d45a97a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:19.696441 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6946af-9a57-43d6-bb89-4cf40d45a97a None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:19.763403 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:19.868685 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 179/357] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:50:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:50:19.870479 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6946af-9a57-43d6-bb89-4cf40d45a97a None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:19.893358 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b771d1d-7597-4605-a1f6-a324f3419877 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:19.957463 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:19.983298 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12eb598-70fb-4270-8ac7-a31cd97e8f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:19.984497 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12eb598-70fb-4270-8ac7-a31cd97e8f73 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:19.984972 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12eb598-70fb-4270-8ac7-a31cd97e8f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:19.985505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12eb598-70fb-4270-8ac7-a31cd97e8f73 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:20.011551 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12eb598-70fb-4270-8ac7-a31cd97e8f73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:20.021498 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-a12eb598-70fb-4270-8ac7-a31cd97e8f73 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:50:20.021498 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:20.021498 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:20.021498 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:20.021498 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:20.021498 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:20.021498 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:20.021498 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:20.021498 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:20.021498 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:20.021498 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:20.021498 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:20.021498 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:20.021498 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:20.021498 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:20.021498 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:20.022533 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:20.022533 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:20.022533 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:20.022533 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:20.022533 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:20.022533 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:20.022533 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:20.022533 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:20.022533 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:20.022533 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:20.022533 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:20.022533 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:20.022533 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:20.022533 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:20.022533 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:20.022533 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:20.023323 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:20.023323 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:20.023323 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:20.023323 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:20.023323 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:20.023323 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:20.023323 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:20.023323 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:20.023323 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:20.023323 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:20.023323 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:50:20.023323 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:20.024481 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 179/358] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 08:50:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:20.028879 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb59ce-bd21-421e-9e36-75d8ed57559b None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:20.029098 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb59ce-bd21-421e-9e36-75d8ed57559b None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:20.030246 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb59ce-bd21-421e-9e36-75d8ed57559b None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:20.034190 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 180/359] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:20.035473 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb59ce-bd21-421e-9e36-75d8ed57559b None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:20.081125 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6946af-9a57-43d6-bb89-4cf40d45a97a None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:20.146798 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063878d-c8dd-4bf3-a39a-40790627eab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:20.147873 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063878d-c8dd-4bf3-a39a-40790627eab0 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:20.148362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063878d-c8dd-4bf3-a39a-40790627eab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:20.148903 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063878d-c8dd-4bf3-a39a-40790627eab0 None admin] PATH_INFO: `/v3/groups/2bf2b90562dc47e2a18a79b9e5344821` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:20.150978 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063878d-c8dd-4bf3-a39a-40790627eab0 None admin] RBAC: Authorizing `identity:get_group(group_id=2bf2b90562dc47e2a18a79b9e5344821)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:20.153085 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063878d-c8dd-4bf3-a39a-40790627eab0 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:20.162352 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 180/360] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 08:50:19 2022] GET /identity/v3/groups/2bf2b90562dc47e2a18a79b9e5344821 => generated 226 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:20.162352 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063878d-c8dd-4bf3-a39a-40790627eab0 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:20.167097 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:20.234975 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb59ce-bd21-421e-9e36-75d8ed57559b None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:20.297666 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a416a8-ff3c-4a00-9e58-c6453e9dae8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:20.298655 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a416a8-ff3c-4a00-9e58-c6453e9dae8b None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:20.299349 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a416a8-ff3c-4a00-9e58-c6453e9dae8b None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:20.299979 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a416a8-ff3c-4a00-9e58-c6453e9dae8b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:20.318552 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063878d-c8dd-4bf3-a39a-40790627eab0 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:20.319208 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a416a8-ff3c-4a00-9e58-c6453e9dae8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:20.328759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-54a416a8-ff3c-4a00-9e58-c6453e9dae8b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:50:20.328759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:20.328759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:20.328759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:20.328759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:20.328759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:20.328759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:20.328759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:20.328759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:20.328759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:20.328759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:20.328759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:20.328759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:20.328759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:20.328759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:20.328759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:20.329713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:20.329713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:20.329713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:20.329713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:20.329713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:20.329713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:20.329713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:20.329713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:20.329713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:20.329713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:20.329713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:20.329713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:20.329713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:20.329713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:20.329713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:20.329713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:20.330625 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:20.330625 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:20.330625 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:20.330625 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:20.330625 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:20.330625 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:20.330625 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:20.330625 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:20.330625 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:20.330625 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:20.330625 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 08:50:20.330625 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:20.332736 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 181/361] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:50:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:20.334509 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a416a8-ff3c-4a00-9e58-c6453e9dae8b None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:20.391162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288fcd6-7064-416c-bac9-df0b42780c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:20.392007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288fcd6-7064-416c-bac9-df0b42780c89 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:20.392573 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288fcd6-7064-416c-bac9-df0b42780c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:20.393009 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288fcd6-7064-416c-bac9-df0b42780c89 None admin] PATH_INFO: `/v3/projects/0601c68bf9ab41768a485e3991efe411` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:20.395999 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288fcd6-7064-416c-bac9-df0b42780c89 None admin] RBAC: Authorizing `identity:get_project(project_id=0601c68bf9ab41768a485e3991efe411)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:20.400349 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288fcd6-7064-416c-bac9-df0b42780c89 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:20.405116 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 181/362] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:50:20 2022] GET /identity/v3/projects/0601c68bf9ab41768a485e3991efe411 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:20.407403 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab507ffd-8d7b-4c97-b030-bba89ed4eceb None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:20.407849 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab507ffd-8d7b-4c97-b030-bba89ed4eceb None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:20.408290 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab507ffd-8d7b-4c97-b030-bba89ed4eceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:20.421984 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:20.447668 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-ab507ffd-8d7b-4c97-b030-bba89ed4eceb None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:20.450645 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ab507ffd-8d7b-4c97-b030-bba89ed4eceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:20.525236 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a416a8-ff3c-4a00-9e58-c6453e9dae8b None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:20.572227 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 182/363] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:20.574380 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab507ffd-8d7b-4c97-b030-bba89ed4eceb None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:20.581569 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:20.602123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce798f5-d762-4b33-91da-13e4d2a8a529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:20.603678 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce798f5-d762-4b33-91da-13e4d2a8a529 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:20.604124 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce798f5-d762-4b33-91da-13e4d2a8a529 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:20.604739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce798f5-d762-4b33-91da-13e4d2a8a529 None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:20.606058 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce798f5-d762-4b33-91da-13e4d2a8a529 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:20.606938 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce798f5-d762-4b33-91da-13e4d2a8a529 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:20.608901 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce798f5-d762-4b33-91da-13e4d2a8a529 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:20.624897 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 182/364] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:50:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:20.626103 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce798f5-d762-4b33-91da-13e4d2a8a529 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:20.745042 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab507ffd-8d7b-4c97-b030-bba89ed4eceb None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:20.803455 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06658591-5756-43cb-b6a4-047db09a50b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:20.804047 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce798f5-d762-4b33-91da-13e4d2a8a529 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:20.804205 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06658591-5756-43cb-b6a4-047db09a50b6 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:20.804335 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06658591-5756-43cb-b6a4-047db09a50b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:20.804614 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06658591-5756-43cb-b6a4-047db09a50b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:20.806093 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06658591-5756-43cb-b6a4-047db09a50b6 None admin] RBAC: Adding query filter params (group.id=2bf2b90562dc47e2a18a79b9e5344821, role.id=07fbbf1ea87a40f791466f0c934b4183, scope.project.id=c75e3b6b026f4fe9874853759e673fd6) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:20.809660 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06658591-5756-43cb-b6a4-047db09a50b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:20.810294 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06658591-5756-43cb-b6a4-047db09a50b6 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:20.816718 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 183/365] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Jul 27 08:50:20 2022] GET /identity/v3/role_assignments?group.id=2bf2b90562dc47e2a18a79b9e5344821&scope.project.id=c75e3b6b026f4fe9874853759e673fd6&role.id=07fbbf1ea87a40f791466f0c934b4183 => generated 260 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:20.827173 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06658591-5756-43cb-b6a4-047db09a50b6 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:20.828891 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:20.877430 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6ba97-f8ee-41e0-beaf-ebaa41d1ae2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:20.879028 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6ba97-f8ee-41e0-beaf-ebaa41d1ae2d None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:20.879798 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6ba97-f8ee-41e0-beaf-ebaa41d1ae2d None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:20.881561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6ba97-f8ee-41e0-beaf-ebaa41d1ae2d None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:20.884283 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6ba97-f8ee-41e0-beaf-ebaa41d1ae2d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:20.885194 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6ba97-f8ee-41e0-beaf-ebaa41d1ae2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:20.888939 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6ba97-f8ee-41e0-beaf-ebaa41d1ae2d None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:20.905366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 183/366] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 08:50:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:20.911476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6ba97-f8ee-41e0-beaf-ebaa41d1ae2d None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:20.994800 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:21.075849 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06658591-5756-43cb-b6a4-047db09a50b6 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:21.146126 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6ba97-f8ee-41e0-beaf-ebaa41d1ae2d None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:21.147515 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00671c88-d1a2-4f00-9aee-05ce9672d71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:21.148303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00671c88-d1a2-4f00-9aee-05ce9672d71c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:21.148780 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00671c88-d1a2-4f00-9aee-05ce9672d71c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:21.149449 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00671c88-d1a2-4f00-9aee-05ce9672d71c None admin] PATH_INFO: `/v3/groups/2bf2b90562dc47e2a18a79b9e5344821` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:21.151179 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00671c88-d1a2-4f00-9aee-05ce9672d71c None admin] RBAC: Authorizing `identity:get_group(group_id=2bf2b90562dc47e2a18a79b9e5344821)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:21.153130 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00671c88-d1a2-4f00-9aee-05ce9672d71c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:21.155912 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 184/367] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 08:50:20 2022] GET /identity/v3/groups/2bf2b90562dc47e2a18a79b9e5344821 => generated 226 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:21.158808 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00671c88-d1a2-4f00-9aee-05ce9672d71c None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:21.235604 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9139a42-163b-43d8-b72f-705dae8efeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:21.236532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9139a42-163b-43d8-b72f-705dae8efeed None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:21.237025 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9139a42-163b-43d8-b72f-705dae8efeed None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:21.237505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9139a42-163b-43d8-b72f-705dae8efeed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:21.262942 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9139a42-163b-43d8-b72f-705dae8efeed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:21.275599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-c9139a42-163b-43d8-b72f-705dae8efeed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:50:21.275599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:21.275599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:21.275599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:21.275599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:21.275599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:21.275599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:21.275599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:21.275599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:21.275599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:21.275599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:21.275599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:21.275599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:21.275599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:21.275599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:21.275599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:21.277454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:21.277454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:21.277454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:21.277454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:21.277454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:21.277454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:21.277454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:21.277454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:21.277454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:21.277454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:21.277454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:21.277454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:21.277454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:21.277454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:21.277454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:21.277454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:21.279532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:21.279532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:21.279532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:21.279532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:21.279532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:21.279532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:21.279532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:21.279532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:21.279532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:21.279532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:21.279532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:50:21.279532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:21.279532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 184/368] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:50:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:21.281101 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9139a42-163b-43d8-b72f-705dae8efeed None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:21.339531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:21.397870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00671c88-d1a2-4f00-9aee-05ce9672d71c None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:21.473000 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed196083-835b-4433-8325-3afceb59e663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:21.474075 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed196083-835b-4433-8325-3afceb59e663 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:21.474615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed196083-835b-4433-8325-3afceb59e663 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:21.475101 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed196083-835b-4433-8325-3afceb59e663 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:21.481391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:21.501461 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9139a42-163b-43d8-b72f-705dae8efeed None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:21.573851 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29ba7d-44ae-4c3b-90bf-9a8144d4f44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:21.574989 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29ba7d-44ae-4c3b-90bf-9a8144d4f44c None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:21.575490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29ba7d-44ae-4c3b-90bf-9a8144d4f44c None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:21.575966 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29ba7d-44ae-4c3b-90bf-9a8144d4f44c None admin] PATH_INFO: `/v3/users/ba5c22c8349044a094cf9858a8cfec08` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:21.578184 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29ba7d-44ae-4c3b-90bf-9a8144d4f44c None admin] RBAC: Authorizing `identity:get_user(user_id=ba5c22c8349044a094cf9858a8cfec08)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:21.581222 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29ba7d-44ae-4c3b-90bf-9a8144d4f44c None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:21.590375 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 185/369] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:50:21 2022] GET /identity/v3/users/ba5c22c8349044a094cf9858a8cfec08 => generated 293 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:21.590375 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29ba7d-44ae-4c3b-90bf-9a8144d4f44c None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:21.632307 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed196083-835b-4433-8325-3afceb59e663 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:21.635859 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed196083-835b-4433-8325-3afceb59e663 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:21.783149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:21.789931 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29ba7d-44ae-4c3b-90bf-9a8144d4f44c None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:21.826356 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 185/370] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:50:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:50:21.826356 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed196083-835b-4433-8325-3afceb59e663 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:21.841003 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f796ead-9914-4662-81c8-ba8808cf5413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:21.841954 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f796ead-9914-4662-81c8-ba8808cf5413 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:21.842449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f796ead-9914-4662-81c8-ba8808cf5413 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:21.842931 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f796ead-9914-4662-81c8-ba8808cf5413 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:21.844042 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f796ead-9914-4662-81c8-ba8808cf5413 None admin] RBAC: Adding query filter params (group.id=2bf2b90562dc47e2a18a79b9e5344821, role.id=87d42817a302438b93da02bfed3f6781, scope.project.id=0601c68bf9ab41768a485e3991efe411) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:21.844576 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f796ead-9914-4662-81c8-ba8808cf5413 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:21.846331 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f796ead-9914-4662-81c8-ba8808cf5413 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:21.862376 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 186/371] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Jul 27 08:50:21 2022] GET /identity/v3/role_assignments?group.id=2bf2b90562dc47e2a18a79b9e5344821&scope.project.id=0601c68bf9ab41768a485e3991efe411&role.id=87d42817a302438b93da02bfed3f6781 => generated 260 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:21.863891 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f796ead-9914-4662-81c8-ba8808cf5413 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:21.906955 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:22.130209 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f796ead-9914-4662-81c8-ba8808cf5413 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:22.158570 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed196083-835b-4433-8325-3afceb59e663 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:22.205807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a303aa3-b04d-47cd-bf20-113eb6980d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:22.206867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a303aa3-b04d-47cd-bf20-113eb6980d27 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:22.207331 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a303aa3-b04d-47cd-bf20-113eb6980d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:22.207786 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a303aa3-b04d-47cd-bf20-113eb6980d27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:22.209405 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a303aa3-b04d-47cd-bf20-113eb6980d27 None admin] RBAC: Adding query filter params (role.id=d1698ed994954594a9c70a2580f34a85, user.id=ba5c22c8349044a094cf9858a8cfec08, scope.system=all) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:22.209934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a303aa3-b04d-47cd-bf20-113eb6980d27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:22.213140 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a303aa3-b04d-47cd-bf20-113eb6980d27 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:22.239476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 187/372] 10.222.0.65 () {56 vars in 1308 bytes} [Wed Jul 27 08:50:21 2022] GET /identity/v3/role_assignments?user.id=ba5c22c8349044a094cf9858a8cfec08&scope.system=all&role.id=d1698ed994954594a9c70a2580f34a85 => generated 510 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:22.247174 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a303aa3-b04d-47cd-bf20-113eb6980d27 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:22.291224 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec03eb6-a3f0-4171-b0f5-5e54badf5e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:22.292290 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec03eb6-a3f0-4171-b0f5-5e54badf5e72 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:22.292784 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec03eb6-a3f0-4171-b0f5-5e54badf5e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:22.293258 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec03eb6-a3f0-4171-b0f5-5e54badf5e72 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:22.294222 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec03eb6-a3f0-4171-b0f5-5e54badf5e72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:22.294789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec03eb6-a3f0-4171-b0f5-5e54badf5e72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:22.296489 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec03eb6-a3f0-4171-b0f5-5e54badf5e72 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:22.304346 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:22.321376 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 186/373] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:50:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 498 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:22.328097 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec03eb6-a3f0-4171-b0f5-5e54badf5e72 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:22.501688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a303aa3-b04d-47cd-bf20-113eb6980d27 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:22.576746 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88e252-82c5-4452-a845-30e7301e8513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:22.577867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88e252-82c5-4452-a845-30e7301e8513 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:22.578377 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88e252-82c5-4452-a845-30e7301e8513 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:22.579126 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88e252-82c5-4452-a845-30e7301e8513 None admin] PATH_INFO: `/v3/projects/0601c68bf9ab41768a485e3991efe411` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:22.581532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88e252-82c5-4452-a845-30e7301e8513 None admin] RBAC: Authorizing `identity:get_project(project_id=0601c68bf9ab41768a485e3991efe411)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:22.585256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88e252-82c5-4452-a845-30e7301e8513 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:22.589061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 188/374] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:50:22 2022] GET /identity/v3/projects/0601c68bf9ab41768a485e3991efe411 => generated 302 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:22.599768 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88e252-82c5-4452-a845-30e7301e8513 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:22.613816 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:22.625344 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec03eb6-a3f0-4171-b0f5-5e54badf5e72 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:22.741624 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f1eba-ba47-47c7-9e4b-e2c917207198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:22.743270 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f1eba-ba47-47c7-9e4b-e2c917207198 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:22.744048 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f1eba-ba47-47c7-9e4b-e2c917207198 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:22.744802 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f1eba-ba47-47c7-9e4b-e2c917207198 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:22.821380 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:22.847158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88e252-82c5-4452-a845-30e7301e8513 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:22.885003 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f1eba-ba47-47c7-9e4b-e2c917207198 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:22.887307 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f1eba-ba47-47c7-9e4b-e2c917207198 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:22.913923 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e0656-253a-4d4a-befb-48991452c0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:22.915082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e0656-253a-4d4a-befb-48991452c0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:22.915555 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e0656-253a-4d4a-befb-48991452c0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:22.916029 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e0656-253a-4d4a-befb-48991452c0a5 None admin] PATH_INFO: `/v3/groups/2bf2b90562dc47e2a18a79b9e5344821` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:22.918443 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e0656-253a-4d4a-befb-48991452c0a5 None admin] RBAC: Authorizing `identity:get_group(group_id=2bf2b90562dc47e2a18a79b9e5344821)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:22.921345 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e0656-253a-4d4a-befb-48991452c0a5 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:22.924934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 189/375] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 08:50:22 2022] GET /identity/v3/groups/2bf2b90562dc47e2a18a79b9e5344821 => generated 226 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:22.930813 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13955837-cfeb-4c35-a7ed-f7c20ad19b82 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:22.930813 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13955837-cfeb-4c35-a7ed-f7c20ad19b82 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:22.930813 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13955837-cfeb-4c35-a7ed-f7c20ad19b82 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:22.931784 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 190/376] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:22.948248 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13955837-cfeb-4c35-a7ed-f7c20ad19b82 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:23.006735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:23.016269 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 187/377] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:50:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 689 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 08:50:23.017997 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c6c65-7819-4e86-9017-eef6fb7700b9 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:23.022788 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c6c65-7819-4e86-9017-eef6fb7700b9 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:23.023403 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c6c65-7819-4e86-9017-eef6fb7700b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:23.052401 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f48c6c65-7819-4e86-9017-eef6fb7700b9 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:23.053712 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f48c6c65-7819-4e86-9017-eef6fb7700b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:23.141690 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13955837-cfeb-4c35-a7ed-f7c20ad19b82 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:23.159779 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 188/378] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:23.161126 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c6c65-7819-4e86-9017-eef6fb7700b9 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:23.188368 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678d7c0-7e4a-43d7-9f70-fcef9bc212bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:23.188778 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678d7c0-7e4a-43d7-9f70-fcef9bc212bd None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:23.189008 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678d7c0-7e4a-43d7-9f70-fcef9bc212bd None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:23.189282 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678d7c0-7e4a-43d7-9f70-fcef9bc212bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:23.190115 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678d7c0-7e4a-43d7-9f70-fcef9bc212bd None admin] RBAC: Adding query filter params (group.id=2bf2b90562dc47e2a18a79b9e5344821, role.id=07fbbf1ea87a40f791466f0c934b4183, scope.project.id=0601c68bf9ab41768a485e3991efe411) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:23.190427 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678d7c0-7e4a-43d7-9f70-fcef9bc212bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:23.191912 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678d7c0-7e4a-43d7-9f70-fcef9bc212bd None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:23.199630 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 191/379] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Jul 27 08:50:22 2022] GET /identity/v3/role_assignments?group.id=2bf2b90562dc47e2a18a79b9e5344821&scope.project.id=0601c68bf9ab41768a485e3991efe411&role.id=07fbbf1ea87a40f791466f0c934b4183 => generated 260 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:23.200515 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678d7c0-7e4a-43d7-9f70-fcef9bc212bd None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:23.229586 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:23.282236 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c6c65-7819-4e86-9017-eef6fb7700b9 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:23.321537 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:23.331164 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cb36d-6b41-4db3-b30d-ccf0bfde3906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:23.331839 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cb36d-6b41-4db3-b30d-ccf0bfde3906 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:23.332116 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cb36d-6b41-4db3-b30d-ccf0bfde3906 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:23.332392 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cb36d-6b41-4db3-b30d-ccf0bfde3906 None admin] PATH_INFO: `/v3/projects/47adb2f515cc47f1ba5c310cfe03d1d5` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:23.336685 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8cb36d-6b41-4db3-b30d-ccf0bfde3906 None admin] RBAC: Authorizing `identity:get_project(project_id=47adb2f515cc47f1ba5c310cfe03d1d5)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:23.338450 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8cb36d-6b41-4db3-b30d-ccf0bfde3906 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:23.340345 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 189/380] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:50:23 2022] GET /identity/v3/projects/47adb2f515cc47f1ba5c310cfe03d1d5 => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:23.347137 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cb36d-6b41-4db3-b30d-ccf0bfde3906 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:23.350572 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678d7c0-7e4a-43d7-9f70-fcef9bc212bd None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:23.406867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f2dd1-ac18-48ef-9d7b-bdd3b9a023b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:23.407510 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f2dd1-ac18-48ef-9d7b-bdd3b9a023b2 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:23.407798 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f2dd1-ac18-48ef-9d7b-bdd3b9a023b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:23.408075 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f2dd1-ac18-48ef-9d7b-bdd3b9a023b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:23.421821 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f2dd1-ac18-48ef-9d7b-bdd3b9a023b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:23.427650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-8f4f2dd1-ac18-48ef-9d7b-bdd3b9a023b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:50:23.427650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:23.427650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:23.427650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:23.427650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:23.427650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:23.427650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:23.427650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:23.427650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:23.427650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:23.427650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:23.427650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:23.427650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:23.427650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:23.427650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:23.427650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:23.428601 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:23.428601 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:23.428601 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:23.428601 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:23.428601 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:23.428601 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:23.428601 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:23.428601 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:23.428601 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:23.428601 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:23.428601 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:23.428601 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:23.428601 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:23.428601 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:23.428601 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:23.428601 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:23.429378 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:23.429378 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:23.429378 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:23.429378 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:23.429378 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:23.429378 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:23.429378 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:23.429378 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:23.429378 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:23.429378 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:23.429378 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:50:23.429378 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:23.429378 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 192/381] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:50:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:23.438863 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f2dd1-ac18-48ef-9d7b-bdd3b9a023b2 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:23.623852 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:23.674095 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f2dd1-ac18-48ef-9d7b-bdd3b9a023b2 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:23.692710 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cb36d-6b41-4db3-b30d-ccf0bfde3906 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:23.741580 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70ff8d-d806-45e6-9ef6-9e2f8a711ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:23.743022 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70ff8d-d806-45e6-9ef6-9e2f8a711ecb None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:23.743697 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70ff8d-d806-45e6-9ef6-9e2f8a711ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:23.744358 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70ff8d-d806-45e6-9ef6-9e2f8a711ecb None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:23.746158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70ff8d-d806-45e6-9ef6-9e2f8a711ecb None admin] RBAC: Adding query filter params (name=member) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:23.746904 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70ff8d-d806-45e6-9ef6-9e2f8a711ecb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:23.749559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70ff8d-d806-45e6-9ef6-9e2f8a711ecb None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:23.767423 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 193/382] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 08:50:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:23.776577 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70ff8d-d806-45e6-9ef6-9e2f8a711ecb None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:23.784913 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eecaa0f-8697-4fe5-b787-99a545791e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:23.785551 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecaa0f-8697-4fe5-b787-99a545791e3e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:23.785928 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecaa0f-8697-4fe5-b787-99a545791e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:23.786301 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecaa0f-8697-4fe5-b787-99a545791e3e None admin] PATH_INFO: `/v3/groups/9e032a8171384c4cb5bb0d5f905c83e2` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:23.803266 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eecaa0f-8697-4fe5-b787-99a545791e3e None admin] RBAC: Authorizing `identity:get_group(group_id=9e032a8171384c4cb5bb0d5f905c83e2)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:23.804717 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eecaa0f-8697-4fe5-b787-99a545791e3e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:23.807861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 190/383] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 08:50:23 2022] GET /identity/v3/groups/9e032a8171384c4cb5bb0d5f905c83e2 => generated 229 bytes in 461 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:23.813639 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eecaa0f-8697-4fe5-b787-99a545791e3e None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:23.978815 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:24.005496 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70ff8d-d806-45e6-9ef6-9e2f8a711ecb None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:24.081908 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea3db3-1377-46b0-85d0-c3b23a3a060e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:24.083043 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea3db3-1377-46b0-85d0-c3b23a3a060e None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:24.083535 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea3db3-1377-46b0-85d0-c3b23a3a060e None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:24.084012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea3db3-1377-46b0-85d0-c3b23a3a060e None admin] PATH_INFO: `/v3/groups/2bf2b90562dc47e2a18a79b9e5344821` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:24.086562 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea3db3-1377-46b0-85d0-c3b23a3a060e None admin] RBAC: Authorizing `identity:get_group(group_id=2bf2b90562dc47e2a18a79b9e5344821)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:24.089720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea3db3-1377-46b0-85d0-c3b23a3a060e None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:24.093307 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 194/384] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 08:50:23 2022] GET /identity/v3/groups/2bf2b90562dc47e2a18a79b9e5344821 => generated 226 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:24.099735 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea3db3-1377-46b0-85d0-c3b23a3a060e None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:24.123497 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:24.128775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eecaa0f-8697-4fe5-b787-99a545791e3e None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:24.264253 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251bf02-7a65-4a1d-8a37-4511c0340632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:24.265268 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251bf02-7a65-4a1d-8a37-4511c0340632 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:24.265779 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251bf02-7a65-4a1d-8a37-4511c0340632 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:24.266254 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251bf02-7a65-4a1d-8a37-4511c0340632 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:24.267323 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251bf02-7a65-4a1d-8a37-4511c0340632 None admin] RBAC: Adding query filter params (group.id=9e032a8171384c4cb5bb0d5f905c83e2, role.id=20bc872844094480b9dca67a25b69e84, scope.project.id=47adb2f515cc47f1ba5c310cfe03d1d5) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:24.267847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251bf02-7a65-4a1d-8a37-4511c0340632 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:24.269563 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251bf02-7a65-4a1d-8a37-4511c0340632 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:24.288229 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 191/385] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Jul 27 08:50:23 2022] GET /identity/v3/role_assignments?group.id=9e032a8171384c4cb5bb0d5f905c83e2&scope.project.id=47adb2f515cc47f1ba5c310cfe03d1d5&role.id=20bc872844094480b9dca67a25b69e84 => generated 260 bytes in 475 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:50:24.360909 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea3db3-1377-46b0-85d0-c3b23a3a060e None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:24.435030 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b4106-406c-4734-a30f-574e35314fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:24.436132 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b4106-406c-4734-a30f-574e35314fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:24.436626 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b4106-406c-4734-a30f-574e35314fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:24.437105 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b4106-406c-4734-a30f-574e35314fe2 None admin] PATH_INFO: `/v3/projects/c75e3b6b026f4fe9874853759e673fd6` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:24.439267 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b4106-406c-4734-a30f-574e35314fe2 None admin] RBAC: Authorizing `identity:get_project(project_id=c75e3b6b026f4fe9874853759e673fd6)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:24.442073 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b4106-406c-4734-a30f-574e35314fe2 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:24.445680 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 195/386] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:50:24 2022] GET /identity/v3/projects/c75e3b6b026f4fe9874853759e673fd6 => generated 298 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:50:24.456200 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251bf02-7a65-4a1d-8a37-4511c0340632 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:24.626254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa8ad5-4f4c-4546-927e-e2d26f5ff78f None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:24.626804 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa8ad5-4f4c-4546-927e-e2d26f5ff78f None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:24.627245 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa8ad5-4f4c-4546-927e-e2d26f5ff78f None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:24.630144 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 196/387] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:24.640651 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89eaa7c-51b9-429e-97c4-5fc60c9ad86d None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:24.641153 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89eaa7c-51b9-429e-97c4-5fc60c9ad86d None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:24.641654 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89eaa7c-51b9-429e-97c4-5fc60c9ad86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:24.670519 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251bf02-7a65-4a1d-8a37-4511c0340632 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:24.693931 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-c89eaa7c-51b9-429e-97c4-5fc60c9ad86d None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:24.697803 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-c89eaa7c-51b9-429e-97c4-5fc60c9ad86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:24.707145 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:24.734462 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd465b63-ea07-439e-83b2-6c71a9fa02b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:24.735209 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd465b63-ea07-439e-83b2-6c71a9fa02b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:24.735488 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd465b63-ea07-439e-83b2-6c71a9fa02b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:24.735757 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd465b63-ea07-439e-83b2-6c71a9fa02b1 None admin] PATH_INFO: `/v3/projects/c75e3b6b026f4fe9874853759e673fd6/groups/2bf2b90562dc47e2a18a79b9e5344821/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:24.744924 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd465b63-ea07-439e-83b2-6c71a9fa02b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=c75e3b6b026f4fe9874853759e673fd6, group_id=2bf2b90562dc47e2a18a79b9e5344821, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:24.746565 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd465b63-ea07-439e-83b2-6c71a9fa02b1 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:24.777278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 192/388] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Jul 27 08:50:24 2022] PUT /identity/v3/projects/c75e3b6b026f4fe9874853759e673fd6/groups/2bf2b90562dc47e2a18a79b9e5344821/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:50:24.862298 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 197/389] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:50:24.923860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd465b63-ea07-439e-83b2-6c71a9fa02b1 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:25.018350 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f48b33-3613-4125-837e-4006a0f22999 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:25.018819 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f48b33-3613-4125-837e-4006a0f22999 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:25.019255 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f48b33-3613-4125-837e-4006a0f22999 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:25.030497 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 198/390] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:25.033654 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef3654-ede1-4bf1-a5c0-7fbc0eaaea04 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:25.034116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef3654-ede1-4bf1-a5c0-7fbc0eaaea04 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:25.034614 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef3654-ede1-4bf1-a5c0-7fbc0eaaea04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:25.060351 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:25.071696 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-e4ef3654-ede1-4bf1-a5c0-7fbc0eaaea04 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:25.073676 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-e4ef3654-ede1-4bf1-a5c0-7fbc0eaaea04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:25.137370 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd465b63-ea07-439e-83b2-6c71a9fa02b1 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:25.191692 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab073e6-5c3a-48d8-b94f-0e7dd1513acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:25.192361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab073e6-5c3a-48d8-b94f-0e7dd1513acf None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:25.192707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab073e6-5c3a-48d8-b94f-0e7dd1513acf None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:25.193043 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab073e6-5c3a-48d8-b94f-0e7dd1513acf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:25.206878 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab073e6-5c3a-48d8-b94f-0e7dd1513acf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:25.212851 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-7ab073e6-5c3a-48d8-b94f-0e7dd1513acf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:50:25.212851 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:25.212851 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:25.212851 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:25.212851 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:25.212851 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:25.212851 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:25.212851 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:25.212851 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:25.212851 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:25.212851 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:25.212851 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:25.212851 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:25.212851 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:25.212851 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:25.212851 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:25.213782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:25.213782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:25.213782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:25.213782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:25.213782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:25.213782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:25.213782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:25.213782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:25.213782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:25.213782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:25.213782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:25.213782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:25.213782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:25.213782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:25.213782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:25.213782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:25.214618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:25.214618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:25.214618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:25.214618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:25.214618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:25.214618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:25.214618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:25.214618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:25.214618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:25.214618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:25.214618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:50:25.214618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:25.214618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 193/391] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 08:50:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:25.220145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 199/392] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:50:25.223615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab073e6-5c3a-48d8-b94f-0e7dd1513acf None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:25.244143 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef3654-ede1-4bf1-a5c0-7fbc0eaaea04 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:25.335224 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:25.420731 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab073e6-5c3a-48d8-b94f-0e7dd1513acf None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:25.448294 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef3654-ede1-4bf1-a5c0-7fbc0eaaea04 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:25.468637 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434493c6-b431-4763-8859-24395b2f5bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:25.469278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434493c6-b431-4763-8859-24395b2f5bfa None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:25.469558 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434493c6-b431-4763-8859-24395b2f5bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:25.469829 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434493c6-b431-4763-8859-24395b2f5bfa None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:25.470629 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434493c6-b431-4763-8859-24395b2f5bfa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:25.470935 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434493c6-b431-4763-8859-24395b2f5bfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:25.472406 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434493c6-b431-4763-8859-24395b2f5bfa None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:25.490212 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 194/393] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:50:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:25.502446 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434493c6-b431-4763-8859-24395b2f5bfa None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:25.542109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3d1ef-412f-4828-b98e-a8f4f86660c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:25.542810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3d1ef-412f-4828-b98e-a8f4f86660c3 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:25.543077 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3d1ef-412f-4828-b98e-a8f4f86660c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:25.543346 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3d1ef-412f-4828-b98e-a8f4f86660c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:25.557311 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3d1ef-412f-4828-b98e-a8f4f86660c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:25.562703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-47e3d1ef-412f-4828-b98e-a8f4f86660c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:50:25.562703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:25.562703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:25.562703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:25.562703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:25.562703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:25.562703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:25.562703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:25.562703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:25.562703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:25.562703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:25.562703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:25.562703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:25.562703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:25.562703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:25.562703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:25.564482 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:25.564482 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:25.564482 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:25.564482 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:25.564482 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:25.564482 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:25.564482 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:25.564482 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:25.564482 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:25.564482 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:25.564482 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:25.564482 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:25.564482 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:25.564482 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:25.564482 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:25.564482 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:25.566055 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:25.566055 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:25.566055 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:25.566055 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:25.566055 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:25.566055 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:25.566055 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:25.566055 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:25.566055 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:25.566055 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:25.566055 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:50:25.566055 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:25.568919 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:25.569645 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 200/394] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:50:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:50:25.574374 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3d1ef-412f-4828-b98e-a8f4f86660c3 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:25.764283 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434493c6-b431-4763-8859-24395b2f5bfa None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:25.768981 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:25.800688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3d1ef-412f-4828-b98e-a8f4f86660c3 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:25.833250 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec607ceb-b2bd-414d-a014-76e9280ee8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:25.834503 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec607ceb-b2bd-414d-a014-76e9280ee8c1 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:25.835011 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec607ceb-b2bd-414d-a014-76e9280ee8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:25.835513 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec607ceb-b2bd-414d-a014-76e9280ee8c1 None admin] PATH_INFO: `/v3/groups/2bf2b90562dc47e2a18a79b9e5344821` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:25.837799 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec607ceb-b2bd-414d-a014-76e9280ee8c1 None admin] RBAC: Authorizing `identity:get_group(group_id=2bf2b90562dc47e2a18a79b9e5344821)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:25.840699 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec607ceb-b2bd-414d-a014-76e9280ee8c1 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:25.844408 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 195/395] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 08:50:25 2022] GET /identity/v3/groups/2bf2b90562dc47e2a18a79b9e5344821 => generated 226 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:25.852812 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec607ceb-b2bd-414d-a014-76e9280ee8c1 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:25.902887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ede7df-6ab2-4176-9a49-6c4ad8ae8709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:25.904049 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ede7df-6ab2-4176-9a49-6c4ad8ae8709 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:25.904730 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ede7df-6ab2-4176-9a49-6c4ad8ae8709 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:25.905241 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ede7df-6ab2-4176-9a49-6c4ad8ae8709 None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:25.906916 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ede7df-6ab2-4176-9a49-6c4ad8ae8709 None admin] RBAC: Adding query filter params (name=member) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:25.907488 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ede7df-6ab2-4176-9a49-6c4ad8ae8709 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:25.910518 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ede7df-6ab2-4176-9a49-6c4ad8ae8709 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:25.936168 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 201/396] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 08:50:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:25.953775 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ede7df-6ab2-4176-9a49-6c4ad8ae8709 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:25.982242 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec607ceb-b2bd-414d-a014-76e9280ee8c1 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:26.031778 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d1960-63e5-45a8-82aa-1b5c11f65179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:26.032557 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d1960-63e5-45a8-82aa-1b5c11f65179 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:26.032830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d1960-63e5-45a8-82aa-1b5c11f65179 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:26.033222 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d1960-63e5-45a8-82aa-1b5c11f65179 None admin] PATH_INFO: `/v3/projects/c75e3b6b026f4fe9874853759e673fd6` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:26.034716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d1960-63e5-45a8-82aa-1b5c11f65179 None admin] RBAC: Authorizing `identity:get_project(project_id=c75e3b6b026f4fe9874853759e673fd6)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:26.036738 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d1960-63e5-45a8-82aa-1b5c11f65179 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:26.038884 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 196/397] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:50:25 2022] GET /identity/v3/projects/c75e3b6b026f4fe9874853759e673fd6 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:50:26.047977 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d1960-63e5-45a8-82aa-1b5c11f65179 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:26.101146 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:26.114793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:26.240311 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d1960-63e5-45a8-82aa-1b5c11f65179 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:26.252663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ede7df-6ab2-4176-9a49-6c4ad8ae8709 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:26.325444 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae417f-ca93-4e57-8f4b-dae2172964f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:26.326146 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae417f-ca93-4e57-8f4b-dae2172964f0 None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:26.326462 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae417f-ca93-4e57-8f4b-dae2172964f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:26.326746 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae417f-ca93-4e57-8f4b-dae2172964f0 None admin] PATH_INFO: `/v3/projects/c75e3b6b026f4fe9874853759e673fd6/groups/2bf2b90562dc47e2a18a79b9e5344821/roles/07fbbf1ea87a40f791466f0c934b4183` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:26.330270 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae417f-ca93-4e57-8f4b-dae2172964f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c75e3b6b026f4fe9874853759e673fd6, group_id=2bf2b90562dc47e2a18a79b9e5344821, role_id=07fbbf1ea87a40f791466f0c934b4183)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:26.331144 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae417f-ca93-4e57-8f4b-dae2172964f0 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:26.347692 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 197/398] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Jul 27 08:50:26 2022] PUT /identity/v3/projects/c75e3b6b026f4fe9874853759e673fd6/groups/2bf2b90562dc47e2a18a79b9e5344821/roles/07fbbf1ea87a40f791466f0c934b4183 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:50:26.393942 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244459e-b32e-45d3-9ae3-8a7ad6d7a0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:26.395540 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244459e-b32e-45d3-9ae3-8a7ad6d7a0da None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:26.396236 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244459e-b32e-45d3-9ae3-8a7ad6d7a0da None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:26.396905 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244459e-b32e-45d3-9ae3-8a7ad6d7a0da None admin] PATH_INFO: `/v3/groups/2bf2b90562dc47e2a18a79b9e5344821` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:26.407934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244459e-b32e-45d3-9ae3-8a7ad6d7a0da None admin] RBAC: Authorizing `identity:get_group(group_id=2bf2b90562dc47e2a18a79b9e5344821)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:26.411377 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244459e-b32e-45d3-9ae3-8a7ad6d7a0da None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:26.415601 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 202/399] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 08:50:25 2022] GET /identity/v3/groups/2bf2b90562dc47e2a18a79b9e5344821 => generated 226 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:50:26.422174 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae417f-ca93-4e57-8f4b-dae2172964f0 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:26.632310 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae417f-ca93-4e57-8f4b-dae2172964f0 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:26.650848 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:26.684726 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c07e50-0c49-410f-9883-daeae9ad8224 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:26.685831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c07e50-0c49-410f-9883-daeae9ad8224 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:26.687819 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c07e50-0c49-410f-9883-daeae9ad8224 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:26.694358 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef417e-b435-45db-a462-58386729ab58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:26.694358 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef417e-b435-45db-a462-58386729ab58 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:26.694358 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef417e-b435-45db-a462-58386729ab58 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:26.694358 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef417e-b435-45db-a462-58386729ab58 None admin] PATH_INFO: `/v3/projects/0601c68bf9ab41768a485e3991efe411` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:26.695004 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef417e-b435-45db-a462-58386729ab58 None admin] RBAC: Authorizing `identity:get_project(project_id=0601c68bf9ab41768a485e3991efe411)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:26.695004 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef417e-b435-45db-a462-58386729ab58 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:26.696333 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 203/400] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:26 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:26.697797 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 198/401] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:50:26 2022] GET /identity/v3/projects/0601c68bf9ab41768a485e3991efe411 => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:26.705017 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef417e-b435-45db-a462-58386729ab58 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:26.705973 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3f1c1-2db7-4316-88b2-7ad0cf5b5d81 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:26.706260 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3f1c1-2db7-4316-88b2-7ad0cf5b5d81 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:26.709747 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3f1c1-2db7-4316-88b2-7ad0cf5b5d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:26.742019 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-9de3f1c1-2db7-4316-88b2-7ad0cf5b5d81 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:26.744288 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-9de3f1c1-2db7-4316-88b2-7ad0cf5b5d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:26.898392 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef417e-b435-45db-a462-58386729ab58 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:26.942237 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 204/402] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:50:26.958188 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c912028-a674-4217-9b7e-19da0bf38688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:26.958990 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c912028-a674-4217-9b7e-19da0bf38688 None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:26.959355 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c912028-a674-4217-9b7e-19da0bf38688 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:26.959639 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c912028-a674-4217-9b7e-19da0bf38688 None admin] PATH_INFO: `/v3/projects/0601c68bf9ab41768a485e3991efe411/groups/2bf2b90562dc47e2a18a79b9e5344821/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:26.963157 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c912028-a674-4217-9b7e-19da0bf38688 None admin] RBAC: Authorizing `identity:create_grant(project_id=0601c68bf9ab41768a485e3991efe411, group_id=2bf2b90562dc47e2a18a79b9e5344821, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:26.965083 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c912028-a674-4217-9b7e-19da0bf38688 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:26.989731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3f1c1-2db7-4316-88b2-7ad0cf5b5d81 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:27.017791 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 199/403] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Jul 27 08:50:26 2022] PUT /identity/v3/projects/0601c68bf9ab41768a485e3991efe411/groups/2bf2b90562dc47e2a18a79b9e5344821/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:50:27.154386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:27.239299 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3f1c1-2db7-4316-88b2-7ad0cf5b5d81 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:27.300902 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c142a-921d-4f96-aee4-9e00c26213fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:27.301589 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c142a-921d-4f96-aee4-9e00c26213fb None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:27.301975 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c142a-921d-4f96-aee4-9e00c26213fb None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:27.303810 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811f739-1daa-4808-bab2-fe090778eb7b None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:27.304313 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811f739-1daa-4808-bab2-fe090778eb7b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:27.304413 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811f739-1daa-4808-bab2-fe090778eb7b None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:27.306858 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c142a-921d-4f96-aee4-9e00c26213fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:27.307556 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 200/404] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:27.318774 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36db6ce-add1-4b76-8c7d-9f242a8e7ca5 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:27.319197 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36db6ce-add1-4b76-8c7d-9f242a8e7ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:27.319571 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36db6ce-add1-4b76-8c7d-9f242a8e7ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:27.330179 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c142a-921d-4f96-aee4-9e00c26213fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:27.336731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-b05c142a-921d-4f96-aee4-9e00c26213fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:50:27.336731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:27.336731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:27.336731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:27.336731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:27.336731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:27.336731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:27.336731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:27.336731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:27.336731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:27.336731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:27.336731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:27.336731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:27.336731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:27.336731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:27.336731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:27.339014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:27.339014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:27.339014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:27.339014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:27.339014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:27.339014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:27.339014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:27.339014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:27.339014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:27.339014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:27.339014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:27.339014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:27.339014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:27.339014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:27.339014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:27.339014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:27.341003 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:27.341003 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:27.341003 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:27.341003 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:27.341003 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:27.341003 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:27.341003 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:27.341003 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:27.341003 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:27.341003 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:27.341003 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:50:27.341003 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:27.341003 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 205/405] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 08:50:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:27.351443 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c142a-921d-4f96-aee4-9e00c26213fb None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:27.357955 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-e36db6ce-add1-4b76-8c7d-9f242a8e7ca5 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:27.357955 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e36db6ce-add1-4b76-8c7d-9f242a8e7ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:27.486860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:27.644272 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c142a-921d-4f96-aee4-9e00c26213fb None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:27.652371 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 201/406] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:50:27.686723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:27.703045 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437fda7-6c91-4074-bb25-a4265de6159e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:27.704439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437fda7-6c91-4074-bb25-a4265de6159e None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:27.705487 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437fda7-6c91-4074-bb25-a4265de6159e None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:27.705767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437fda7-6c91-4074-bb25-a4265de6159e None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:27.706553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437fda7-6c91-4074-bb25-a4265de6159e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:27.706860 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437fda7-6c91-4074-bb25-a4265de6159e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:27.707409 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36db6ce-add1-4b76-8c7d-9f242a8e7ca5 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:27.708299 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437fda7-6c91-4074-bb25-a4265de6159e None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:27.721009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 206/407] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:50:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:27.732136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437fda7-6c91-4074-bb25-a4265de6159e None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:27.898618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437fda7-6c91-4074-bb25-a4265de6159e None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:27.965365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10050c-6312-4bb9-a41f-fb27587198a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:27.966192 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10050c-6312-4bb9-a41f-fb27587198a6 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:27.966363 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10050c-6312-4bb9-a41f-fb27587198a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:27.966732 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10050c-6312-4bb9-a41f-fb27587198a6 None admin] PATH_INFO: `/v3/groups/2bf2b90562dc47e2a18a79b9e5344821` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:27.968640 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10050c-6312-4bb9-a41f-fb27587198a6 None admin] RBAC: Authorizing `identity:get_group(group_id=2bf2b90562dc47e2a18a79b9e5344821)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:27.970105 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10050c-6312-4bb9-a41f-fb27587198a6 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:27.973160 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 207/408] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 08:50:27 2022] GET /identity/v3/groups/2bf2b90562dc47e2a18a79b9e5344821 => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:27.979522 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36db6ce-add1-4b76-8c7d-9f242a8e7ca5 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:27.991411 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10050c-6312-4bb9-a41f-fb27587198a6 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:28.055043 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52269756-4e34-46d0-9c74-b57ca2fa6401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:28.056652 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52269756-4e34-46d0-9c74-b57ca2fa6401 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:28.057532 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52269756-4e34-46d0-9c74-b57ca2fa6401 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:28.058349 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52269756-4e34-46d0-9c74-b57ca2fa6401 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:28.082765 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52269756-4e34-46d0-9c74-b57ca2fa6401 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:28.093747 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-52269756-4e34-46d0-9c74-b57ca2fa6401 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:50:28.093747 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:28.093747 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:28.093747 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:28.093747 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:28.093747 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:28.093747 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:28.093747 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:28.093747 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:28.093747 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:28.093747 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:28.093747 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:28.093747 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:28.093747 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:28.093747 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:28.093747 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:28.095553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:28.095553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:28.095553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:28.095553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:28.095553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:28.095553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:28.095553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:28.095553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:28.095553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:28.095553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:28.095553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:28.095553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:28.095553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:28.095553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:28.095553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:28.095553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:28.097088 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:28.097088 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:28.097088 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:28.097088 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:28.097088 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:28.097088 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:28.097088 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:28.097088 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:28.097088 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:28.097088 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:28.097088 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:50:28.097088 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:28.102254 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 202/409] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:50:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:28.116072 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52269756-4e34-46d0-9c74-b57ca2fa6401 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:28.146493 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:28.163056 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:28.277100 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10050c-6312-4bb9-a41f-fb27587198a6 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:28.301162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52269756-4e34-46d0-9c74-b57ca2fa6401 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:28.354855 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f3a0b-1a06-4da0-bf6c-840639808958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:28.355756 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f3a0b-1a06-4da0-bf6c-840639808958 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:28.356076 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f3a0b-1a06-4da0-bf6c-840639808958 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:28.356520 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f3a0b-1a06-4da0-bf6c-840639808958 None admin] PATH_INFO: `/v3/projects/0601c68bf9ab41768a485e3991efe411` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:28.357866 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f52baa-9274-4941-a9d1-5a99dc5bc885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:28.358642 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f3a0b-1a06-4da0-bf6c-840639808958 None admin] RBAC: Authorizing `identity:get_project(project_id=0601c68bf9ab41768a485e3991efe411)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:28.358796 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f52baa-9274-4941-a9d1-5a99dc5bc885 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:28.359142 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f52baa-9274-4941-a9d1-5a99dc5bc885 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:28.359454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f3a0b-1a06-4da0-bf6c-840639808958 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:28.359640 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f52baa-9274-4941-a9d1-5a99dc5bc885 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:28.360426 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f52baa-9274-4941-a9d1-5a99dc5bc885 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:28.360836 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f52baa-9274-4941-a9d1-5a99dc5bc885 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:28.361546 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 208/410] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:50:27 2022] GET /identity/v3/projects/0601c68bf9ab41768a485e3991efe411 => generated 302 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:28.362469 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f52baa-9274-4941-a9d1-5a99dc5bc885 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:28.362806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c23818-7fb7-49a4-b5e2-5cd79d2d9921 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:28.363169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c23818-7fb7-49a4-b5e2-5cd79d2d9921 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:28.363450 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c23818-7fb7-49a4-b5e2-5cd79d2d9921 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:28.365132 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 209/411] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:28.371656 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d609ca-2853-4d59-b88d-5a77bdc39d68 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:28.372026 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d609ca-2853-4d59-b88d-5a77bdc39d68 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:28.372363 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d609ca-2853-4d59-b88d-5a77bdc39d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:28.378296 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 203/412] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:50:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:28.379275 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f52baa-9274-4941-a9d1-5a99dc5bc885 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:28.404952 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-12d609ca-2853-4d59-b88d-5a77bdc39d68 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:28.407468 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-12d609ca-2853-4d59-b88d-5a77bdc39d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:28.542361 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 210/413] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:28.542361 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d609ca-2853-4d59-b88d-5a77bdc39d68 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:28.553723 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:28.606240 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f52baa-9274-4941-a9d1-5a99dc5bc885 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:28.618822 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:28.693837 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a51466-1c76-4174-9dc4-42092397af2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:28.694587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a51466-1c76-4174-9dc4-42092397af2b None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:28.694866 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a51466-1c76-4174-9dc4-42092397af2b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:28.695143 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a51466-1c76-4174-9dc4-42092397af2b None admin] PATH_INFO: `/v3/projects/0601c68bf9ab41768a485e3991efe411/groups/2bf2b90562dc47e2a18a79b9e5344821/roles/07fbbf1ea87a40f791466f0c934b4183` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:28.698186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a51466-1c76-4174-9dc4-42092397af2b None admin] RBAC: Authorizing `identity:create_grant(project_id=0601c68bf9ab41768a485e3991efe411, group_id=2bf2b90562dc47e2a18a79b9e5344821, role_id=07fbbf1ea87a40f791466f0c934b4183)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:28.699687 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a51466-1c76-4174-9dc4-42092397af2b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:28.707206 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d609ca-2853-4d59-b88d-5a77bdc39d68 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:28.717294 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 204/414] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Jul 27 08:50:28 2022] PUT /identity/v3/projects/0601c68bf9ab41768a485e3991efe411/groups/2bf2b90562dc47e2a18a79b9e5344821/roles/07fbbf1ea87a40f791466f0c934b4183 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:50:28.718706 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a51466-1c76-4174-9dc4-42092397af2b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:28.775443 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a89dee-0754-4bef-ac93-7f6a397a69a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:28.776540 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a89dee-0754-4bef-ac93-7f6a397a69a3 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:28.777295 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a89dee-0754-4bef-ac93-7f6a397a69a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:28.777779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a89dee-0754-4bef-ac93-7f6a397a69a3 None admin] PATH_INFO: `/v3/groups/9e032a8171384c4cb5bb0d5f905c83e2` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:28.780249 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a89dee-0754-4bef-ac93-7f6a397a69a3 None admin] RBAC: Authorizing `identity:get_group(group_id=9e032a8171384c4cb5bb0d5f905c83e2)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:28.783365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a89dee-0754-4bef-ac93-7f6a397a69a3 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:28.786918 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 211/415] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 08:50:28 2022] GET /identity/v3/groups/9e032a8171384c4cb5bb0d5f905c83e2 => generated 229 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:28.795489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a89dee-0754-4bef-ac93-7f6a397a69a3 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:28.842551 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a51466-1c76-4174-9dc4-42092397af2b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:28.884242 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559c059-0ff5-4dfd-bf44-64a366659104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:28.885455 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559c059-0ff5-4dfd-bf44-64a366659104 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:28.885946 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559c059-0ff5-4dfd-bf44-64a366659104 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:28.886558 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559c059-0ff5-4dfd-bf44-64a366659104 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:28.896403 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:28.902803 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b559c059-0ff5-4dfd-bf44-64a366659104 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:28.910606 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-b559c059-0ff5-4dfd-bf44-64a366659104 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:50:28.910606 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:28.910606 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:28.910606 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:28.910606 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:28.910606 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:28.910606 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:28.910606 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:28.910606 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:28.910606 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:28.910606 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:28.910606 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:28.910606 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:28.910606 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:28.910606 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:28.910606 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:28.911642 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:28.911642 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:28.911642 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:28.911642 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:28.911642 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:28.911642 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:28.911642 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:28.911642 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:28.911642 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:28.911642 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:28.911642 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:28.911642 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:28.911642 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:28.911642 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:28.911642 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:28.911642 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:28.912459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:28.912459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:28.912459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:28.912459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:28.912459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:28.912459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:28.912459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:28.912459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:28.912459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:28.912459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:28.912459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:50:28.912459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:28.915360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 205/416] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:50:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:28.921964 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559c059-0ff5-4dfd-bf44-64a366659104 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:29.001890 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a89dee-0754-4bef-ac93-7f6a397a69a3 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:29.032230 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:29.055870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559c059-0ff5-4dfd-bf44-64a366659104 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:29.073686 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707de4e-cfa2-463f-b759-56a2cb3866ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:29.074739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707de4e-cfa2-463f-b759-56a2cb3866ff None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:29.075191 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707de4e-cfa2-463f-b759-56a2cb3866ff None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:29.075649 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707de4e-cfa2-463f-b759-56a2cb3866ff None admin] PATH_INFO: `/v3/projects/47adb2f515cc47f1ba5c310cfe03d1d5` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:29.077879 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707de4e-cfa2-463f-b759-56a2cb3866ff None admin] RBAC: Authorizing `identity:get_project(project_id=47adb2f515cc47f1ba5c310cfe03d1d5)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:29.080593 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707de4e-cfa2-463f-b759-56a2cb3866ff None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:29.090994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 212/417] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:50:28 2022] GET /identity/v3/projects/47adb2f515cc47f1ba5c310cfe03d1d5 => generated 344 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:29.100791 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8eb5c-3e70-4d6f-9531-b716c02488b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:29.102016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8eb5c-3e70-4d6f-9531-b716c02488b4 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:29.103069 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8eb5c-3e70-4d6f-9531-b716c02488b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:29.104203 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707de4e-cfa2-463f-b759-56a2cb3866ff None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:29.108531 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8eb5c-3e70-4d6f-9531-b716c02488b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:29.120554 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8eb5c-3e70-4d6f-9531-b716c02488b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:29.121236 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8eb5c-3e70-4d6f-9531-b716c02488b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:29.124666 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8eb5c-3e70-4d6f-9531-b716c02488b4 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:29.140116 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 206/418] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 08:50:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:50:29.146187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8eb5c-3e70-4d6f-9531-b716c02488b4 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:29.223061 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:29.281534 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8eb5c-3e70-4d6f-9531-b716c02488b4 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:29.286443 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707de4e-cfa2-463f-b759-56a2cb3866ff None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:29.331726 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b5b0e-6bd7-4a9f-b962-216ac34516ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:29.332319 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b5b0e-6bd7-4a9f-b962-216ac34516ec None admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:29.332817 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b5b0e-6bd7-4a9f-b962-216ac34516ec None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:29.333099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b5b0e-6bd7-4a9f-b962-216ac34516ec None admin] PATH_INFO: `/v3/projects/47adb2f515cc47f1ba5c310cfe03d1d5/groups/9e032a8171384c4cb5bb0d5f905c83e2/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:29.335715 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b5b0e-6bd7-4a9f-b962-216ac34516ec None admin] RBAC: Authorizing `identity:create_grant(project_id=47adb2f515cc47f1ba5c310cfe03d1d5, group_id=9e032a8171384c4cb5bb0d5f905c83e2, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:29.338209 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b5b0e-6bd7-4a9f-b962-216ac34516ec None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:29.361467 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 213/419] 10.222.0.65 () {58 vars in 1442 bytes} [Wed Jul 27 08:50:29 2022] PUT /identity/v3/projects/47adb2f515cc47f1ba5c310cfe03d1d5/groups/9e032a8171384c4cb5bb0d5f905c83e2/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:50:29.362227 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5045674-5e41-4a9f-af9e-32af567c18ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:29.363064 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5045674-5e41-4a9f-af9e-32af567c18ce None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:29.363398 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5045674-5e41-4a9f-af9e-32af567c18ce None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:29.363736 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5045674-5e41-4a9f-af9e-32af567c18ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:29.452107 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5045674-5e41-4a9f-af9e-32af567c18ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:29.453629 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5045674-5e41-4a9f-af9e-32af567c18ce None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:29.531293 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:29.583445 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 207/420] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:50:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 08:50:29.596405 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b5b0e-6bd7-4a9f-b962-216ac34516ec None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:29.600343 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30b998-b85d-4d54-9522-80a76a452cfb None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:29.600863 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30b998-b85d-4d54-9522-80a76a452cfb None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:29.601369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30b998-b85d-4d54-9522-80a76a452cfb None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:29.604227 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 208/421] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:29.624433 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54c8f3-387e-4640-a94e-81f1cd5a272c None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:29.624936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54c8f3-387e-4640-a94e-81f1cd5a272c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:29.625449 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54c8f3-387e-4640-a94e-81f1cd5a272c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:29.680868 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-1e54c8f3-387e-4640-a94e-81f1cd5a272c None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:29.683133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1e54c8f3-387e-4640-a94e-81f1cd5a272c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:29.692319 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:29.838375 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 209/422] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:50:29.838549 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b5b0e-6bd7-4a9f-b962-216ac34516ec None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:29.865645 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54c8f3-387e-4640-a94e-81f1cd5a272c None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:29.975465 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2c7cf-9232-438d-b8fb-dafeef9a4437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:29.976539 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2c7cf-9232-438d-b8fb-dafeef9a4437 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:29.977652 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2c7cf-9232-438d-b8fb-dafeef9a4437 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:29.978158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2c7cf-9232-438d-b8fb-dafeef9a4437 None admin] PATH_INFO: `/v3/projects/c75e3b6b026f4fe9874853759e673fd6` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:29.983588 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2c7cf-9232-438d-b8fb-dafeef9a4437 None admin] RBAC: Authorizing `identity:get_project(project_id=c75e3b6b026f4fe9874853759e673fd6)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:29.986154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2c7cf-9232-438d-b8fb-dafeef9a4437 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:29.989435 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 214/423] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:50:29 2022] GET /identity/v3/projects/c75e3b6b026f4fe9874853759e673fd6 => generated 298 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:29.989784 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:29.996620 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54c8f3-387e-4640-a94e-81f1cd5a272c None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:30.002933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2c7cf-9232-438d-b8fb-dafeef9a4437 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:30.038756 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78cb35-0cef-472d-9a4f-b67983d08f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:30.041183 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78cb35-0cef-472d-9a4f-b67983d08f63 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:30.041682 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78cb35-0cef-472d-9a4f-b67983d08f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:30.042160 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78cb35-0cef-472d-9a4f-b67983d08f63 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:30.054675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78cb35-0cef-472d-9a4f-b67983d08f63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:30.061132 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-3f78cb35-0cef-472d-9a4f-b67983d08f63 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:50:30.061132 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:30.061132 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:30.061132 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:30.061132 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:30.061132 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:30.061132 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:30.061132 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:30.061132 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:30.061132 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:30.061132 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:30.061132 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:30.061132 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:30.061132 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:30.061132 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:30.061132 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:30.062055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:30.062055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:30.062055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:30.062055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:30.062055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:30.062055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:30.062055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:30.062055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:30.062055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:30.062055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:30.062055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:30.062055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:30.062055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:30.062055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:30.062055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:30.062055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:30.062880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:30.062880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:30.062880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:30.062880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:30.062880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:30.062880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:30.062880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:30.062880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:30.062880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:30.062880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:30.062880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:50:30.062880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:30.065368 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 210/424] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 08:50:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:50:30.072569 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78cb35-0cef-472d-9a4f-b67983d08f63 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:30.199564 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78cb35-0cef-472d-9a4f-b67983d08f63 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:30.244891 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f56d16-3378-465f-bf03-402985b2eab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:30.246220 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f56d16-3378-465f-bf03-402985b2eab4 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:30.246994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f56d16-3378-465f-bf03-402985b2eab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:30.247463 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f56d16-3378-465f-bf03-402985b2eab4 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:30.248543 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f56d16-3378-465f-bf03-402985b2eab4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:30.249042 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f56d16-3378-465f-bf03-402985b2eab4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:30.251211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f56d16-3378-465f-bf03-402985b2eab4 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:30.266035 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 211/425] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:50:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:50:30.267558 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99bb7d-47c3-489f-ae01-1a7d29518093 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:30.268004 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99bb7d-47c3-489f-ae01-1a7d29518093 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:30.268404 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99bb7d-47c3-489f-ae01-1a7d29518093 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:30.271834 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2c7cf-9232-438d-b8fb-dafeef9a4437 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:30.274942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 212/426] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:30.276602 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99bb7d-47c3-489f-ae01-1a7d29518093 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:30.294487 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:30.299541 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:30.330814 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea77a5-afe6-4fad-91ed-580ec9e23818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:30.331645 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea77a5-afe6-4fad-91ed-580ec9e23818 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:30.332031 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea77a5-afe6-4fad-91ed-580ec9e23818 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:30.332408 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea77a5-afe6-4fad-91ed-580ec9e23818 None admin] PATH_INFO: `/v3/groups/2bf2b90562dc47e2a18a79b9e5344821` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:30.333778 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea77a5-afe6-4fad-91ed-580ec9e23818 None admin] RBAC: Authorizing `identity:get_group(group_id=2bf2b90562dc47e2a18a79b9e5344821)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:30.335419 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea77a5-afe6-4fad-91ed-580ec9e23818 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:30.338387 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 215/427] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 08:50:30 2022] GET /identity/v3/groups/2bf2b90562dc47e2a18a79b9e5344821 => generated 226 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:30.340052 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfed56-e473-4293-9fbf-5989a47de2e1 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:30.340382 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfed56-e473-4293-9fbf-5989a47de2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:30.340778 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfed56-e473-4293-9fbf-5989a47de2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:30.361370 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-b5dfed56-e473-4293-9fbf-5989a47de2e1 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:30.362817 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-b5dfed56-e473-4293-9fbf-5989a47de2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:30.421575 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99bb7d-47c3-489f-ae01-1a7d29518093 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:30.447956 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 216/428] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:30.449806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfed56-e473-4293-9fbf-5989a47de2e1 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:30.483964 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4088e-ad2d-46e7-a656-c97ce673232b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:30.484813 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4088e-ad2d-46e7-a656-c97ce673232b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:30.485223 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4088e-ad2d-46e7-a656-c97ce673232b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:30.485655 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4088e-ad2d-46e7-a656-c97ce673232b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:30.633954 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4088e-ad2d-46e7-a656-c97ce673232b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:30.636770 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4088e-ad2d-46e7-a656-c97ce673232b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:30.650571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfed56-e473-4293-9fbf-5989a47de2e1 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:30.668024 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:30.677537 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:30.737005 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659eff71-f5d6-4eeb-9579-b5f30d7b06b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:30.738450 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eff71-f5d6-4eeb-9579-b5f30d7b06b3 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:30.739194 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eff71-f5d6-4eeb-9579-b5f30d7b06b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:30.739883 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eff71-f5d6-4eeb-9579-b5f30d7b06b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:30.741938 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659eff71-f5d6-4eeb-9579-b5f30d7b06b3 None admin] RBAC: Adding query filter params (group.id=2bf2b90562dc47e2a18a79b9e5344821, role.id=87d42817a302438b93da02bfed3f6781, scope.project.id=c75e3b6b026f4fe9874853759e673fd6) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:30.742830 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659eff71-f5d6-4eeb-9579-b5f30d7b06b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:30.745864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659eff71-f5d6-4eeb-9579-b5f30d7b06b3 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:30.760559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 217/429] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Jul 27 08:50:30 2022] GET /identity/v3/role_assignments?group.id=2bf2b90562dc47e2a18a79b9e5344821&scope.project.id=c75e3b6b026f4fe9874853759e673fd6&role.id=87d42817a302438b93da02bfed3f6781 => generated 611 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:30.762585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659eff71-f5d6-4eeb-9579-b5f30d7b06b3 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:30.835109 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 213/430] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:50:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:50:30.844655 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4088e-ad2d-46e7-a656-c97ce673232b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:31.036676 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4088e-ad2d-46e7-a656-c97ce673232b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:31.057398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659eff71-f5d6-4eeb-9579-b5f30d7b06b3 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:31.060222 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:31.083334 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c49ffd-b1fa-41f7-829d-4824f564c213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:31.084008 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c49ffd-b1fa-41f7-829d-4824f564c213 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:31.084289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c49ffd-b1fa-41f7-829d-4824f564c213 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:31.084564 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c49ffd-b1fa-41f7-829d-4824f564c213 None admin] PATH_INFO: `/v3/projects/c75e3b6b026f4fe9874853759e673fd6` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:31.087046 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c49ffd-b1fa-41f7-829d-4824f564c213 None admin] RBAC: Authorizing `identity:get_project(project_id=c75e3b6b026f4fe9874853759e673fd6)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:31.088754 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c49ffd-b1fa-41f7-829d-4824f564c213 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:31.092442 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 214/431] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:50:30 2022] GET /identity/v3/projects/c75e3b6b026f4fe9874853759e673fd6 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:31.099635 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c49ffd-b1fa-41f7-829d-4824f564c213 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:31.119673 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a66e58-3abe-45b9-8f04-0267f7a05859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:31.120695 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a66e58-3abe-45b9-8f04-0267f7a05859 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:31.121178 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a66e58-3abe-45b9-8f04-0267f7a05859 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:31.121672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a66e58-3abe-45b9-8f04-0267f7a05859 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:31.138345 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a66e58-3abe-45b9-8f04-0267f7a05859 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:31.139789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-31a66e58-3abe-45b9-8f04-0267f7a05859 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:50:31.139789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:31.139789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:31.139789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:31.139789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:31.139789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:31.139789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:31.139789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:31.139789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:31.139789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:31.139789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:31.139789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:31.139789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:31.139789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:31.139789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:31.139789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:31.140673 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:31.140673 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:31.140673 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:31.140673 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:31.140673 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:31.140673 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:31.140673 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:31.140673 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:31.140673 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:31.140673 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:31.140673 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:31.140673 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:31.140673 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:31.140673 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:31.140673 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:31.140673 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:31.141457 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:31.141457 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:31.141457 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:31.141457 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:31.141457 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:31.141457 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:31.141457 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:31.141457 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:31.141457 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:31.141457 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:31.141457 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 08:50:31.141457 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:31.141457 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 218/432] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:50:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:31.147178 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a66e58-3abe-45b9-8f04-0267f7a05859 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:31.194690 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:31.271768 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c49ffd-b1fa-41f7-829d-4824f564c213 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:31.303519 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a66e58-3abe-45b9-8f04-0267f7a05859 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:31.323391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8c3c9-a348-42b2-b148-f0d142fdcf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:31.324211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8c3c9-a348-42b2-b148-f0d142fdcf06 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:31.324589 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8c3c9-a348-42b2-b148-f0d142fdcf06 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:31.324957 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8c3c9-a348-42b2-b148-f0d142fdcf06 None admin] PATH_INFO: `/v3/groups/2bf2b90562dc47e2a18a79b9e5344821` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:31.327217 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac8c3c9-a348-42b2-b148-f0d142fdcf06 None admin] RBAC: Authorizing `identity:get_group(group_id=2bf2b90562dc47e2a18a79b9e5344821)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:31.328964 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac8c3c9-a348-42b2-b148-f0d142fdcf06 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:31.331191 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 215/433] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 08:50:31 2022] GET /identity/v3/groups/2bf2b90562dc47e2a18a79b9e5344821 => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:31.344569 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8c3c9-a348-42b2-b148-f0d142fdcf06 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:31.371687 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b0c35-5d5c-43fc-8be2-6021292b1f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:31.372471 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b0c35-5d5c-43fc-8be2-6021292b1f49 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:31.372822 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b0c35-5d5c-43fc-8be2-6021292b1f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:31.373104 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b0c35-5d5c-43fc-8be2-6021292b1f49 None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:31.373862 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b0c35-5d5c-43fc-8be2-6021292b1f49 None admin] RBAC: Adding query filter params (name=member) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:31.374166 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b0c35-5d5c-43fc-8be2-6021292b1f49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:31.375612 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b0c35-5d5c-43fc-8be2-6021292b1f49 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:31.387486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 219/434] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 08:50:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:50:31.397834 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b0c35-5d5c-43fc-8be2-6021292b1f49 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:31.467861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:31.545043 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8c3c9-a348-42b2-b148-f0d142fdcf06 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:31.587192 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:31.609933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b0c35-5d5c-43fc-8be2-6021292b1f49 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:31.625459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df4069-ed3c-40d2-8659-7066ca648586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:31.626111 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df4069-ed3c-40d2-8659-7066ca648586 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:31.626433 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df4069-ed3c-40d2-8659-7066ca648586 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:31.626723 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df4069-ed3c-40d2-8659-7066ca648586 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:31.629863 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df4069-ed3c-40d2-8659-7066ca648586 None admin] RBAC: Adding query filter params (group.id=2bf2b90562dc47e2a18a79b9e5344821, role.id=07fbbf1ea87a40f791466f0c934b4183, scope.project.id=c75e3b6b026f4fe9874853759e673fd6) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:31.629863 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df4069-ed3c-40d2-8659-7066ca648586 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:31.632922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df4069-ed3c-40d2-8659-7066ca648586 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:31.642602 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 216/435] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Jul 27 08:50:31 2022] GET /identity/v3/role_assignments?group.id=2bf2b90562dc47e2a18a79b9e5344821&scope.project.id=c75e3b6b026f4fe9874853759e673fd6&role.id=07fbbf1ea87a40f791466f0c934b4183 => generated 611 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:50:31.691669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f73333-8d57-4edc-9d94-39442f2fa894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:31.692622 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f73333-8d57-4edc-9d94-39442f2fa894 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:31.693105 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f73333-8d57-4edc-9d94-39442f2fa894 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:31.693509 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f73333-8d57-4edc-9d94-39442f2fa894 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:31.814995 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f73333-8d57-4edc-9d94-39442f2fa894 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:31.817203 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f73333-8d57-4edc-9d94-39442f2fa894 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:31.982278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:32.008105 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 220/436] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:50:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 08:50:32.018016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df4069-ed3c-40d2-8659-7066ca648586 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:32.218728 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df4069-ed3c-40d2-8659-7066ca648586 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:32.245606 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:32.285570 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532b2b8-18cb-4758-82d3-40fa97f3f859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:32.286761 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532b2b8-18cb-4758-82d3-40fa97f3f859 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:32.287270 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532b2b8-18cb-4758-82d3-40fa97f3f859 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:32.287770 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532b2b8-18cb-4758-82d3-40fa97f3f859 None admin] PATH_INFO: `/v3/projects/0601c68bf9ab41768a485e3991efe411` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:32.290152 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532b2b8-18cb-4758-82d3-40fa97f3f859 None admin] RBAC: Authorizing `identity:get_project(project_id=0601c68bf9ab41768a485e3991efe411)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:32.292973 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532b2b8-18cb-4758-82d3-40fa97f3f859 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:32.301066 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 217/437] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:50:32 2022] GET /identity/v3/projects/0601c68bf9ab41768a485e3991efe411 => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:32.302133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f73333-8d57-4edc-9d94-39442f2fa894 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:32.313267 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038b6af-6f0c-4bde-bac6-1e11ec427bb4 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:32.313677 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038b6af-6f0c-4bde-bac6-1e11ec427bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:32.314115 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038b6af-6f0c-4bde-bac6-1e11ec427bb4 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:32.316657 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 218/438] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:32.325728 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614aa4a8-0a37-449d-9d14-c0622777410e None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:32.326172 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614aa4a8-0a37-449d-9d14-c0622777410e None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:32.326759 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614aa4a8-0a37-449d-9d14-c0622777410e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:32.356957 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-614aa4a8-0a37-449d-9d14-c0622777410e None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:32.358930 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-614aa4a8-0a37-449d-9d14-c0622777410e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:32.442620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f73333-8d57-4edc-9d94-39442f2fa894 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:32.458769 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 219/439] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:50:32.459856 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20041ef7-ce80-41de-9bc4-fcc4edbffcb4 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:32.460204 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20041ef7-ce80-41de-9bc4-fcc4edbffcb4 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:32.460449 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20041ef7-ce80-41de-9bc4-fcc4edbffcb4 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:32.469276 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 220/440] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:32.470567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d185dec-a770-49c8-9117-73a8d76ed40c None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:32.470855 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d185dec-a770-49c8-9117-73a8d76ed40c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:32.471133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d185dec-a770-49c8-9117-73a8d76ed40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:32.496349 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-5d185dec-a770-49c8-9117-73a8d76ed40c None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:32.497480 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-5d185dec-a770-49c8-9117-73a8d76ed40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:32.499003 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b1be4-d865-4b0d-8a47-e1cfdfe668d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:32.499677 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b1be4-d865-4b0d-8a47-e1cfdfe668d5 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:32.499957 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b1be4-d865-4b0d-8a47-e1cfdfe668d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:32.500234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b1be4-d865-4b0d-8a47-e1cfdfe668d5 None admin] PATH_INFO: `/v3/groups/2bf2b90562dc47e2a18a79b9e5344821` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:32.501451 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b1be4-d865-4b0d-8a47-e1cfdfe668d5 None admin] RBAC: Authorizing `identity:get_group(group_id=2bf2b90562dc47e2a18a79b9e5344821)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:32.502948 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b1be4-d865-4b0d-8a47-e1cfdfe668d5 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:32.504589 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 221/441] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 08:50:32 2022] GET /identity/v3/groups/2bf2b90562dc47e2a18a79b9e5344821 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:50:32.505645 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b1be4-d865-4b0d-8a47-e1cfdfe668d5 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:32.581739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:32.596355 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 221/442] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:50:32.597771 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d185dec-a770-49c8-9117-73a8d76ed40c None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:32.645317 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b1be4-d865-4b0d-8a47-e1cfdfe668d5 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:32.674901 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:32.693358 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db6e65-0086-4613-b59d-ed45d7c768d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:32.694489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db6e65-0086-4613-b59d-ed45d7c768d7 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:32.694969 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db6e65-0086-4613-b59d-ed45d7c768d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:32.695438 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db6e65-0086-4613-b59d-ed45d7c768d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:32.714426 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db6e65-0086-4613-b59d-ed45d7c768d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:32.720129 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-52db6e65-0086-4613-b59d-ed45d7c768d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:50:32.720129 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:32.720129 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:32.720129 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:32.720129 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:32.720129 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:32.720129 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:32.720129 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:32.720129 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:32.720129 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:32.720129 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:32.720129 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:32.720129 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:32.720129 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:32.720129 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:32.720129 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:32.721814 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:32.721814 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:32.721814 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:32.721814 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:32.721814 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:32.721814 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:32.721814 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:32.721814 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:32.721814 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:32.721814 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:32.721814 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:32.721814 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:32.721814 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:32.721814 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:32.721814 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:32.721814 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:32.722669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:32.722669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:32.722669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:32.722669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:32.722669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:32.722669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:32.722669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:32.722669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:32.722669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:32.722669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:32.722669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:50:32.722669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:32.722669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 222/443] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 08:50:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:32.722669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db6e65-0086-4613-b59d-ed45d7c768d7 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:32.750545 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d185dec-a770-49c8-9117-73a8d76ed40c None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:32.791882 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e238ba-0f4c-4f6f-b804-ea135156c816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:32.792646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e238ba-0f4c-4f6f-b804-ea135156c816 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:32.792980 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e238ba-0f4c-4f6f-b804-ea135156c816 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:32.793379 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e238ba-0f4c-4f6f-b804-ea135156c816 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:32.794371 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e238ba-0f4c-4f6f-b804-ea135156c816 None admin] RBAC: Adding query filter params (group.id=2bf2b90562dc47e2a18a79b9e5344821, role.id=87d42817a302438b93da02bfed3f6781, scope.project.id=0601c68bf9ab41768a485e3991efe411) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:32.794768 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e238ba-0f4c-4f6f-b804-ea135156c816 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:32.796327 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e238ba-0f4c-4f6f-b804-ea135156c816 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:32.803256 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 222/444] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Jul 27 08:50:32 2022] GET /identity/v3/role_assignments?group.id=2bf2b90562dc47e2a18a79b9e5344821&scope.project.id=0601c68bf9ab41768a485e3991efe411&role.id=87d42817a302438b93da02bfed3f6781 => generated 611 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:32.804287 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e238ba-0f4c-4f6f-b804-ea135156c816 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:32.865860 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db6e65-0086-4613-b59d-ed45d7c768d7 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:32.902547 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:32.925453 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c0c45-0284-466f-a358-6d83d062defa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:32.926123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c0c45-0284-466f-a358-6d83d062defa None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:32.926438 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c0c45-0284-466f-a358-6d83d062defa None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:32.926717 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c0c45-0284-466f-a358-6d83d062defa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:32.946250 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c0c45-0284-466f-a358-6d83d062defa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:32.956694 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-620c0c45-0284-466f-a358-6d83d062defa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:50:32.956694 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:32.956694 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:32.956694 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:32.956694 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:32.956694 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:32.956694 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:32.956694 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:32.956694 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:32.956694 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:32.956694 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:32.956694 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:32.956694 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:32.956694 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:32.956694 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:32.956694 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:32.957672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:32.957672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:32.957672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:32.957672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:32.957672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:32.957672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:32.957672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:32.957672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:32.957672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:32.957672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:32.957672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:32.957672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:32.957672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:32.957672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:32.957672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:32.957672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:32.958497 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:32.958497 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:32.958497 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:32.958497 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:32.958497 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:32.958497 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:32.958497 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:32.958497 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:32.958497 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:32.958497 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:32.958497 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:50:32.958497 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:32.958497 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 223/445] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:50:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:32.967653 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c0c45-0284-466f-a358-6d83d062defa None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:32.971700 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e238ba-0f4c-4f6f-b804-ea135156c816 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:32.981797 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:33.025990 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211145f-846b-4204-a978-559a77f8e0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:33.027057 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211145f-846b-4204-a978-559a77f8e0f7 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:33.027722 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211145f-846b-4204-a978-559a77f8e0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:33.028157 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211145f-846b-4204-a978-559a77f8e0f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:33.029041 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211145f-846b-4204-a978-559a77f8e0f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:33.029526 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211145f-846b-4204-a978-559a77f8e0f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:33.031300 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211145f-846b-4204-a978-559a77f8e0f7 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:33.043685 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 223/446] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:50:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:33.051400 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211145f-846b-4204-a978-559a77f8e0f7 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:33.113950 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c0c45-0284-466f-a358-6d83d062defa None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:33.173861 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da8772-d914-4421-bab4-3b9670b7f710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:33.175241 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da8772-d914-4421-bab4-3b9670b7f710 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:33.175723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da8772-d914-4421-bab4-3b9670b7f710 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:33.176205 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da8772-d914-4421-bab4-3b9670b7f710 None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:33.177507 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da8772-d914-4421-bab4-3b9670b7f710 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:33.178048 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da8772-d914-4421-bab4-3b9670b7f710 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:33.180805 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da8772-d914-4421-bab4-3b9670b7f710 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:33.194395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 224/447] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:50:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:33.205879 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da8772-d914-4421-bab4-3b9670b7f710 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:33.211598 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211145f-846b-4204-a978-559a77f8e0f7 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:33.253600 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e35b7-d259-4988-93bc-d0c355ab84cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:33.254527 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e35b7-d259-4988-93bc-d0c355ab84cf None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:33.254866 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e35b7-d259-4988-93bc-d0c355ab84cf None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:33.255137 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e35b7-d259-4988-93bc-d0c355ab84cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:33.283475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:33.317645 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:33.370138 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e35b7-d259-4988-93bc-d0c355ab84cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:33.372201 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e35b7-d259-4988-93bc-d0c355ab84cf None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:33.376800 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da8772-d914-4421-bab4-3b9670b7f710 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:33.413107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ab940-8318-4e93-86de-bee853723670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:33.413736 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ab940-8318-4e93-86de-bee853723670 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:33.414033 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ab940-8318-4e93-86de-bee853723670 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:33.414284 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ab940-8318-4e93-86de-bee853723670 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:33.488792 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ab940-8318-4e93-86de-bee853723670 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:33.490351 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ab940-8318-4e93-86de-bee853723670 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:33.536297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 224/448] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:50:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:50:33.542838 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e35b7-d259-4988-93bc-d0c355ab84cf None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:33.547067 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:33.621023 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:33.640867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 225/449] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:50:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:50:33.647903 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ab940-8318-4e93-86de-bee853723670 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:33.663028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e35b7-d259-4988-93bc-d0c355ab84cf None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:33.708750 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e6cd4-999b-42df-aa67-213ae2327dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:33.709764 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e6cd4-999b-42df-aa67-213ae2327dfc None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:33.710211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e6cd4-999b-42df-aa67-213ae2327dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:33.710693 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e6cd4-999b-42df-aa67-213ae2327dfc None admin] PATH_INFO: `/v3/projects/0601c68bf9ab41768a485e3991efe411` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:33.713393 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e6cd4-999b-42df-aa67-213ae2327dfc None admin] RBAC: Authorizing `identity:get_project(project_id=0601c68bf9ab41768a485e3991efe411)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:33.715886 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e6cd4-999b-42df-aa67-213ae2327dfc None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:33.725725 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 225/450] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:50:33 2022] GET /identity/v3/projects/0601c68bf9ab41768a485e3991efe411 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:50:33.727756 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e6cd4-999b-42df-aa67-213ae2327dfc None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:33.796543 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ab940-8318-4e93-86de-bee853723670 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:33.841680 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836c94f-48de-4aab-a3eb-cacc6541287b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:33.842361 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836c94f-48de-4aab-a3eb-cacc6541287b None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:33.842652 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836c94f-48de-4aab-a3eb-cacc6541287b None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:33.842925 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836c94f-48de-4aab-a3eb-cacc6541287b None admin] PATH_INFO: `/v3/projects/47adb2f515cc47f1ba5c310cfe03d1d5` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:33.844136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836c94f-48de-4aab-a3eb-cacc6541287b None admin] RBAC: Authorizing `identity:get_project(project_id=47adb2f515cc47f1ba5c310cfe03d1d5)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:33.845612 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836c94f-48de-4aab-a3eb-cacc6541287b None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:33.847353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 226/451] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:50:33 2022] GET /identity/v3/projects/47adb2f515cc47f1ba5c310cfe03d1d5 => generated 344 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:50:33.853527 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836c94f-48de-4aab-a3eb-cacc6541287b None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:33.853720 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e6cd4-999b-42df-aa67-213ae2327dfc None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:33.866361 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:33.891675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b90ed-56d6-43f7-95af-8718913b7b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:33.892479 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b90ed-56d6-43f7-95af-8718913b7b23 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:33.892821 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b90ed-56d6-43f7-95af-8718913b7b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:33.893238 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b90ed-56d6-43f7-95af-8718913b7b23 None admin] PATH_INFO: `/v3/groups/2bf2b90562dc47e2a18a79b9e5344821` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:33.894669 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b90ed-56d6-43f7-95af-8718913b7b23 None admin] RBAC: Authorizing `identity:get_group(group_id=2bf2b90562dc47e2a18a79b9e5344821)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:33.896289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b90ed-56d6-43f7-95af-8718913b7b23 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:33.898093 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 226/452] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 08:50:33 2022] GET /identity/v3/groups/2bf2b90562dc47e2a18a79b9e5344821 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:33.905251 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b90ed-56d6-43f7-95af-8718913b7b23 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:33.909364 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:33.968080 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836c94f-48de-4aab-a3eb-cacc6541287b None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:34.007933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29f076-45ae-4312-8183-e00661f39efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:34.008609 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29f076-45ae-4312-8183-e00661f39efe None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:34.009000 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29f076-45ae-4312-8183-e00661f39efe None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:34.009406 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29f076-45ae-4312-8183-e00661f39efe None admin] PATH_INFO: `/v3/groups/9e032a8171384c4cb5bb0d5f905c83e2` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:34.010777 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29f076-45ae-4312-8183-e00661f39efe None admin] RBAC: Authorizing `identity:get_group(group_id=9e032a8171384c4cb5bb0d5f905c83e2)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:34.012259 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29f076-45ae-4312-8183-e00661f39efe None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:34.014109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 227/453] 10.222.0.65 () {56 vars in 1180 bytes} [Wed Jul 27 08:50:33 2022] GET /identity/v3/groups/9e032a8171384c4cb5bb0d5f905c83e2 => generated 229 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:50:34.028198 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29f076-45ae-4312-8183-e00661f39efe None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:34.032450 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b90ed-56d6-43f7-95af-8718913b7b23 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:34.072471 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eaf6a8-27bd-4007-aacc-95f77075055d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:34.072988 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eaf6a8-27bd-4007-aacc-95f77075055d None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:34.073266 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eaf6a8-27bd-4007-aacc-95f77075055d None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:34.073540 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eaf6a8-27bd-4007-aacc-95f77075055d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:34.074378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eaf6a8-27bd-4007-aacc-95f77075055d None admin] RBAC: Adding query filter params (group.id=2bf2b90562dc47e2a18a79b9e5344821, role.id=07fbbf1ea87a40f791466f0c934b4183, scope.project.id=0601c68bf9ab41768a485e3991efe411) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:34.074664 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eaf6a8-27bd-4007-aacc-95f77075055d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:34.076102 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eaf6a8-27bd-4007-aacc-95f77075055d None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:34.082158 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 227/454] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Jul 27 08:50:33 2022] GET /identity/v3/role_assignments?group.id=2bf2b90562dc47e2a18a79b9e5344821&scope.project.id=0601c68bf9ab41768a485e3991efe411&role.id=07fbbf1ea87a40f791466f0c934b4183 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:50:34.121002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:34.148068 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29f076-45ae-4312-8183-e00661f39efe None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:34.196369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd32ec-3772-4e4d-813a-80624270800b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:34.197012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd32ec-3772-4e4d-813a-80624270800b None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:34.197296 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd32ec-3772-4e4d-813a-80624270800b None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:34.197575 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd32ec-3772-4e4d-813a-80624270800b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:34.198428 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd32ec-3772-4e4d-813a-80624270800b None admin] RBAC: Adding query filter params (group.id=9e032a8171384c4cb5bb0d5f905c83e2, role.id=20bc872844094480b9dca67a25b69e84, scope.project.id=47adb2f515cc47f1ba5c310cfe03d1d5) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:34.198747 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd32ec-3772-4e4d-813a-80624270800b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:34.200354 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd32ec-3772-4e4d-813a-80624270800b None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:34.209332 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 228/455] 10.222.0.65 () {56 vars in 1376 bytes} [Wed Jul 27 08:50:34 2022] GET /identity/v3/role_assignments?group.id=9e032a8171384c4cb5bb0d5f905c83e2&scope.project.id=47adb2f515cc47f1ba5c310cfe03d1d5&role.id=20bc872844094480b9dca67a25b69e84 => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:50:37.531834 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f097c-2004-4b7b-82da-22352ac8327a None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:37.533255 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f097c-2004-4b7b-82da-22352ac8327a None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:37.533956 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f097c-2004-4b7b-82da-22352ac8327a None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:37.537133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 228/456] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:37.546541 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fedece-0a37-4cdf-a96e-8c6e168506ee None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:37.547966 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fedece-0a37-4cdf-a96e-8c6e168506ee None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:37.548733 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fedece-0a37-4cdf-a96e-8c6e168506ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:37.593123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-64fedece-0a37-4cdf-a96e-8c6e168506ee None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:37.595276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-64fedece-0a37-4cdf-a96e-8c6e168506ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:37.685511 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8a4c6-3cbf-4a8b-985b-0603a504d4cf None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:37.686471 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8a4c6-3cbf-4a8b-985b-0603a504d4cf None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:37.687278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8a4c6-3cbf-4a8b-985b-0603a504d4cf None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:37.690418 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 229/457] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:37.700098 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f0bd2-622e-4f00-bcc0-71981eefe4f4 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:37.700950 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f0bd2-622e-4f00-bcc0-71981eefe4f4 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:37.701707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f0bd2-622e-4f00-bcc0-71981eefe4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:37.755713 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-719f0bd2-622e-4f00-bcc0-71981eefe4f4 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:37.760497 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-719f0bd2-622e-4f00-bcc0-71981eefe4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:37.799703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 229/458] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:50:37.843190 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fedece-0a37-4cdf-a96e-8c6e168506ee None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:37.967237 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:37.979106 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 230/459] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:50:37.981889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc457501-bba3-4e9c-a0b7-661babd62457 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:37.982741 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc457501-bba3-4e9c-a0b7-661babd62457 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:37.983438 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc457501-bba3-4e9c-a0b7-661babd62457 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:37.993348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 231/460] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:37 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:37.996014 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b8869-a12e-44fc-b315-895225c1e8ef None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:37.996684 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b8869-a12e-44fc-b315-895225c1e8ef None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:37.997308 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b8869-a12e-44fc-b315-895225c1e8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:38.030019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-a59b8869-a12e-44fc-b315-895225c1e8ef None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:38.032333 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a59b8869-a12e-44fc-b315-895225c1e8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:38.066522 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:38.137874 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fedece-0a37-4cdf-a96e-8c6e168506ee None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:38.163929 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 232/461] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:38.170361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b8869-a12e-44fc-b315-895225c1e8ef None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:38.240181 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b94e3d-d122-499d-9cca-8054fa373bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:38.241853 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b94e3d-d122-499d-9cca-8054fa373bff None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:38.242848 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b94e3d-d122-499d-9cca-8054fa373bff None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:38.244239 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b94e3d-d122-499d-9cca-8054fa373bff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:38.267631 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b94e3d-d122-499d-9cca-8054fa373bff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:38.270919 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b94e3d-d122-499d-9cca-8054fa373bff None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:38.301877 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-21b94e3d-d122-499d-9cca-8054fa373bff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:38.301877 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:38.301877 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:38.301877 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:38.301877 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:38.301877 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:38.301877 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:38.301877 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:38.301877 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:38.301877 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:38.301877 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:38.301877 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:38.301877 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:50:38.301877 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:50:38.301877 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:50:38.303610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:50:38.303610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:38.303610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:38.303610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:38.303610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:38.303610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:38.303610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:38.303610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:38.303610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:38.303610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:38.303610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:38.303610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:38.303610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:38.303610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:38.303610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:38.303610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:38.303610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:38.305927 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:50:38.305927 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:50:38.305927 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:38.305927 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:38.309853 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 230/462] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:50:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 468 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:50:38.311819 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b94e3d-d122-499d-9cca-8054fa373bff None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:38.389379 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b8869-a12e-44fc-b315-895225c1e8ef None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:38.443969 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:38.459048 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90537ca6-daf8-4f2d-9a57-a64b5e25b2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:38.460299 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90537ca6-daf8-4f2d-9a57-a64b5e25b2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:38.460767 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90537ca6-daf8-4f2d-9a57-a64b5e25b2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:38.461235 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90537ca6-daf8-4f2d-9a57-a64b5e25b2b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:38.482792 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90537ca6-daf8-4f2d-9a57-a64b5e25b2b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:38.485433 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90537ca6-daf8-4f2d-9a57-a64b5e25b2b9 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:38.508061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b94e3d-d122-499d-9cca-8054fa373bff None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:38.518378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-90537ca6-daf8-4f2d-9a57-a64b5e25b2b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:38.518378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:38.518378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:38.518378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:38.518378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:38.518378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:38.518378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:38.518378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:38.518378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:38.518378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:38.518378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:38.518378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:38.518378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:50:38.518378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:50:38.518378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:50:38.519356 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:50:38.519356 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:38.519356 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:38.519356 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:38.519356 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:38.519356 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:38.519356 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:38.519356 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:38.519356 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:38.519356 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:38.519356 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:38.519356 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:38.519356 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:38.519356 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:38.519356 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:38.519356 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:38.519356 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:38.520176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:50:38.520176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:50:38.520176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:38.520176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:38.522683 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 233/463] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:50:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:38.524402 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90537ca6-daf8-4f2d-9a57-a64b5e25b2b9 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:38.552500 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:38.568668 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb5ea5-03ee-4c5b-8fbf-269f9af4496f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:38.569333 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb5ea5-03ee-4c5b-8fbf-269f9af4496f None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:38.569610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb5ea5-03ee-4c5b-8fbf-269f9af4496f None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:38.569891 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb5ea5-03ee-4c5b-8fbf-269f9af4496f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:38.584144 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb5ea5-03ee-4c5b-8fbf-269f9af4496f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:38.587196 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb5ea5-03ee-4c5b-8fbf-269f9af4496f None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:38.610235 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-bddb5ea5-03ee-4c5b-8fbf-269f9af4496f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:38.610235 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:38.610235 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:38.610235 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:38.610235 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:38.610235 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:38.610235 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:38.610235 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:38.610235 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:38.610235 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:38.610235 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:38.610235 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:38.610235 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:50:38.610235 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:50:38.610235 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:50:38.611369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:50:38.611369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:38.611369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:38.611369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:38.611369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:38.611369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:38.611369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:38.611369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:38.611369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:38.611369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:38.611369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:38.611369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:38.611369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:38.611369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:38.611369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:38.611369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:38.611369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:38.612211 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:50:38.612211 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:50:38.612211 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:38.612211 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:38.612419 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 231/464] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:50:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:38.614600 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a16e5-e998-4d1e-a500-6d8d6981b8eb None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:38.615046 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a16e5-e998-4d1e-a500-6d8d6981b8eb None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:38.615529 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a16e5-e998-4d1e-a500-6d8d6981b8eb None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:38.622791 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 232/465] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:38.622791 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a16e5-e998-4d1e-a500-6d8d6981b8eb None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:38.695716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90537ca6-daf8-4f2d-9a57-a64b5e25b2b9 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:38.750045 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfbfefb-a7fb-4467-bb63-13a38ab8b6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:38.751040 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbfefb-a7fb-4467-bb63-13a38ab8b6cb None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:38.751521 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbfefb-a7fb-4467-bb63-13a38ab8b6cb None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:38.751885 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbfefb-a7fb-4467-bb63-13a38ab8b6cb None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:38.752732 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfbfefb-a7fb-4467-bb63-13a38ab8b6cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:38.753232 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfbfefb-a7fb-4467-bb63-13a38ab8b6cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:38.754947 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfbfefb-a7fb-4467-bb63-13a38ab8b6cb None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:38.772937 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 234/466] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:38.775098 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfbfefb-a7fb-4467-bb63-13a38ab8b6cb None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:38.793705 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a16e5-e998-4d1e-a500-6d8d6981b8eb None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:38.853048 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:38.857960 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b9e14-6d0a-4aa7-8223-e72d6e8aaff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:38.858903 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b9e14-6d0a-4aa7-8223-e72d6e8aaff7 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:38.859346 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b9e14-6d0a-4aa7-8223-e72d6e8aaff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:38.859784 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b9e14-6d0a-4aa7-8223-e72d6e8aaff7 None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:38.860972 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b9e14-6d0a-4aa7-8223-e72d6e8aaff7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:38.861421 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b9e14-6d0a-4aa7-8223-e72d6e8aaff7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:38.863611 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b9e14-6d0a-4aa7-8223-e72d6e8aaff7 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:38.884472 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 233/467] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:38.886392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014f835-de2b-4b27-bb95-5febba535286 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:38.886760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014f835-de2b-4b27-bb95-5febba535286 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:38.887122 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014f835-de2b-4b27-bb95-5febba535286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:38.916045 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-4014f835-de2b-4b27-bb95-5febba535286 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:38.918037 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-4014f835-de2b-4b27-bb95-5febba535286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:38.966177 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfbfefb-a7fb-4467-bb63-13a38ab8b6cb None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:38.968952 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:39.023513 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267a183-500b-4330-b750-cb2dcc959b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:39.025187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267a183-500b-4330-b750-cb2dcc959b5e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:39.025678 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267a183-500b-4330-b750-cb2dcc959b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:39.026152 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267a183-500b-4330-b750-cb2dcc959b5e None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:39.027757 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267a183-500b-4330-b750-cb2dcc959b5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:39.028283 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267a183-500b-4330-b750-cb2dcc959b5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:39.030961 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267a183-500b-4330-b750-cb2dcc959b5e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:39.050350 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 234/468] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:39.050350 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014f835-de2b-4b27-bb95-5febba535286 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:39.061270 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 235/469] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:39.062755 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267a183-500b-4330-b750-cb2dcc959b5e None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:39.246707 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014f835-de2b-4b27-bb95-5febba535286 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:39.252567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:39.257949 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267a183-500b-4330-b750-cb2dcc959b5e None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:39.308867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2364aa-0891-4395-bd5e-ee0b246288a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:39.309682 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2364aa-0891-4395-bd5e-ee0b246288a0 None admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:39.310155 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2364aa-0891-4395-bd5e-ee0b246288a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:39.310626 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2364aa-0891-4395-bd5e-ee0b246288a0 None admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:39.311765 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2364aa-0891-4395-bd5e-ee0b246288a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:39.314008 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2364aa-0891-4395-bd5e-ee0b246288a0 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:39.320849 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d2ae4-4b82-4d37-8df7-82e4ead8243e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:39.321747 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d2ae4-4b82-4d37-8df7-82e4ead8243e None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:39.322115 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d2ae4-4b82-4d37-8df7-82e4ead8243e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:39.322592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d2ae4-4b82-4d37-8df7-82e4ead8243e None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:39.323773 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d2ae4-4b82-4d37-8df7-82e4ead8243e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:39.326185 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d2ae4-4b82-4d37-8df7-82e4ead8243e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:39.351169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 235/470] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 08:50:39 2022] POST /identity/v3/users => generated 248 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:50:39.352293 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2364aa-0891-4395-bd5e-ee0b246288a0 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:39.373051 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 236/471] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 08:50:39 2022] POST /identity/v3/users => generated 248 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:50:39.374984 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d2ae4-4b82-4d37-8df7-82e4ead8243e None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:39.412753 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:39.608816 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2364aa-0891-4395-bd5e-ee0b246288a0 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:39.618241 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d2ae4-4b82-4d37-8df7-82e4ead8243e None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:39.669628 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241ee13-a3ed-44ce-b89e-e0a43a44848e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:39.670818 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241ee13-a3ed-44ce-b89e-e0a43a44848e None admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:39.671338 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241ee13-a3ed-44ce-b89e-e0a43a44848e None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:39.671824 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241ee13-a3ed-44ce-b89e-e0a43a44848e None admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:39.673151 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c241ee13-a3ed-44ce-b89e-e0a43a44848e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:39.675879 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c241ee13-a3ed-44ce-b89e-e0a43a44848e None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:39.699383 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615a4b8-9f6e-4366-a85c-a6c1f82c3964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:39.701888 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615a4b8-9f6e-4366-a85c-a6c1f82c3964 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:39.702253 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615a4b8-9f6e-4366-a85c-a6c1f82c3964 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:39.702834 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615a4b8-9f6e-4366-a85c-a6c1f82c3964 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:39.725888 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 236/472] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 08:50:39 2022] POST /identity/v3/users => generated 246 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:50:39.728528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44739a27-c6b3-41e2-9d36-8d7aac7df9cb None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:39.729310 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44739a27-c6b3-41e2-9d36-8d7aac7df9cb None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:39.730017 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44739a27-c6b3-41e2-9d36-8d7aac7df9cb None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:39.733038 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 237/473] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:39.738464 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615a4b8-9f6e-4366-a85c-a6c1f82c3964 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:39.739283 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615a4b8-9f6e-4366-a85c-a6c1f82c3964 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:39.743321 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5f9b8-4275-40e0-972c-54d69f702fb8 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:39.744282 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5f9b8-4275-40e0-972c-54d69f702fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:39.744694 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5f9b8-4275-40e0-972c-54d69f702fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:39.771529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-8615a4b8-9f6e-4366-a85c-a6c1f82c3964 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:39.771529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:39.771529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:39.771529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:39.771529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:39.771529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:39.771529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:39.771529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:39.771529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:39.771529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:39.771529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:39.771529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:39.771529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:50:39.771529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:50:39.771529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:50:39.772993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:50:39.772993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:39.772993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:39.772993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:39.772993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:39.772993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:39.772993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:39.772993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:39.772993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:39.772993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:39.772993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:39.772993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:39.772993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:39.772993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:39.772993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:39.772993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:39.772993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:39.774884 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:50:39.774884 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:50:39.774884 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:39.774884 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:39.777829 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-dbc5f9b8-4275-40e0-972c-54d69f702fb8 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:39.779399 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 237/474] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:50:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:39.779896 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-dbc5f9b8-4275-40e0-972c-54d69f702fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:39.785563 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615a4b8-9f6e-4366-a85c-a6c1f82c3964 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:39.811398 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:39.909640 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 238/475] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:50:39.947943 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5f9b8-4275-40e0-972c-54d69f702fb8 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:39.966842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:40.024530 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615a4b8-9f6e-4366-a85c-a6c1f82c3964 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:40.104628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e9302-80b5-443e-9161-6b752eacafb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:40.105784 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e9302-80b5-443e-9161-6b752eacafb3 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:40.106227 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e9302-80b5-443e-9161-6b752eacafb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:40.107028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e9302-80b5-443e-9161-6b752eacafb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:40.108866 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e9302-80b5-443e-9161-6b752eacafb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:40.109362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e9302-80b5-443e-9161-6b752eacafb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:40.112513 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e9302-80b5-443e-9161-6b752eacafb3 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:40.143182 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 238/476] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:50:40.148126 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e9302-80b5-443e-9161-6b752eacafb3 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:40.200923 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5f9b8-4275-40e0-972c-54d69f702fb8 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:40.258953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:40.277600 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889b3e7-4f70-4cc6-bd2b-acf5de40695e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:40.278546 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889b3e7-4f70-4cc6-bd2b-acf5de40695e None admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:40.279036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889b3e7-4f70-4cc6-bd2b-acf5de40695e None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:40.279551 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889b3e7-4f70-4cc6-bd2b-acf5de40695e None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:40.280313 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889b3e7-4f70-4cc6-bd2b-acf5de40695e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:40.281774 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889b3e7-4f70-4cc6-bd2b-acf5de40695e None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:40.293011 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.sql.core [None req-9889b3e7-4f70-4cc6-bd2b-acf5de40695e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 08:50:40.293011 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 27 08:50:40.293011 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [parameters: {'id': '90fb8809076d4e38bb2ec1390bcb9a7b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 27 08:50:40.293011 dv-cinder-797608-64-smb devstack@keystone.service[80153]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80153) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 08:50:40.311846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-9889b3e7-4f70-4cc6-bd2b-acf5de40695e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 27 08:50:40.311846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:40.311846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 08:50:40.311846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 08:50:40.311846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 08:50:40.311846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 08:50:40.311846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 08:50:40.311846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 08:50:40.311846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 08:50:40.311846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application conn.query(q) Jul 27 08:50:40.311846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 08:50:40.311846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 08:50:40.311846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 08:50:40.311846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application result.read() Jul 27 08:50:40.311846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 08:50:40.313617 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 08:50:40.313617 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 08:50:40.313617 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 08:50:40.313617 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 08:50:40.313617 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 08:50:40.313617 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 08:50:40.313617 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 08:50:40.313617 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 08:50:40.313617 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:40.313617 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 08:50:40.313617 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:40.313617 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:40.313617 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 08:50:40.313617 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 08:50:40.313617 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 27 08:50:40.313617 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return ref.to_dict() Jul 27 08:50:40.313617 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 08:50:40.313617 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application next(self.gen) Jul 27 08:50:40.316146 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 08:50:40.316146 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application yield resource Jul 27 08:50:40.316146 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 08:50:40.316146 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application next(self.gen) Jul 27 08:50:40.316146 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 08:50:40.316146 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 08:50:40.316146 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 08:50:40.316146 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 08:50:40.316146 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 08:50:40.316146 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise self.value Jul 27 08:50:40.316146 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 08:50:40.316146 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 08:50:40.316146 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 08:50:40.316146 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application session.commit() Jul 27 08:50:40.316146 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 08:50:40.316146 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 08:50:40.316146 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 08:50:40.318163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 08:50:40.318163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 08:50:40.318163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self.session.flush() Jul 27 08:50:40.318163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 08:50:40.318163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 08:50:40.318163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 08:50:40.318163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 08:50:40.318163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 08:50:40.318163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application compat.raise_( Jul 27 08:50:40.318163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 08:50:40.318163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception Jul 27 08:50:40.318163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 08:50:40.318163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 08:50:40.318163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 08:50:40.318163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 08:50:40.318163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 08:50:40.318163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 08:50:40.325565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 08:50:40.325565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 08:50:40.325565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 27 08:50:40.325565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 27 08:50:40.325565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 08:50:40.325565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 08:50:40.325565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 08:50:40.325565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 08:50:40.325565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 08:50:40.325565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 08:50:40.325565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 08:50:40.325565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 08:50:40.325565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 08:50:40.325565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 08:50:40.325565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 08:50:40.325565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception Jul 27 08:50:40.328520 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 08:50:40.328520 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 08:50:40.328520 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 08:50:40.328520 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 08:50:40.328520 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 08:50:40.328520 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 08:50:40.328520 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 08:50:40.328520 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application conn.query(q) Jul 27 08:50:40.328520 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 08:50:40.328520 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 08:50:40.328520 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 08:50:40.328520 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application result.read() Jul 27 08:50:40.328520 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 08:50:40.328520 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 08:50:40.328520 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 08:50:40.328520 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 08:50:40.331118 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 08:50:40.331118 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 08:50:40.331118 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 08:50:40.331118 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 08:50:40.331118 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 08:50:40.331118 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 27 08:50:40.331118 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [parameters: {'id': '90fb8809076d4e38bb2ec1390bcb9a7b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 27 08:50:40.331118 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 08:50:40.331118 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:40.331118 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:50:40.331118 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:40.331118 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:40.331118 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:40.331118 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:40.331118 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:40.331118 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:40.333276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:40.333276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:40.333276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:40.333276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:40.333276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:40.333276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:40.333276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 27 08:50:40.333276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 27 08:50:40.333276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:40.333276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:40.333276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 27 08:50:40.333276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 27 08:50:40.333276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 08:50:40.333276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 08:50:40.333276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 27 08:50:40.333276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:40.335648 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 239/477] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Jul 27 08:50:39 2022] POST /identity/v3/roles => generated 144 bytes in 367 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:40.341935 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e9302-80b5-443e-9161-6b752eacafb3 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:40.344857 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889b3e7-4f70-4cc6-bd2b-acf5de40695e None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:40.396654 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48456a-a295-4272-9a33-4ed2b9571cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:40.397297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48456a-a295-4272-9a33-4ed2b9571cc7 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:40.397583 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48456a-a295-4272-9a33-4ed2b9571cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:40.397860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48456a-a295-4272-9a33-4ed2b9571cc7 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:40.398676 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48456a-a295-4272-9a33-4ed2b9571cc7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:40.401331 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48456a-a295-4272-9a33-4ed2b9571cc7 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:40.438071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 239/478] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 08:50:40 2022] POST /identity/v3/users => generated 249 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:50:40.503016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:40.569975 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889b3e7-4f70-4cc6-bd2b-acf5de40695e None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:40.639602 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910439b6-edad-4d92-9163-ad1d7f0aa924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:40.641795 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910439b6-edad-4d92-9163-ad1d7f0aa924 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:40.642505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910439b6-edad-4d92-9163-ad1d7f0aa924 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:40.643159 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910439b6-edad-4d92-9163-ad1d7f0aa924 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:40.667126 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910439b6-edad-4d92-9163-ad1d7f0aa924 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:40.679214 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-910439b6-edad-4d92-9163-ad1d7f0aa924 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:50:40.679214 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:40.679214 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:40.679214 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:40.679214 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:40.679214 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:40.679214 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:40.679214 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:40.679214 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:40.679214 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:40.679214 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:40.679214 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:40.679214 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:40.679214 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:40.679214 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:40.679214 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:40.681685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:40.681685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:40.681685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:40.681685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:40.681685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:40.681685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:40.681685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:40.681685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:40.681685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:40.681685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:40.681685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:40.681685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:40.681685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:40.681685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:40.681685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:40.681685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:40.683287 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:40.683287 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:40.683287 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:40.683287 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:40.683287 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:40.683287 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:40.683287 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:40.683287 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:40.683287 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:40.683287 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:40.683287 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 08:50:40.683287 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:40.687439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 240/479] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 08:50:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:50:40.697252 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48456a-a295-4272-9a33-4ed2b9571cc7 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:40.920776 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48456a-a295-4272-9a33-4ed2b9571cc7 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:40.974774 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:40.996876 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1184e9-fada-4225-9f05-b22ff4de008f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:40.997918 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1184e9-fada-4225-9f05-b22ff4de008f None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:40.998462 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1184e9-fada-4225-9f05-b22ff4de008f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:40.998921 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1184e9-fada-4225-9f05-b22ff4de008f None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:41.001082 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1184e9-fada-4225-9f05-b22ff4de008f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:41.001889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1184e9-fada-4225-9f05-b22ff4de008f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:41.004264 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1184e9-fada-4225-9f05-b22ff4de008f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:41.020792 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 240/480] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:50:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:42.600510 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f2227-c129-4419-b8ab-27fa3666b6c1 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:42.601584 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f2227-c129-4419-b8ab-27fa3666b6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:42.601584 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f2227-c129-4419-b8ab-27fa3666b6c1 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:42.603573 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 241/481] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:42.611240 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a99e57-3cc6-4d25-9c78-c27f22dc2746 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:42.612166 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a99e57-3cc6-4d25-9c78-c27f22dc2746 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:42.612166 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a99e57-3cc6-4d25-9c78-c27f22dc2746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:42.639632 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-e5a99e57-3cc6-4d25-9c78-c27f22dc2746 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:42.640927 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e5a99e57-3cc6-4d25-9c78-c27f22dc2746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:42.739427 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 241/482] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:42.779135 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f2227-c129-4419-b8ab-27fa3666b6c1 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:42.956350 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f2227-c129-4419-b8ab-27fa3666b6c1 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:43.002433 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:43.012824 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f731d-c170-463f-bde8-158e9755c922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:43.013492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f731d-c170-463f-bde8-158e9755c922 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:43.018991 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f731d-c170-463f-bde8-158e9755c922 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:43.019392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f731d-c170-463f-bde8-158e9755c922 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:43.042612 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f731d-c170-463f-bde8-158e9755c922 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:43.047665 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-fe7f731d-c170-463f-bde8-158e9755c922 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:50:43.047665 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:43.047665 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:43.047665 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:43.047665 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:43.047665 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:43.047665 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:43.047665 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:43.047665 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:43.047665 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:43.047665 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:43.047665 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:43.047665 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:43.047665 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:43.047665 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:43.047665 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:43.049663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:43.049663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:43.049663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:43.049663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:43.049663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:43.049663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:43.049663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:43.049663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:43.049663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:43.049663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:43.049663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:43.049663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:43.049663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:43.049663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:43.049663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:43.049663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:43.052002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:43.052002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:43.052002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:43.052002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:43.052002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:43.052002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:43.052002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:43.052002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:43.052002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:43.052002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:43.052002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:50:43.052002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:43.052002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 242/483] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 08:50:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:50:43.058884 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a99e57-3cc6-4d25-9c78-c27f22dc2746 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:43.198371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2850f-5894-4714-9b82-7c63d468963c None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:43.198371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2850f-5894-4714-9b82-7c63d468963c None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:43.198371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2850f-5894-4714-9b82-7c63d468963c None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:43.200591 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 243/484] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:50:43.210195 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4843ed1-b654-4bc8-9182-420ddb43e3ec None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:43.211199 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4843ed1-b654-4bc8-9182-420ddb43e3ec None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:43.212177 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4843ed1-b654-4bc8-9182-420ddb43e3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:43.245682 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-c4843ed1-b654-4bc8-9182-420ddb43e3ec None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:43.248291 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-c4843ed1-b654-4bc8-9182-420ddb43e3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:43.370359 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a99e57-3cc6-4d25-9c78-c27f22dc2746 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:43.411398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 244/485] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:43.423581 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:43.467747 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ca87d-b53e-42cd-85af-05308035b4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:43.469385 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ca87d-b53e-42cd-85af-05308035b4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:43.470194 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ca87d-b53e-42cd-85af-05308035b4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:43.470963 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ca87d-b53e-42cd-85af-05308035b4a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:43.472681 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ca87d-b53e-42cd-85af-05308035b4a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:43.473543 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ca87d-b53e-42cd-85af-05308035b4a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:43.476558 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ca87d-b53e-42cd-85af-05308035b4a5 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:43.491620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4843ed1-b654-4bc8-9182-420ddb43e3ec None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:43.496224 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 242/486] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 08:50:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:50:43.510635 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ca87d-b53e-42cd-85af-05308035b4a5 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:43.730174 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4843ed1-b654-4bc8-9182-420ddb43e3ec None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:43.780237 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:43.785089 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ca87d-b53e-42cd-85af-05308035b4a5 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:43.813648 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f3cd0-1233-44ad-a806-147d3d0fc031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:43.814816 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f3cd0-1233-44ad-a806-147d3d0fc031 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:43.815297 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f3cd0-1233-44ad-a806-147d3d0fc031 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:43.815759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f3cd0-1233-44ad-a806-147d3d0fc031 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:43.833841 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b33a46-6af2-4152-bf75-e4fba13e47d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:43.834869 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b33a46-6af2-4152-bf75-e4fba13e47d8 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:43.835361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b33a46-6af2-4152-bf75-e4fba13e47d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:43.835828 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b33a46-6af2-4152-bf75-e4fba13e47d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:43.852307 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f3cd0-1233-44ad-a806-147d3d0fc031 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:43.853820 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b33a46-6af2-4152-bf75-e4fba13e47d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:43.856621 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b33a46-6af2-4152-bf75-e4fba13e47d8 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:43.858743 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-390f3cd0-1233-44ad-a806-147d3d0fc031 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:50:43.858743 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:43.858743 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:43.858743 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:43.858743 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:43.858743 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:43.858743 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:43.858743 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:43.858743 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:43.858743 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:43.858743 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:43.858743 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:43.858743 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:43.858743 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:43.858743 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:43.858743 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:43.859641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:43.859641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:43.859641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:43.859641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:43.859641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:43.859641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:43.859641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:43.859641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:43.859641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:43.859641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:43.859641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:43.859641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:43.859641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:43.859641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:43.859641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:43.859641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:43.860433 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:43.860433 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:43.860433 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:43.860433 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:43.860433 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:43.860433 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:43.860433 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:43.860433 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:43.860433 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:43.860433 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:43.860433 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:50:43.860433 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:43.863169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 245/487] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 08:50:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:43.891807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f3cd0-1233-44ad-a806-147d3d0fc031 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:43.900226 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-93b33a46-6af2-4152-bf75-e4fba13e47d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:43.900226 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:43.900226 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:43.900226 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:43.900226 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:43.900226 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:43.900226 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:43.900226 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:43.900226 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:43.900226 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:43.900226 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:43.900226 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:43.900226 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:50:43.900226 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:50:43.900226 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:50:43.901179 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:50:43.901179 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:43.901179 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:43.901179 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:43.901179 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:43.901179 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:43.901179 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:43.901179 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:43.901179 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:43.901179 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:43.901179 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:43.901179 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:43.901179 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:43.901179 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:43.901179 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:43.901179 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:43.901179 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:43.902016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:50:43.902016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:50:43.902016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:43.902016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:43.909913 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 243/488] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:50:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:43.912055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b33a46-6af2-4152-bf75-e4fba13e47d8 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:43.988399 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:44.085743 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f3cd0-1233-44ad-a806-147d3d0fc031 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:44.150017 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4f479-8446-4944-92cd-b4ef9fbc5433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:44.151141 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4f479-8446-4944-92cd-b4ef9fbc5433 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:44.153023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4f479-8446-4944-92cd-b4ef9fbc5433 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:44.153530 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4f479-8446-4944-92cd-b4ef9fbc5433 None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:44.154784 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4f479-8446-4944-92cd-b4ef9fbc5433 None admin] RBAC: Adding query filter params (name=service) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:44.155324 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4f479-8446-4944-92cd-b4ef9fbc5433 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:44.156988 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4f479-8446-4944-92cd-b4ef9fbc5433 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:44.168365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 246/489] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 08:50:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:44.170111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fc005-ec95-4676-9bab-09adf2d2c4d9 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:44.170663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fc005-ec95-4676-9bab-09adf2d2c4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:44.171149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fc005-ec95-4676-9bab-09adf2d2c4d9 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:44.173050 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 247/490] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:44.181109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fc005-ec95-4676-9bab-09adf2d2c4d9 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:44.187913 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b33a46-6af2-4152-bf75-e4fba13e47d8 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:44.246454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:44.251672 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e86364-f9c1-4c7f-905b-96ee948565be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:44.252437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e86364-f9c1-4c7f-905b-96ee948565be None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:44.252613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e86364-f9c1-4c7f-905b-96ee948565be None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:44.252854 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e86364-f9c1-4c7f-905b-96ee948565be None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:44.253576 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e86364-f9c1-4c7f-905b-96ee948565be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:44.253881 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e86364-f9c1-4c7f-905b-96ee948565be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:44.255331 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e86364-f9c1-4c7f-905b-96ee948565be None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:44.274622 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 244/491] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:50:44.274622 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5ec0f-e70e-4155-9fc5-f69f716ae975 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:44.274622 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5ec0f-e70e-4155-9fc5-f69f716ae975 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:44.274622 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5ec0f-e70e-4155-9fc5-f69f716ae975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:44.293162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-7dc5ec0f-e70e-4155-9fc5-f69f716ae975 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:44.294537 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-7dc5ec0f-e70e-4155-9fc5-f69f716ae975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:44.345456 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fc005-ec95-4676-9bab-09adf2d2c4d9 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:44.402602 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 245/492] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:44.402602 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5ec0f-e70e-4155-9fc5-f69f716ae975 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:44.422467 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3368313-b70b-499e-9c14-07a758a65e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:44.423178 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3368313-b70b-499e-9c14-07a758a65e9a None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:44.423532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3368313-b70b-499e-9c14-07a758a65e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:44.423881 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3368313-b70b-499e-9c14-07a758a65e9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:44.440632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3368313-b70b-499e-9c14-07a758a65e9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:44.442281 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3368313-b70b-499e-9c14-07a758a65e9a None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:44.448210 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:44.469324 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-c3368313-b70b-499e-9c14-07a758a65e9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:44.469324 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:44.469324 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:44.469324 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:44.469324 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:44.469324 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:44.469324 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:44.469324 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:44.469324 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:44.469324 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:44.469324 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:44.469324 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:44.469324 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:50:44.469324 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:50:44.469324 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:50:44.470267 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:50:44.470267 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:44.470267 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:44.470267 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:44.470267 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:44.470267 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:44.470267 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:44.470267 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:44.470267 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:44.470267 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:44.470267 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:44.470267 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:44.470267 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:44.470267 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:44.470267 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:44.470267 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:44.470267 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:44.471333 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:50:44.471333 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:50:44.471333 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:44.471333 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:44.477851 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 248/493] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:50:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:50:44.477851 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45a9c8-2ccc-40ba-b199-fd01996f0d39 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:44.477851 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45a9c8-2ccc-40ba-b199-fd01996f0d39 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:44.477851 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45a9c8-2ccc-40ba-b199-fd01996f0d39 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:44.482678 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 249/494] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:44.484488 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45a9c8-2ccc-40ba-b199-fd01996f0d39 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:44.597047 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5ec0f-e70e-4155-9fc5-f69f716ae975 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:44.639816 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:44.655068 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45a9c8-2ccc-40ba-b199-fd01996f0d39 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:44.659287 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60364e9c-8f1f-44df-ae53-0b8a314545a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:44.660107 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60364e9c-8f1f-44df-ae53-0b8a314545a6 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:44.660568 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60364e9c-8f1f-44df-ae53-0b8a314545a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:44.661029 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60364e9c-8f1f-44df-ae53-0b8a314545a6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:44.674998 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60364e9c-8f1f-44df-ae53-0b8a314545a6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:44.677749 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60364e9c-8f1f-44df-ae53-0b8a314545a6 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:44.704268 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88bf46-8bb4-4d92-8fb8-28a4ea4719d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:44.705102 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88bf46-8bb4-4d92-8fb8-28a4ea4719d5 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:44.705274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-60364e9c-8f1f-44df-ae53-0b8a314545a6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 08:50:44.705274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:44.705274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:44.705274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:44.705274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:44.705274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:44.705274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:44.705274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:44.705274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:44.705274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:44.705274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:44.705274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:44.705274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:50:44.705274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:50:44.705274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:50:44.705274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:50:44.707171 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:44.707171 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:44.707171 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:50:44.707171 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:50:44.707171 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:50:44.707171 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:50:44.707171 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:44.707171 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:44.707171 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:44.707171 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:44.707171 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:44.707171 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:44.707171 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:44.707171 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:44.707171 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:44.707171 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:44.707171 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:44.707171 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:44.708804 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:44.708804 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:44.708804 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:50:44.708804 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:50:44.708804 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:50:44.708804 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:50:44.708804 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:50:44.708804 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:50:44.708804 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 08:50:44.708804 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:44.709852 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88bf46-8bb4-4d92-8fb8-28a4ea4719d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:44.709852 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88bf46-8bb4-4d92-8fb8-28a4ea4719d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:44.710120 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 246/495] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:50:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:44.710120 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60364e9c-8f1f-44df-ae53-0b8a314545a6 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:44.732662 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88bf46-8bb4-4d92-8fb8-28a4ea4719d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:44.744232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-5d88bf46-8bb4-4d92-8fb8-28a4ea4719d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:50:44.744232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:44.744232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:44.744232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:44.744232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:44.744232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:44.744232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:44.744232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:44.744232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:44.744232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:44.744232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:44.744232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:44.744232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:44.744232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:44.744232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:44.744232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:44.745597 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:44.745597 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:44.745597 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:44.745597 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:44.745597 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:44.745597 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:44.745597 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:44.745597 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:44.745597 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:44.745597 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:44.745597 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:44.745597 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:44.745597 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:44.745597 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:44.745597 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:44.745597 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:44.746757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:44.746757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:44.746757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:44.746757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:44.746757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:44.746757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:44.746757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:44.746757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:44.746757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:44.746757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:44.746757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:50:44.746757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:44.746757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 250/496] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 08:50:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:44.749865 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33499fa-2e5d-4895-9727-1b187dc4397c None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:44.749865 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33499fa-2e5d-4895-9727-1b187dc4397c None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:44.749865 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33499fa-2e5d-4895-9727-1b187dc4397c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:44.777740 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-d33499fa-2e5d-4895-9727-1b187dc4397c None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:44.780543 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-d33499fa-2e5d-4895-9727-1b187dc4397c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:44.853750 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:44.884707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60364e9c-8f1f-44df-ae53-0b8a314545a6 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:44.904596 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 251/497] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:44.916379 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33499fa-2e5d-4895-9727-1b187dc4397c None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:44.938160 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaaad18-0998-48b9-8836-bcdf7c9465f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:44.939428 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaad18-0998-48b9-8836-bcdf7c9465f4 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:44.940014 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaad18-0998-48b9-8836-bcdf7c9465f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:44.941231 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaad18-0998-48b9-8836-bcdf7c9465f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:44.942501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaaad18-0998-48b9-8836-bcdf7c9465f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:44.943027 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaaad18-0998-48b9-8836-bcdf7c9465f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:44.945592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaaad18-0998-48b9-8836-bcdf7c9465f4 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:44.970358 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 247/498] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:44.970358 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaaad18-0998-48b9-8836-bcdf7c9465f4 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:45.064412 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:45.083477 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33499fa-2e5d-4895-9727-1b187dc4397c None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:45.116074 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaaad18-0998-48b9-8836-bcdf7c9465f4 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:45.141256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc8749-7972-46a4-818a-9314e99214da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:45.142229 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc8749-7972-46a4-818a-9314e99214da None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:45.142763 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc8749-7972-46a4-818a-9314e99214da None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:45.143244 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc8749-7972-46a4-818a-9314e99214da None admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:45.144727 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc8749-7972-46a4-818a-9314e99214da None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:45.145274 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc8749-7972-46a4-818a-9314e99214da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:45.147501 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc8749-7972-46a4-818a-9314e99214da None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:45.155911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81afdf59-ccc2-4d3d-bbed-397045c1f1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:45.156535 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afdf59-ccc2-4d3d-bbed-397045c1f1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:45.156813 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afdf59-ccc2-4d3d-bbed-397045c1f1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:45.157084 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afdf59-ccc2-4d3d-bbed-397045c1f1e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:45.157816 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81afdf59-ccc2-4d3d-bbed-397045c1f1e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:45.158119 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81afdf59-ccc2-4d3d-bbed-397045c1f1e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:45.159579 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81afdf59-ccc2-4d3d-bbed-397045c1f1e8 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:45.170596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 248/499] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 08:50:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:45.171501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81afdf59-ccc2-4d3d-bbed-397045c1f1e8 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:45.175189 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:45.223471 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 252/500] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Jul 27 08:50:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:45.224896 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc8749-7972-46a4-818a-9314e99214da None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:45.292300 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81afdf59-ccc2-4d3d-bbed-397045c1f1e8 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:45.347463 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f8ada-1394-488e-b0b7-ad9f17781dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:45.348508 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f8ada-1394-488e-b0b7-ad9f17781dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:45.348915 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f8ada-1394-488e-b0b7-ad9f17781dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:45.349357 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f8ada-1394-488e-b0b7-ad9f17781dc5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:45.365960 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f8ada-1394-488e-b0b7-ad9f17781dc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:45.372905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-936f8ada-1394-488e-b0b7-ad9f17781dc5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:50:45.372905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:45.372905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:45.372905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:45.372905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:45.372905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:45.372905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:45.372905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:45.372905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:45.372905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:45.372905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:45.372905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:45.372905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:45.372905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:45.372905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:45.372905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:45.374529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:45.374529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:45.374529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:45.374529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:45.374529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:45.374529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:45.374529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:45.374529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:45.374529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:45.374529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:45.374529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:45.374529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:45.374529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:45.374529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:45.374529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:45.374529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:45.375889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:45.375889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:45.375889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:45.375889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:45.375889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:45.375889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:45.375889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:45.375889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:45.375889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:45.375889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:45.375889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:50:45.375889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:45.376904 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc8749-7972-46a4-818a-9314e99214da None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:45.377016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 249/501] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 08:50:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:45.377016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35bc8b-485d-45be-8158-ea0f1841f72c None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:45.377228 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35bc8b-485d-45be-8158-ea0f1841f72c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:45.377579 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35bc8b-485d-45be-8158-ea0f1841f72c None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:45.382006 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 250/502] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:45.382006 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35bc8b-485d-45be-8158-ea0f1841f72c None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:45.422646 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bdf5c-7486-4ce5-a0cd-3026d417ed5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:45.423316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bdf5c-7486-4ce5-a0cd-3026d417ed5e None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:45.423642 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bdf5c-7486-4ce5-a0cd-3026d417ed5e None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:45.423914 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bdf5c-7486-4ce5-a0cd-3026d417ed5e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:45.434594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45bdf5c-7486-4ce5-a0cd-3026d417ed5e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:45.437085 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45bdf5c-7486-4ce5-a0cd-3026d417ed5e None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:45.461937 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-a45bdf5c-7486-4ce5-a0cd-3026d417ed5e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 08:50:45.461937 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:45.461937 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:45.461937 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:45.461937 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:45.461937 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:45.461937 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:45.461937 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:45.461937 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:45.461937 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:45.461937 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:45.461937 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:45.461937 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:50:45.461937 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:50:45.461937 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:50:45.461937 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:50:45.463071 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:45.463071 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:45.463071 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:50:45.463071 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:50:45.463071 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:50:45.463071 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:50:45.463071 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:45.463071 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:45.463071 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:45.463071 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:45.463071 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:45.463071 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:45.463071 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:45.463071 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:45.463071 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:45.463071 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:45.463071 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:45.463071 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:45.464059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:45.464059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:45.464059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:50:45.464059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:50:45.464059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:50:45.464059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:50:45.464059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:50:45.464059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:50:45.464059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 08:50:45.464059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:45.464588 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 253/503] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:50:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:45.465709 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bdf5c-7486-4ce5-a0cd-3026d417ed5e None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:45.472266 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:45.484273 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:45.549772 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35bc8b-485d-45be-8158-ea0f1841f72c None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:45.593349 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bdf5c-7486-4ce5-a0cd-3026d417ed5e None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:45.601351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131330f-64d7-4728-852d-ccc1b359232d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:45.603337 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131330f-64d7-4728-852d-ccc1b359232d None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:45.603830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131330f-64d7-4728-852d-ccc1b359232d None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:45.604303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131330f-64d7-4728-852d-ccc1b359232d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:45.623676 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131330f-64d7-4728-852d-ccc1b359232d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:45.626260 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131330f-64d7-4728-852d-ccc1b359232d None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:45.631226 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e04929-7ab5-4d1d-bcb8-893031c44d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:45.631846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e04929-7ab5-4d1d-bcb8-893031c44d0c None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:45.632123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e04929-7ab5-4d1d-bcb8-893031c44d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:45.632392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e04929-7ab5-4d1d-bcb8-893031c44d0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:45.651464 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-e131330f-64d7-4728-852d-ccc1b359232d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:45.651464 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:45.651464 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:45.651464 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:45.651464 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:45.651464 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:45.651464 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:45.651464 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:45.651464 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:45.651464 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:45.651464 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:45.651464 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:45.651464 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:50:45.651464 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:50:45.651464 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:50:45.652675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:50:45.652675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:45.652675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:45.652675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:45.652675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:45.652675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:45.652675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:45.652675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:45.652675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:45.652675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:45.652675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:45.652675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:45.652675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:45.652675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:45.652675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:45.652675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:45.652675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:45.653528 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:50:45.653528 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:50:45.653528 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:45.653528 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:45.653528 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 251/504] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:45.654846 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131330f-64d7-4728-852d-ccc1b359232d None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:45.739250 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e04929-7ab5-4d1d-bcb8-893031c44d0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:45.742090 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e04929-7ab5-4d1d-bcb8-893031c44d0c None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:45.748126 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:45.781596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131330f-64d7-4728-852d-ccc1b359232d None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:45.808312 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:45.846114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35896d49-e510-48b2-80eb-5560046e2cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:45.847208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35896d49-e510-48b2-80eb-5560046e2cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:45.847725 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35896d49-e510-48b2-80eb-5560046e2cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:45.848227 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35896d49-e510-48b2-80eb-5560046e2cd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:45.849606 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35896d49-e510-48b2-80eb-5560046e2cd8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:45.850163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35896d49-e510-48b2-80eb-5560046e2cd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:45.852888 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35896d49-e510-48b2-80eb-5560046e2cd8 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:45.860708 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 254/505] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:50:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:50:45.861996 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa977c-5979-447a-813a-e2deeeafbc7b None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:45.862292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa977c-5979-447a-813a-e2deeeafbc7b None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:45.862603 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa977c-5979-447a-813a-e2deeeafbc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:45.875248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 252/506] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 08:50:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:45.875248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35896d49-e510-48b2-80eb-5560046e2cd8 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:45.884099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-4cfa977c-5979-447a-813a-e2deeeafbc7b None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:45.885478 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-4cfa977c-5979-447a-813a-e2deeeafbc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:45.959658 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 255/507] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:45.961116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa977c-5979-447a-813a-e2deeeafbc7b None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:46.005389 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:46.035532 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35896d49-e510-48b2-80eb-5560046e2cd8 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:46.079365 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ca322-13d0-4aa9-98ca-e3ac467e7840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:46.080106 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ca322-13d0-4aa9-98ca-e3ac467e7840 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:46.080471 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ca322-13d0-4aa9-98ca-e3ac467e7840 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:46.080884 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ca322-13d0-4aa9-98ca-e3ac467e7840 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:46.081785 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ca322-13d0-4aa9-98ca-e3ac467e7840 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:46.082185 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ca322-13d0-4aa9-98ca-e3ac467e7840 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:46.083803 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ca322-13d0-4aa9-98ca-e3ac467e7840 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:46.098344 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa977c-5979-447a-813a-e2deeeafbc7b None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:46.149232 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 253/508] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Jul 27 08:50:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:46.150530 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ca322-13d0-4aa9-98ca-e3ac467e7840 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:46.155665 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442cfe0-2d60-4863-8fec-aef9a2026c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:46.156700 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442cfe0-2d60-4863-8fec-aef9a2026c8e None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:46.157174 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442cfe0-2d60-4863-8fec-aef9a2026c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:46.157637 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442cfe0-2d60-4863-8fec-aef9a2026c8e None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:46.158436 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442cfe0-2d60-4863-8fec-aef9a2026c8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:46.158750 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442cfe0-2d60-4863-8fec-aef9a2026c8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:46.160183 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442cfe0-2d60-4863-8fec-aef9a2026c8e None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:46.184314 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 256/509] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:46.184314 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442cfe0-2d60-4863-8fec-aef9a2026c8e None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:46.195237 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:46.292920 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:46.301090 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ca322-13d0-4aa9-98ca-e3ac467e7840 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:46.303386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442cfe0-2d60-4863-8fec-aef9a2026c8e None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:46.356843 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d910e-6778-45ed-b963-46394cf8b906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:46.357159 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd5688-b0a7-4064-a734-366869b00ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:46.357871 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d910e-6778-45ed-b963-46394cf8b906 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:46.358004 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd5688-b0a7-4064-a734-366869b00ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:46.358352 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd5688-b0a7-4064-a734-366869b00ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:46.358510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d910e-6778-45ed-b963-46394cf8b906 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:46.358807 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d910e-6778-45ed-b963-46394cf8b906 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:46.358937 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd5688-b0a7-4064-a734-366869b00ab0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:46.375662 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d910e-6778-45ed-b963-46394cf8b906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:46.375937 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd5688-b0a7-4064-a734-366869b00ab0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:46.377338 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d910e-6778-45ed-b963-46394cf8b906 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:46.377519 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd5688-b0a7-4064-a734-366869b00ab0 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:46.399205 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-efbd5688-b0a7-4064-a734-366869b00ab0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:46.399205 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:46.399205 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:46.399205 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:46.399205 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:46.399205 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:46.399205 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:46.399205 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:46.399205 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:46.399205 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:46.399205 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:46.399205 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:46.399205 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:50:46.399205 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:50:46.399205 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:50:46.400807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:50:46.400807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:46.400807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:46.400807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:46.400807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:46.400807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:46.400807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:46.400807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:46.400807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:46.400807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:46.400807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:46.400807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:46.400807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:46.400807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:46.400807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:46.400807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:46.400807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:46.402707 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:50:46.402707 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:50:46.402707 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:46.402707 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:46.403391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-f19d910e-6778-45ed-b963-46394cf8b906 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:46.403391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:46.403391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:46.403391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:46.403391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:46.403391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:46.403391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:46.403391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:46.403391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:46.403391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:46.403391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:46.403391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:46.403391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:50:46.403391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:50:46.403391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:50:46.404889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:50:46.404889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:46.404889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:46.404889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:46.404889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:46.404889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:46.404889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:46.404889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:46.404889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:46.404889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:46.404889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:46.404889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:46.404889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:46.404889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:46.404889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:46.404889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:46.404889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:46.406605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:50:46.406605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:50:46.406605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:46.406605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:46.406986 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 257/510] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:50:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:46.406986 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd5688-b0a7-4064-a734-366869b00ab0 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:46.407360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 254/511] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:50:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:46.408626 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d910e-6778-45ed-b963-46394cf8b906 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:46.499798 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:46.517714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d910e-6778-45ed-b963-46394cf8b906 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:46.559893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd5688-b0a7-4064-a734-366869b00ab0 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:46.562607 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ac308-2376-4864-9653-3075c010096c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:46.563229 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ac308-2376-4864-9653-3075c010096c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:46.563513 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ac308-2376-4864-9653-3075c010096c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:46.563780 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ac308-2376-4864-9653-3075c010096c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:46.596532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493edc1-76f6-4fd2-905b-22295cf54cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:46.597179 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493edc1-76f6-4fd2-905b-22295cf54cef None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:46.597460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493edc1-76f6-4fd2-905b-22295cf54cef None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:46.597734 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493edc1-76f6-4fd2-905b-22295cf54cef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:46.611038 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493edc1-76f6-4fd2-905b-22295cf54cef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:46.612532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493edc1-76f6-4fd2-905b-22295cf54cef None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:46.620326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:46.629298 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-a493edc1-76f6-4fd2-905b-22295cf54cef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:46.629298 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:46.629298 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:46.629298 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:46.629298 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:46.629298 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:46.629298 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:46.629298 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:46.629298 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:46.629298 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:46.629298 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:46.629298 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:46.629298 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:50:46.629298 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:50:46.629298 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:50:46.630554 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:50:46.630554 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:46.630554 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:46.630554 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:46.630554 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:46.630554 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:46.630554 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:46.630554 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:46.630554 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:46.630554 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:46.630554 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:46.630554 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:46.630554 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:46.630554 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:46.630554 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:46.630554 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:46.630554 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:46.631760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:50:46.631760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:50:46.631760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:46.631760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:46.631760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 258/512] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:50:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:46.632013 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493edc1-76f6-4fd2-905b-22295cf54cef None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:46.645236 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ac308-2376-4864-9653-3075c010096c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:46.647913 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ac308-2376-4864-9653-3075c010096c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:46.757615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:46.761905 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493edc1-76f6-4fd2-905b-22295cf54cef None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:46.784288 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 255/513] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:50:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:50:46.785187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ac308-2376-4864-9653-3075c010096c None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:46.811281 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26bfdeb-7ab2-4bdf-8f89-e213b60cda88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:46.811950 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bfdeb-7ab2-4bdf-8f89-e213b60cda88 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:46.812239 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bfdeb-7ab2-4bdf-8f89-e213b60cda88 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:46.812515 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bfdeb-7ab2-4bdf-8f89-e213b60cda88 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:46.822715 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26bfdeb-7ab2-4bdf-8f89-e213b60cda88 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:46.824234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26bfdeb-7ab2-4bdf-8f89-e213b60cda88 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:46.837561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-d26bfdeb-7ab2-4bdf-8f89-e213b60cda88 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:50:46.837561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:46.837561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:46.837561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:46.837561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:46.837561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:46.837561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:46.837561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:46.837561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:46.837561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:46.837561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:46.837561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:46.837561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:50:46.837561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:50:46.837561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:50:46.837561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:50:46.839449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:46.839449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:46.839449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:50:46.839449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:50:46.839449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:50:46.839449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:50:46.839449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:46.839449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:46.839449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:46.839449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:46.839449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:46.839449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:46.839449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:46.839449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:46.839449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:46.839449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:46.839449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:46.839449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:46.841172 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:46.841172 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:46.841172 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:50:46.841172 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:50:46.841172 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:50:46.841172 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:50:46.841172 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:50:46.841172 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:50:46.841172 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:50:46.841172 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:46.841172 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 259/514] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Jul 27 08:50:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:46.841172 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26bfdeb-7ab2-4bdf-8f89-e213b60cda88 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:46.906378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ac308-2376-4864-9653-3075c010096c None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:46.910689 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:46.946553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be9941-45aa-448b-bb30-d4f77770e8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:46.947198 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be9941-45aa-448b-bb30-d4f77770e8c9 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:46.947684 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be9941-45aa-448b-bb30-d4f77770e8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:46.947974 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be9941-45aa-448b-bb30-d4f77770e8c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:46.948690 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be9941-45aa-448b-bb30-d4f77770e8c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:46.949005 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be9941-45aa-448b-bb30-d4f77770e8c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:46.950444 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be9941-45aa-448b-bb30-d4f77770e8c9 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:46.958632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26bfdeb-7ab2-4bdf-8f89-e213b60cda88 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:46.963569 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 256/515] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:46.964469 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be9941-45aa-448b-bb30-d4f77770e8c9 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:46.995933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7f6ff-5888-42a7-839a-4be99a869076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:46.996560 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7f6ff-5888-42a7-839a-4be99a869076 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:46.996835 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7f6ff-5888-42a7-839a-4be99a869076 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:46.997104 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7f6ff-5888-42a7-839a-4be99a869076 None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:46.997812 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7f6ff-5888-42a7-839a-4be99a869076 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:46.998110 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7f6ff-5888-42a7-839a-4be99a869076 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:46.999555 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7f6ff-5888-42a7-839a-4be99a869076 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:47.012688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 260/516] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:47.013457 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7f6ff-5888-42a7-839a-4be99a869076 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:47.027777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:47.085430 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be9941-45aa-448b-bb30-d4f77770e8c9 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:47.130295 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b69fa-7dfb-4be5-96a8-2bf67c5d1c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:47.131386 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b69fa-7dfb-4be5-96a8-2bf67c5d1c86 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:47.131789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7f6ff-5888-42a7-839a-4be99a869076 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:47.131946 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b69fa-7dfb-4be5-96a8-2bf67c5d1c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:47.132355 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b69fa-7dfb-4be5-96a8-2bf67c5d1c86 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:47.134127 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b69fa-7dfb-4be5-96a8-2bf67c5d1c86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:47.134689 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b69fa-7dfb-4be5-96a8-2bf67c5d1c86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:47.137272 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b69fa-7dfb-4be5-96a8-2bf67c5d1c86 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:47.151422 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:47.159488 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 257/517] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:47.161013 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b69fa-7dfb-4be5-96a8-2bf67c5d1c86 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:47.175888 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f675a-4c47-4daf-917e-56c3c5ab787c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:47.176557 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f675a-4c47-4daf-917e-56c3c5ab787c None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:47.176834 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f675a-4c47-4daf-917e-56c3c5ab787c None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:47.177111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f675a-4c47-4daf-917e-56c3c5ab787c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:47.193997 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f675a-4c47-4daf-917e-56c3c5ab787c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:47.195522 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f675a-4c47-4daf-917e-56c3c5ab787c None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:47.218781 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-da8f675a-4c47-4daf-917e-56c3c5ab787c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:47.218781 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:47.218781 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:47.218781 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:47.218781 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:47.218781 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:47.218781 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:47.218781 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:47.218781 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:47.218781 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:47.218781 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:47.218781 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:47.218781 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:50:47.218781 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:50:47.218781 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:50:47.220254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:50:47.220254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:47.220254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:47.220254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:47.220254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:47.220254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:47.220254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:47.220254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:47.220254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:47.220254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:47.220254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:47.220254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:47.220254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:47.220254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:47.220254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:47.220254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:47.220254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:47.221638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:50:47.221638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:50:47.221638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:47.221638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:47.221638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 261/518] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:50:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:47.221638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f675a-4c47-4daf-917e-56c3c5ab787c None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:47.295796 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b69fa-7dfb-4be5-96a8-2bf67c5d1c86 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:47.304350 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:47.343832 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286ad66-90e8-4343-9d45-6f74922c0823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:47.344767 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286ad66-90e8-4343-9d45-6f74922c0823 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:47.345212 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286ad66-90e8-4343-9d45-6f74922c0823 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:47.345670 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286ad66-90e8-4343-9d45-6f74922c0823 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:47.347161 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286ad66-90e8-4343-9d45-6f74922c0823 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:47.347669 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286ad66-90e8-4343-9d45-6f74922c0823 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:47.350144 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286ad66-90e8-4343-9d45-6f74922c0823 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:47.358925 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f675a-4c47-4daf-917e-56c3c5ab787c None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:47.378932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 258/519] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Jul 27 08:50:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:47.380414 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286ad66-90e8-4343-9d45-6f74922c0823 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:47.407872 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ab58b-05a3-4fc1-ad17-27412a04d9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:47.408529 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ab58b-05a3-4fc1-ad17-27412a04d9be None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:47.408814 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ab58b-05a3-4fc1-ad17-27412a04d9be None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:47.409098 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ab58b-05a3-4fc1-ad17-27412a04d9be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:47.417789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ab58b-05a3-4fc1-ad17-27412a04d9be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:47.419317 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ab58b-05a3-4fc1-ad17-27412a04d9be None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:47.433142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-d64ab58b-05a3-4fc1-ad17-27412a04d9be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:50:47.433142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:47.433142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:47.433142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:47.433142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:47.433142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:47.433142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:47.433142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:47.433142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:47.433142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:47.433142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:47.433142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:47.433142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:50:47.433142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:50:47.433142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:50:47.434924 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:50:47.434924 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:47.434924 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:47.434924 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:47.434924 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:47.434924 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:47.434924 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:47.434924 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:47.434924 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:47.434924 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:47.434924 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:47.434924 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:47.434924 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:47.434924 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:47.434924 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:47.434924 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:47.434924 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:47.436652 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:50:47.436652 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:50:47.436652 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:50:47.436652 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:50:47.436652 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:50:47.436652 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:50:47.436652 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:50:47.436652 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:47.436652 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 262/520] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:50:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:47.436652 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ab58b-05a3-4fc1-ad17-27412a04d9be None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:47.478978 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:47.528641 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286ad66-90e8-4343-9d45-6f74922c0823 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:47.557881 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ab58b-05a3-4fc1-ad17-27412a04d9be None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:47.589052 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2966b5-7ccc-467e-93d9-9f1cf9a3705f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:47.590113 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2966b5-7ccc-467e-93d9-9f1cf9a3705f None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:47.590721 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2966b5-7ccc-467e-93d9-9f1cf9a3705f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:47.591202 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2966b5-7ccc-467e-93d9-9f1cf9a3705f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:47.595224 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35eaa16-7ee9-490b-a814-2a8710023673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:47.595859 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35eaa16-7ee9-490b-a814-2a8710023673 None admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:47.596143 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35eaa16-7ee9-490b-a814-2a8710023673 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:47.596416 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35eaa16-7ee9-490b-a814-2a8710023673 None admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:47.597114 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35eaa16-7ee9-490b-a814-2a8710023673 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:47.598627 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35eaa16-7ee9-490b-a814-2a8710023673 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:47.605437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2966b5-7ccc-467e-93d9-9f1cf9a3705f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:47.608029 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2966b5-7ccc-467e-93d9-9f1cf9a3705f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:47.623706 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 263/521] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 08:50:47 2022] POST /identity/v3/users => generated 247 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:50:47.624753 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35eaa16-7ee9-490b-a814-2a8710023673 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:47.640162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-1d2966b5-7ccc-467e-93d9-9f1cf9a3705f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 08:50:47.640162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:47.640162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:47.640162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:47.640162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:47.640162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:47.640162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:47.640162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:47.640162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:47.640162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:47.640162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:47.640162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:47.640162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:50:47.640162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:50:47.640162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:50:47.640162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:50:47.642238 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:47.642238 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:47.642238 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:50:47.642238 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:50:47.642238 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:50:47.642238 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:50:47.642238 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:47.642238 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:47.642238 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:47.642238 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:47.642238 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:47.642238 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:47.642238 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:47.642238 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:47.642238 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:47.642238 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:47.642238 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:47.642238 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:47.645156 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:47.645156 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:47.645156 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:50:47.645156 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:50:47.645156 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:50:47.645156 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:50:47.645156 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:50:47.645156 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:50:47.645156 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 08:50:47.645156 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:47.645156 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 259/522] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 08:50:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:47.645156 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2966b5-7ccc-467e-93d9-9f1cf9a3705f None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:47.688059 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:47.748450 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:47.774610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35eaa16-7ee9-490b-a814-2a8710023673 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:47.801966 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2966b5-7ccc-467e-93d9-9f1cf9a3705f None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:47.832871 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb041c-d9e5-43dd-8bf2-98bf6a822d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:47.833447 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb041c-d9e5-43dd-8bf2-98bf6a822d99 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:47.833747 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb041c-d9e5-43dd-8bf2-98bf6a822d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:47.833989 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb041c-d9e5-43dd-8bf2-98bf6a822d99 None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:47.834750 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb041c-d9e5-43dd-8bf2-98bf6a822d99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:47.835160 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb041c-d9e5-43dd-8bf2-98bf6a822d99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:47.837081 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb041c-d9e5-43dd-8bf2-98bf6a822d99 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:47.853756 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 264/523] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:47.854776 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb041c-d9e5-43dd-8bf2-98bf6a822d99 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:47.869378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c99490-f65f-40f7-a61b-4f3a38c75a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:47.870446 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c99490-f65f-40f7-a61b-4f3a38c75a34 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:47.870929 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c99490-f65f-40f7-a61b-4f3a38c75a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:47.871380 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c99490-f65f-40f7-a61b-4f3a38c75a34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:47.979992 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c99490-f65f-40f7-a61b-4f3a38c75a34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:47.982540 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c99490-f65f-40f7-a61b-4f3a38c75a34 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:48.001903 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb041c-d9e5-43dd-8bf2-98bf6a822d99 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:48.019866 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:48.058062 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aaefbb-baab-41fa-90c1-71476d03e949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:48.058932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aaefbb-baab-41fa-90c1-71476d03e949 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:48.059355 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aaefbb-baab-41fa-90c1-71476d03e949 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:48.059761 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aaefbb-baab-41fa-90c1-71476d03e949 None admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:48.060817 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aaefbb-baab-41fa-90c1-71476d03e949 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:48.061600 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aaefbb-baab-41fa-90c1-71476d03e949 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:48.063406 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aaefbb-baab-41fa-90c1-71476d03e949 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:48.096745 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 265/524] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:50:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:48.097943 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aaefbb-baab-41fa-90c1-71476d03e949 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:48.112384 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:48.131984 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 260/525] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:50:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:50:48.132950 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c99490-f65f-40f7-a61b-4f3a38c75a34 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:48.260227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aaefbb-baab-41fa-90c1-71476d03e949 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:48.273889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c99490-f65f-40f7-a61b-4f3a38c75a34 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:48.299913 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03523b0c-a1a6-4631-a141-2ddd604e1e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:48.300539 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03523b0c-a1a6-4631-a141-2ddd604e1e55 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:48.300820 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03523b0c-a1a6-4631-a141-2ddd604e1e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:48.301093 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03523b0c-a1a6-4631-a141-2ddd604e1e55 None admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:48.301932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03523b0c-a1a6-4631-a141-2ddd604e1e55 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:48.302212 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03523b0c-a1a6-4631-a141-2ddd604e1e55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:48.303692 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03523b0c-a1a6-4631-a141-2ddd604e1e55 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:48.309197 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:48.324683 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4652a4-c39e-4afa-a8a3-ec3ae2a1f4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:48.325542 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 266/526] 10.222.0.65 () {56 vars in 1139 bytes} [Wed Jul 27 08:50:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:48.325877 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4652a4-c39e-4afa-a8a3-ec3ae2a1f4ff None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:48.326377 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4652a4-c39e-4afa-a8a3-ec3ae2a1f4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:48.326504 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03523b0c-a1a6-4631-a141-2ddd604e1e55 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:48.326961 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4652a4-c39e-4afa-a8a3-ec3ae2a1f4ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:48.341299 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4652a4-c39e-4afa-a8a3-ec3ae2a1f4ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:48.342843 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4652a4-c39e-4afa-a8a3-ec3ae2a1f4ff None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:48.357007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-7e4652a4-c39e-4afa-a8a3-ec3ae2a1f4ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:50:48.357007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:48.357007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:48.357007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:48.357007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:48.357007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:48.357007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:48.357007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:48.357007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:48.357007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:48.357007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:48.357007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:48.357007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:50:48.357007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:50:48.357007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:50:48.358698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:50:48.358698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:48.358698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:48.358698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:48.358698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:48.358698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:48.358698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:48.358698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:48.358698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:48.358698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:48.358698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:48.358698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:48.358698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:48.358698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:48.358698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:48.358698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:48.358698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:48.361325 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:50:48.361325 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:50:48.361325 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:50:48.361325 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:50:48.361325 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:50:48.361325 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:50:48.361325 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:50:48.361325 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:48.361325 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 261/527] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:50:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:48.361325 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4652a4-c39e-4afa-a8a3-ec3ae2a1f4ff None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:48.431404 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:48.494610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4652a4-c39e-4afa-a8a3-ec3ae2a1f4ff None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:48.498385 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03523b0c-a1a6-4631-a141-2ddd604e1e55 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:48.545026 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df6798-1448-4945-bed2-707cdad27685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:48.545876 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df6798-1448-4945-bed2-707cdad27685 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:48.546273 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df6798-1448-4945-bed2-707cdad27685 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:48.546795 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df6798-1448-4945-bed2-707cdad27685 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:48.552854 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d48e1e-922a-4c8f-ac20-bd7a426b1a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:48.553744 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d48e1e-922a-4c8f-ac20-bd7a426b1a82 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:48.554244 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d48e1e-922a-4c8f-ac20-bd7a426b1a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:48.554915 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d48e1e-922a-4c8f-ac20-bd7a426b1a82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:48.556393 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d48e1e-922a-4c8f-ac20-bd7a426b1a82 None admin] RBAC: Adding query filter params (role.id=e476894ef72943f9b83d98d0704edfea, scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267, user.id=713805e0f1174a01987014319075ec03) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:48.556928 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d48e1e-922a-4c8f-ac20-bd7a426b1a82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:48.559635 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d48e1e-922a-4c8f-ac20-bd7a426b1a82 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:48.564114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df6798-1448-4945-bed2-707cdad27685 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:48.566962 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df6798-1448-4945-bed2-707cdad27685 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:48.570139 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 267/528] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:50:48 2022] GET /identity/v3/role_assignments?user.id=713805e0f1174a01987014319075ec03&scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267&role.id=e476894ef72943f9b83d98d0704edfea => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:48.571778 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d48e1e-922a-4c8f-ac20-bd7a426b1a82 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:48.598974 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-24df6798-1448-4945-bed2-707cdad27685 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:48.598974 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:48.598974 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:48.598974 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:48.598974 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:48.598974 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:48.598974 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:48.598974 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:48.598974 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:48.598974 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:48.598974 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:48.598974 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:48.598974 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:50:48.598974 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:50:48.598974 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:50:48.599936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:50:48.599936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:48.599936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:48.599936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:48.599936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:48.599936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:48.599936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:48.599936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:48.599936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:48.599936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:48.599936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:48.599936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:48.599936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:48.599936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:48.599936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:48.599936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:48.599936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:48.600801 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:50:48.600801 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:50:48.600801 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:48.600801 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:48.606979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 262/529] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:48.608402 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df6798-1448-4945-bed2-707cdad27685 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:48.677596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:48.725573 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d48e1e-922a-4c8f-ac20-bd7a426b1a82 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:48.767504 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:48.779761 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a7e9b-bccc-4f97-8aee-b78cff12b987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:48.781231 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a7e9b-bccc-4f97-8aee-b78cff12b987 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:48.782057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a7e9b-bccc-4f97-8aee-b78cff12b987 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:48.782585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a7e9b-bccc-4f97-8aee-b78cff12b987 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:48.799348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df6798-1448-4945-bed2-707cdad27685 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:48.881364 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26f7c6-5287-44d2-b2a5-c1c12e586636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:48.881921 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26f7c6-5287-44d2-b2a5-c1c12e586636 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:48.882201 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26f7c6-5287-44d2-b2a5-c1c12e586636 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:48.882524 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26f7c6-5287-44d2-b2a5-c1c12e586636 None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:48.883304 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26f7c6-5287-44d2-b2a5-c1c12e586636 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:48.884231 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26f7c6-5287-44d2-b2a5-c1c12e586636 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:48.886195 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26f7c6-5287-44d2-b2a5-c1c12e586636 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:48.888945 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a7e9b-bccc-4f97-8aee-b78cff12b987 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:48.892456 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a7e9b-bccc-4f97-8aee-b78cff12b987 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:48.908440 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 263/530] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:50:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:48.909342 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26f7c6-5287-44d2-b2a5-c1c12e586636 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:49.067137 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 268/531] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:50:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:50:49.068166 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a7e9b-bccc-4f97-8aee-b78cff12b987 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:49.104176 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:49.108478 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:49.119957 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26f7c6-5287-44d2-b2a5-c1c12e586636 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:49.187843 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576d177-e2cb-425b-a03b-8dcffdc8624f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:49.189018 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576d177-e2cb-425b-a03b-8dcffdc8624f None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:49.189621 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576d177-e2cb-425b-a03b-8dcffdc8624f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:49.190116 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576d177-e2cb-425b-a03b-8dcffdc8624f None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:49.191548 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576d177-e2cb-425b-a03b-8dcffdc8624f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:49.192224 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576d177-e2cb-425b-a03b-8dcffdc8624f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:49.194763 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576d177-e2cb-425b-a03b-8dcffdc8624f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:49.206227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a7e9b-bccc-4f97-8aee-b78cff12b987 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:49.222870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 264/532] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:49.224604 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576d177-e2cb-425b-a03b-8dcffdc8624f None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:49.257362 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b06ca8-9fce-4c5c-acbc-37166588f769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:49.258004 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b06ca8-9fce-4c5c-acbc-37166588f769 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:49.258678 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b06ca8-9fce-4c5c-acbc-37166588f769 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:49.258980 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b06ca8-9fce-4c5c-acbc-37166588f769 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:49.259878 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b06ca8-9fce-4c5c-acbc-37166588f769 None admin] RBAC: Adding query filter params (role.id=e476894ef72943f9b83d98d0704edfea, scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267, user.id=72763a52df364a4a8a660ec1be4aba79) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:49.260189 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b06ca8-9fce-4c5c-acbc-37166588f769 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:49.261894 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b06ca8-9fce-4c5c-acbc-37166588f769 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:49.269486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 269/533] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:50:49 2022] GET /identity/v3/role_assignments?user.id=72763a52df364a4a8a660ec1be4aba79&scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267&role.id=e476894ef72943f9b83d98d0704edfea => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:49.270481 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b06ca8-9fce-4c5c-acbc-37166588f769 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:49.404102 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:49.447129 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b06ca8-9fce-4c5c-acbc-37166588f769 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:49.453717 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576d177-e2cb-425b-a03b-8dcffdc8624f None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:49.518375 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da04993-92be-44e1-a8e4-4764cf2a57e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:49.519058 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da04993-92be-44e1-a8e4-4764cf2a57e5 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:49.519336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da04993-92be-44e1-a8e4-4764cf2a57e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:49.519612 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da04993-92be-44e1-a8e4-4764cf2a57e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:49.536768 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da04993-92be-44e1-a8e4-4764cf2a57e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:49.538399 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da04993-92be-44e1-a8e4-4764cf2a57e5 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:49.540642 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cee747-ec11-4564-956b-e3fad4ff6b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:49.541951 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cee747-ec11-4564-956b-e3fad4ff6b50 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:49.542622 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cee747-ec11-4564-956b-e3fad4ff6b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:49.543137 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cee747-ec11-4564-956b-e3fad4ff6b50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:49.556689 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-6da04993-92be-44e1-a8e4-4764cf2a57e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:49.556689 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:49.556689 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:49.556689 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:49.556689 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:49.556689 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:49.556689 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:49.556689 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:49.556689 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:49.556689 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:49.556689 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:49.556689 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:49.556689 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:50:49.556689 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:50:49.556689 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:50:49.557587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:50:49.557587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:49.557587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:49.557587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:49.557587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:49.557587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:49.557587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:49.557587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:49.557587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:49.557587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:49.557587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:49.557587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:49.557587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:49.557587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:49.557587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:49.557587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:49.557587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:49.558480 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:50:49.558480 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:50:49.558480 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:49.558480 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:49.558687 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 265/534] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:50:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:49.559832 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cee747-ec11-4564-956b-e3fad4ff6b50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:49.561342 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cee747-ec11-4564-956b-e3fad4ff6b50 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:49.567835 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da04993-92be-44e1-a8e4-4764cf2a57e5 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:49.582140 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-04cee747-ec11-4564-956b-e3fad4ff6b50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:50:49.582140 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:49.582140 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:49.582140 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:49.582140 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:49.582140 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:49.582140 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:49.582140 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:49.582140 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:49.582140 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:49.582140 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:49.582140 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:49.582140 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:50:49.582140 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:50:49.582140 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:50:49.583116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:50:49.583116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:49.583116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:49.583116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:49.583116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:49.583116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:49.583116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:49.583116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:49.583116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:49.583116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:49.583116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:49.583116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:49.583116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:49.583116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:49.583116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:49.583116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:49.583116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:49.583945 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:50:49.583945 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:50:49.583945 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:50:49.583945 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:50:49.583945 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:50:49.583945 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:50:49.583945 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:50:49.583945 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:49.583945 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 270/535] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:50:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:49.595850 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:49.597409 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cee747-ec11-4564-956b-e3fad4ff6b50 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:49.717476 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da04993-92be-44e1-a8e4-4764cf2a57e5 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:49.762793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5af144-d47e-4cef-8304-b6602039acc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:49.763459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5af144-d47e-4cef-8304-b6602039acc6 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:49.770348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5af144-d47e-4cef-8304-b6602039acc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:49.770348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5af144-d47e-4cef-8304-b6602039acc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:49.770348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5af144-d47e-4cef-8304-b6602039acc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:49.770348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5af144-d47e-4cef-8304-b6602039acc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:49.770348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5af144-d47e-4cef-8304-b6602039acc6 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:49.807444 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 266/536] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:49.822679 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5af144-d47e-4cef-8304-b6602039acc6 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:49.959449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cee747-ec11-4564-956b-e3fad4ff6b50 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:50.009488 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:50.034398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde88b5-f5a3-4209-8447-f6c656005193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:50.035703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde88b5-f5a3-4209-8447-f6c656005193 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:50.036278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde88b5-f5a3-4209-8447-f6c656005193 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:50.036850 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde88b5-f5a3-4209-8447-f6c656005193 None admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:50.038252 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde88b5-f5a3-4209-8447-f6c656005193 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:50.038923 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde88b5-f5a3-4209-8447-f6c656005193 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:50.046349 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde88b5-f5a3-4209-8447-f6c656005193 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:50.070891 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 271/537] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:50:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 476 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:50.075921 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde88b5-f5a3-4209-8447-f6c656005193 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:50.096104 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:50.101276 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5af144-d47e-4cef-8304-b6602039acc6 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:50.143094 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6ddbb-c2f2-4511-b6b5-192767101f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:50.144063 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6ddbb-c2f2-4511-b6b5-192767101f3a None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:50.144234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6ddbb-c2f2-4511-b6b5-192767101f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:50.144358 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6ddbb-c2f2-4511-b6b5-192767101f3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:50.152947 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6ddbb-c2f2-4511-b6b5-192767101f3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:50.154505 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6ddbb-c2f2-4511-b6b5-192767101f3a None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:50.168680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-73d6ddbb-c2f2-4511-b6b5-192767101f3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:50:50.168680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:50.168680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:50.168680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:50.168680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:50.168680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:50.168680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:50.168680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:50.168680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:50.168680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:50.168680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:50.168680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:50.168680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:50:50.168680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:50:50.168680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:50:50.170360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:50:50.170360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:50.170360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:50.170360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:50.170360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:50.170360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:50.170360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:50.170360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:50.170360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:50.170360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:50.170360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:50.170360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:50.170360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:50.170360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:50.170360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:50.170360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:50.170360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:50.172032 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:50:50.172032 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:50:50.172032 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:50:50.172032 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:50:50.172032 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:50:50.172032 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:50:50.172032 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:50:50.172032 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:50.172032 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 267/538] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:50:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:50:50.172032 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51904b35-ac0d-4885-aaeb-415b2f1a1c56 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:50.172032 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51904b35-ac0d-4885-aaeb-415b2f1a1c56 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:50.173115 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51904b35-ac0d-4885-aaeb-415b2f1a1c56 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:50.178011 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 268/539] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:50.179781 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da759e-87aa-4861-9fe1-87fab3e97c31 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:50.180177 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da759e-87aa-4861-9fe1-87fab3e97c31 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:50.180675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da759e-87aa-4861-9fe1-87fab3e97c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:50.202375 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-38da759e-87aa-4861-9fe1-87fab3e97c31 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:50.203858 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-38da759e-87aa-4861-9fe1-87fab3e97c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:50.206469 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde88b5-f5a3-4209-8447-f6c656005193 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:50.246762 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd6ea9-1a04-4acd-b711-6cdc4222a596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:50.247385 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd6ea9-1a04-4acd-b711-6cdc4222a596 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:50.247664 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd6ea9-1a04-4acd-b711-6cdc4222a596 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:50.247932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd6ea9-1a04-4acd-b711-6cdc4222a596 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:50.248737 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd6ea9-1a04-4acd-b711-6cdc4222a596 None admin] RBAC: Adding query filter params (role.id=e476894ef72943f9b83d98d0704edfea, scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267, user.id=c30bc55c6a1348bb961f0d010422da87) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:50.249019 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd6ea9-1a04-4acd-b711-6cdc4222a596 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:50.250517 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd6ea9-1a04-4acd-b711-6cdc4222a596 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:50.257383 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 272/540] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:50:50 2022] GET /identity/v3/role_assignments?user.id=c30bc55c6a1348bb961f0d010422da87&scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267&role.id=e476894ef72943f9b83d98d0704edfea => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:50:50.258233 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd6ea9-1a04-4acd-b711-6cdc4222a596 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:50.322347 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 269/541] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:50.360314 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da759e-87aa-4861-9fe1-87fab3e97c31 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:50.388750 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:50.437272 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd6ea9-1a04-4acd-b711-6cdc4222a596 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:50.490870 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66958859-cf53-4b7b-9f62-9c322e1693b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:50.491504 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66958859-cf53-4b7b-9f62-9c322e1693b3 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:50.491783 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66958859-cf53-4b7b-9f62-9c322e1693b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:50.492054 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66958859-cf53-4b7b-9f62-9c322e1693b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:50.492957 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66958859-cf53-4b7b-9f62-9c322e1693b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:50.493388 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66958859-cf53-4b7b-9f62-9c322e1693b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:50.496171 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66958859-cf53-4b7b-9f62-9c322e1693b3 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:50.510798 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 273/542] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:50:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:50.526729 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66958859-cf53-4b7b-9f62-9c322e1693b3 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:50.533166 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:50.656059 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da759e-87aa-4861-9fe1-87fab3e97c31 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:50.722640 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650993d-1ba3-4688-bdff-f65b1d77c47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:50.724088 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650993d-1ba3-4688-bdff-f65b1d77c47a None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:50.724787 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650993d-1ba3-4688-bdff-f65b1d77c47a None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:50.725465 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650993d-1ba3-4688-bdff-f65b1d77c47a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:50.746515 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650993d-1ba3-4688-bdff-f65b1d77c47a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:50.756968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-f650993d-1ba3-4688-bdff-f65b1d77c47a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:50:50.756968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:50.756968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:50.756968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:50.756968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:50.756968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:50.756968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:50.756968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:50.756968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:50.756968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:50.756968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:50.756968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:50.756968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:50.756968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:50.756968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:50.756968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:50.759148 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:50.759148 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:50.759148 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:50.759148 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:50.759148 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:50.759148 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:50.759148 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:50.759148 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:50.759148 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:50.759148 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:50.759148 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:50.759148 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:50.759148 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:50.759148 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:50.759148 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:50.759148 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:50.761017 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:50.761017 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:50.761017 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:50.761017 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:50.761017 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:50.761017 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:50.761017 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:50.761017 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:50.761017 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:50.761017 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:50.761017 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:50:50.761017 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:50.765353 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 270/543] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 08:50:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:50.772092 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650993d-1ba3-4688-bdff-f65b1d77c47a None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:50.828411 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66958859-cf53-4b7b-9f62-9c322e1693b3 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:50.967825 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c41681-3a70-4dfe-b425-4d1c9f502e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:50.968857 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c41681-3a70-4dfe-b425-4d1c9f502e71 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:50.968857 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c41681-3a70-4dfe-b425-4d1c9f502e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:50.968857 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c41681-3a70-4dfe-b425-4d1c9f502e71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:50.969670 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c41681-3a70-4dfe-b425-4d1c9f502e71 None admin] RBAC: Adding query filter params (role.id=e476894ef72943f9b83d98d0704edfea, scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267, user.id=b018ac10ad804c6cbbe7fdcc1cec61e8) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:50.969979 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c41681-3a70-4dfe-b425-4d1c9f502e71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:50.971461 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c41681-3a70-4dfe-b425-4d1c9f502e71 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:50.984833 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:50.996483 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 274/544] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:50:50 2022] GET /identity/v3/role_assignments?user.id=b018ac10ad804c6cbbe7fdcc1cec61e8&scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267&role.id=e476894ef72943f9b83d98d0704edfea => generated 259 bytes in 471 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:50:51.012967 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650993d-1ba3-4688-bdff-f65b1d77c47a None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:51.070355 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:51.107595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de13be7-cb77-4ead-9a06-14846ffc3e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:51.109305 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de13be7-cb77-4ead-9a06-14846ffc3e61 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:51.110125 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de13be7-cb77-4ead-9a06-14846ffc3e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:51.110955 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de13be7-cb77-4ead-9a06-14846ffc3e61 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:51.112826 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de13be7-cb77-4ead-9a06-14846ffc3e61 None admin] RBAC: Adding query filter params (name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:51.113722 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de13be7-cb77-4ead-9a06-14846ffc3e61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:51.116860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de13be7-cb77-4ead-9a06-14846ffc3e61 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:51.136358 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 271/545] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 08:50:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:51.142238 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c41681-3a70-4dfe-b425-4d1c9f502e71 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:51.327586 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c41681-3a70-4dfe-b425-4d1c9f502e71 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:51.397121 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444e692-494e-4211-860b-7674a8e53f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:51.398246 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444e692-494e-4211-860b-7674a8e53f2c None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:51.398591 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444e692-494e-4211-860b-7674a8e53f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:51.399627 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444e692-494e-4211-860b-7674a8e53f2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:51.429398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444e692-494e-4211-860b-7674a8e53f2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:51.433180 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444e692-494e-4211-860b-7674a8e53f2c None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:51.469098 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-c444e692-494e-4211-860b-7674a8e53f2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:51.469098 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:51.469098 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:51.469098 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:51.469098 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:51.469098 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:51.469098 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:51.469098 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:51.469098 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:51.469098 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:51.469098 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:51.469098 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:51.469098 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:50:51.469098 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:50:51.469098 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:50:51.470012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:50:51.470012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:51.470012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:51.470012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:51.470012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:51.470012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:51.470012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:51.470012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:51.470012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:51.470012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:51.470012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:51.470012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:51.470012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:51.470012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:51.470012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:51.470012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:51.470012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:51.470873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:50:51.470873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:50:51.470873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:51.470873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:51.478502 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 275/546] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:50:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:51.484068 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de13be7-cb77-4ead-9a06-14846ffc3e61 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:51.733508 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de13be7-cb77-4ead-9a06-14846ffc3e61 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:51.792668 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd180531-4a64-4c87-af0f-391d4031d5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:51.793700 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd180531-4a64-4c87-af0f-391d4031d5bb None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:51.794176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd180531-4a64-4c87-af0f-391d4031d5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:51.794779 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd180531-4a64-4c87-af0f-391d4031d5bb None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:51.795688 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd180531-4a64-4c87-af0f-391d4031d5bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:51.796192 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd180531-4a64-4c87-af0f-391d4031d5bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:51.797787 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd180531-4a64-4c87-af0f-391d4031d5bb None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:51.820023 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 272/547] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:51.830281 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444e692-494e-4211-860b-7674a8e53f2c None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:51.897960 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161b349-c6f6-4390-9380-c7814b3d66ea None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:51.898645 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161b349-c6f6-4390-9380-c7814b3d66ea None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:51.899334 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161b349-c6f6-4390-9380-c7814b3d66ea None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:51.901288 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 273/548] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:51.927841 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17f37d-ec0f-4dbd-bc1c-1a0cba4a33a0 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:51.928482 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17f37d-ec0f-4dbd-bc1c-1a0cba4a33a0 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:51.928968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17f37d-ec0f-4dbd-bc1c-1a0cba4a33a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:51.962764 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:51.971434 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-7d17f37d-ec0f-4dbd-bc1c-1a0cba4a33a0 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:51.972866 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-7d17f37d-ec0f-4dbd-bc1c-1a0cba4a33a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:52.064946 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444e692-494e-4211-860b-7674a8e53f2c None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:52.128349 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:52.149776 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402fa9f-1172-4014-81ec-92665566288d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:52.151793 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402fa9f-1172-4014-81ec-92665566288d None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:52.152448 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402fa9f-1172-4014-81ec-92665566288d None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:52.153311 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402fa9f-1172-4014-81ec-92665566288d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:52.181571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402fa9f-1172-4014-81ec-92665566288d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:52.192764 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402fa9f-1172-4014-81ec-92665566288d None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:52.212572 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-2402fa9f-1172-4014-81ec-92665566288d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 08:50:52.212572 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:52.212572 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:52.212572 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:52.212572 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:52.212572 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:52.212572 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:52.212572 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:52.212572 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:52.212572 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:52.212572 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:52.212572 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:52.212572 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:50:52.212572 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:50:52.212572 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:50:52.212572 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:50:52.213974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:52.213974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:52.213974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:50:52.213974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:50:52.213974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:50:52.213974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:50:52.213974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:52.213974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:52.213974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:52.213974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:52.213974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:52.213974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:52.213974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:52.213974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:52.213974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:52.213974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:52.213974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:52.213974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:52.215333 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:52.215333 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:52.215333 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:50:52.215333 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:50:52.215333 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:50:52.215333 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:50:52.215333 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:50:52.215333 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:50:52.215333 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 08:50:52.215333 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:52.219713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 276/549] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:50:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:52.225460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402fa9f-1172-4014-81ec-92665566288d None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:52.248707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 274/550] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:52.292845 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17f37d-ec0f-4dbd-bc1c-1a0cba4a33a0 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:52.448100 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402fa9f-1172-4014-81ec-92665566288d None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:52.462569 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:52.482668 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17f37d-ec0f-4dbd-bc1c-1a0cba4a33a0 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:52.489192 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7a9fc-ac07-4a81-9e76-6a2bc9fbf9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:52.490197 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7a9fc-ac07-4a81-9e76-6a2bc9fbf9b3 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:52.490750 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7a9fc-ac07-4a81-9e76-6a2bc9fbf9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:52.491230 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7a9fc-ac07-4a81-9e76-6a2bc9fbf9b3 None admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:52.493106 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7a9fc-ac07-4a81-9e76-6a2bc9fbf9b3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:52.493776 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7a9fc-ac07-4a81-9e76-6a2bc9fbf9b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:52.495931 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7a9fc-ac07-4a81-9e76-6a2bc9fbf9b3 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:52.522001 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 277/551] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Jul 27 08:50:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:50:52.523589 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e46d98-26ec-4dc3-b31f-83b4c686ab69 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:52.523881 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e46d98-26ec-4dc3-b31f-83b4c686ab69 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:52.524229 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e46d98-26ec-4dc3-b31f-83b4c686ab69 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:52.525382 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a763fb-b5f0-4859-9eb2-ed85658e5612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:52.526338 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 278/552] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:52.530656 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a763fb-b5f0-4859-9eb2-ed85658e5612 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:52.531035 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e46d98-26ec-4dc3-b31f-83b4c686ab69 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:52.531353 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a763fb-b5f0-4859-9eb2-ed85658e5612 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:52.531637 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a763fb-b5f0-4859-9eb2-ed85658e5612 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:52.550727 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a763fb-b5f0-4859-9eb2-ed85658e5612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:52.561956 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-57a763fb-b5f0-4859-9eb2-ed85658e5612 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:50:52.561956 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:52.561956 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:52.561956 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:52.561956 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:52.561956 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:52.561956 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:52.561956 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:52.561956 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:52.561956 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:52.561956 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:52.561956 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:52.561956 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:52.561956 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:52.561956 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:52.561956 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:52.563123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:52.563123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:52.563123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:52.563123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:52.563123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:52.563123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:52.563123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:52.563123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:52.563123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:52.563123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:52.563123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:52.563123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:52.563123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:52.563123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:52.563123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:52.563123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:52.563926 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:52.563926 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:52.563926 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:52.563926 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:52.563926 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:52.563926 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:52.563926 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:52.563926 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:52.563926 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:52.563926 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:52.563926 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:50:52.563926 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:52.570414 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 275/553] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 08:50:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:52.573162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab577d53-fd9d-4e44-9049-19be328fb2ab None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:52.575388 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab577d53-fd9d-4e44-9049-19be328fb2ab None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:52.575764 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab577d53-fd9d-4e44-9049-19be328fb2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:52.613166 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-ab577d53-fd9d-4e44-9049-19be328fb2ab None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:52.616730 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ab577d53-fd9d-4e44-9049-19be328fb2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:52.664414 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:52.692450 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e46d98-26ec-4dc3-b31f-83b4c686ab69 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:52.732386 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 276/554] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:52.733575 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab577d53-fd9d-4e44-9049-19be328fb2ab None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:52.771914 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1d169-9f7e-4e68-805e-46c52d6ca206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:52.773460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1d169-9f7e-4e68-805e-46c52d6ca206 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:52.773848 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1d169-9f7e-4e68-805e-46c52d6ca206 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:52.774870 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1d169-9f7e-4e68-805e-46c52d6ca206 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:52.831436 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:52.871829 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a1d169-9f7e-4e68-805e-46c52d6ca206 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:52.873356 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a1d169-9f7e-4e68-805e-46c52d6ca206 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:52.916994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab577d53-fd9d-4e44-9049-19be328fb2ab None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:52.972882 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087f3dd-1845-4089-8b1d-2921d28dcf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:52.973534 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087f3dd-1845-4089-8b1d-2921d28dcf2a None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:52.973813 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087f3dd-1845-4089-8b1d-2921d28dcf2a None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:52.974088 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087f3dd-1845-4089-8b1d-2921d28dcf2a None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:52.974868 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087f3dd-1845-4089-8b1d-2921d28dcf2a None admin] RBAC: Adding query filter params (name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:52.975181 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087f3dd-1845-4089-8b1d-2921d28dcf2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:52.976613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087f3dd-1845-4089-8b1d-2921d28dcf2a None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:52.991028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 277/555] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 08:50:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:52.991028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087f3dd-1845-4089-8b1d-2921d28dcf2a None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:53.016041 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 279/556] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:50:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:50:53.017662 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6f4e0-3128-46e4-9b64-cbba3c97a065 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:53.018064 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6f4e0-3128-46e4-9b64-cbba3c97a065 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:53.018482 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6f4e0-3128-46e4-9b64-cbba3c97a065 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:53.020278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 280/557] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:53.023299 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6f4e0-3128-46e4-9b64-cbba3c97a065 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:53.029484 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:53.127187 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:53.137363 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087f3dd-1845-4089-8b1d-2921d28dcf2a None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:53.183078 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6f4e0-3128-46e4-9b64-cbba3c97a065 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:53.184131 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe3f0d-fb8e-422a-a9b1-583d4b1be5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:53.184801 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe3f0d-fb8e-422a-a9b1-583d4b1be5ba None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:53.185080 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe3f0d-fb8e-422a-a9b1-583d4b1be5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:53.185559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe3f0d-fb8e-422a-a9b1-583d4b1be5ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:53.199823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe3f0d-fb8e-422a-a9b1-583d4b1be5ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:53.205715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-c8fe3f0d-fb8e-422a-a9b1-583d4b1be5ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:50:53.205715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:53.205715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:53.205715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:53.205715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:53.205715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:53.205715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:53.205715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:53.205715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:53.205715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:53.205715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:53.205715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:53.205715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:53.205715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:53.205715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:53.205715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:53.206724 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:53.206724 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:53.206724 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:53.206724 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:53.206724 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:53.206724 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:53.206724 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:53.206724 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:53.206724 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:53.206724 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:53.206724 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:53.206724 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:53.206724 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:53.206724 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:53.206724 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:53.206724 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:53.207631 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:53.207631 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:53.207631 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:53.207631 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:53.207631 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:53.207631 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:53.207631 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:53.207631 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:53.207631 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:53.207631 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:53.207631 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:50:53.207631 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:53.207631 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 278/558] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 08:50:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:53.208315 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe3f0d-fb8e-422a-a9b1-583d4b1be5ba None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:53.249192 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0dba4e-93cd-4bdd-a6d0-8c4e19d34370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:53.249748 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0dba4e-93cd-4bdd-a6d0-8c4e19d34370 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:53.250120 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0dba4e-93cd-4bdd-a6d0-8c4e19d34370 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:53.250425 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0dba4e-93cd-4bdd-a6d0-8c4e19d34370 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:53.262619 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0dba4e-93cd-4bdd-a6d0-8c4e19d34370 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:53.264101 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0dba4e-93cd-4bdd-a6d0-8c4e19d34370 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:53.281741 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-2f0dba4e-93cd-4bdd-a6d0-8c4e19d34370 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:53.281741 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:53.281741 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:53.281741 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:53.281741 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:53.281741 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:53.281741 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:53.281741 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:53.281741 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:53.281741 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:53.281741 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:53.281741 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:53.281741 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:50:53.281741 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:50:53.281741 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:50:53.288490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:50:53.288490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:53.288490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:53.288490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:53.288490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:53.288490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:53.288490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:53.288490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:53.288490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:53.288490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:53.288490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:53.288490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:53.288490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:53.288490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:53.288490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:53.288490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:53.288490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:53.289408 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:50:53.289408 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:50:53.289408 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:53.289408 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:53.289408 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 281/559] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:50:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:53.289408 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47297c-eb5e-4b5d-93a0-04c89b573e94 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:53.289408 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47297c-eb5e-4b5d-93a0-04c89b573e94 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:53.289408 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47297c-eb5e-4b5d-93a0-04c89b573e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:53.306727 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-be47297c-eb5e-4b5d-93a0-04c89b573e94 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:53.307796 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-be47297c-eb5e-4b5d-93a0-04c89b573e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:53.330499 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:53.356152 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe3f0d-fb8e-422a-a9b1-583d4b1be5ba None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:53.380810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 282/560] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:53.382105 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47297c-eb5e-4b5d-93a0-04c89b573e94 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:53.398734 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fba5d9-79c8-4bf5-86b2-3c8bf907946e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:53.400022 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fba5d9-79c8-4bf5-86b2-3c8bf907946e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:53.400354 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fba5d9-79c8-4bf5-86b2-3c8bf907946e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:53.400682 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fba5d9-79c8-4bf5-86b2-3c8bf907946e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:53.416041 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fba5d9-79c8-4bf5-86b2-3c8bf907946e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:53.417529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fba5d9-79c8-4bf5-86b2-3c8bf907946e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:53.435911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-42fba5d9-79c8-4bf5-86b2-3c8bf907946e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:53.435911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:53.435911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:53.435911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:53.435911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:53.435911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:53.435911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:53.435911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:53.435911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:53.435911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:53.435911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:53.435911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:53.435911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:50:53.435911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:50:53.435911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:50:53.436942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:50:53.436942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:53.436942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:53.436942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:53.436942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:53.436942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:53.436942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:53.436942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:53.436942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:53.436942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:53.436942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:53.436942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:53.436942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:53.436942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:53.436942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:53.436942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:53.436942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:53.437811 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:50:53.437811 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:50:53.437811 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:53.437811 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:53.438846 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 279/561] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:50:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:53.439311 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fba5d9-79c8-4bf5-86b2-3c8bf907946e None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:53.452934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:53.507267 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47297c-eb5e-4b5d-93a0-04c89b573e94 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:53.547412 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483bbf2-c308-48df-a88c-2f0244289782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:53.548052 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483bbf2-c308-48df-a88c-2f0244289782 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:53.548332 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483bbf2-c308-48df-a88c-2f0244289782 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:53.548605 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483bbf2-c308-48df-a88c-2f0244289782 None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:53.549354 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483bbf2-c308-48df-a88c-2f0244289782 None admin] RBAC: Adding query filter params (name=service) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:53.549662 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483bbf2-c308-48df-a88c-2f0244289782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:53.551202 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483bbf2-c308-48df-a88c-2f0244289782 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:53.560879 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 283/562] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 08:50:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:53.563443 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fba5d9-79c8-4bf5-86b2-3c8bf907946e None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:53.566098 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483bbf2-c308-48df-a88c-2f0244289782 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:53.602379 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e66d2-b9ff-4b58-beeb-3cf8ef98895d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:53.603023 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e66d2-b9ff-4b58-beeb-3cf8ef98895d None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:53.603312 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e66d2-b9ff-4b58-beeb-3cf8ef98895d None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:53.603592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e66d2-b9ff-4b58-beeb-3cf8ef98895d None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:53.604309 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e66d2-b9ff-4b58-beeb-3cf8ef98895d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:53.604624 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e66d2-b9ff-4b58-beeb-3cf8ef98895d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:53.606062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e66d2-b9ff-4b58-beeb-3cf8ef98895d None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:53.607837 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:53.622648 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 280/563] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:53.623530 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e66d2-b9ff-4b58-beeb-3cf8ef98895d None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:53.679459 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483bbf2-c308-48df-a88c-2f0244289782 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:53.694644 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:53.717790 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef501ab6-5d1b-4603-bf3a-29c10ef93742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:53.718617 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef501ab6-5d1b-4603-bf3a-29c10ef93742 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:53.718903 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef501ab6-5d1b-4603-bf3a-29c10ef93742 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:53.720507 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef501ab6-5d1b-4603-bf3a-29c10ef93742 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:53.731253 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef501ab6-5d1b-4603-bf3a-29c10ef93742 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:53.736576 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-ef501ab6-5d1b-4603-bf3a-29c10ef93742 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:50:53.736576 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:53.736576 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:53.736576 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:53.736576 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:53.736576 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:53.736576 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:53.736576 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:53.736576 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:53.736576 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:53.736576 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:53.736576 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:53.736576 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:53.736576 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:53.736576 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:53.736576 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:53.737592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:53.737592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:53.737592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:53.737592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:53.737592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:53.737592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:53.737592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:53.737592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:53.737592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:53.737592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:53.737592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:53.737592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:53.737592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:53.737592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:53.737592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:53.737592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:53.738486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:53.738486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:53.738486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:53.738486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:53.738486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:53.738486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:53.738486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:53.738486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:53.738486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:53.738486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:53.738486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:50:53.738486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:53.738486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 284/564] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 08:50:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:53.739358 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef501ab6-5d1b-4603-bf3a-29c10ef93742 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:53.748583 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e66d2-b9ff-4b58-beeb-3cf8ef98895d None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:53.787823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869932b-c9dd-472b-8fc5-6b4d576bd6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:53.788452 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869932b-c9dd-472b-8fc5-6b4d576bd6c6 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:53.788733 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869932b-c9dd-472b-8fc5-6b4d576bd6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:53.789005 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869932b-c9dd-472b-8fc5-6b4d576bd6c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:53.789742 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869932b-c9dd-472b-8fc5-6b4d576bd6c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:53.790049 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869932b-c9dd-472b-8fc5-6b4d576bd6c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:53.791562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869932b-c9dd-472b-8fc5-6b4d576bd6c6 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:53.803266 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 281/565] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:53.804527 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857975f-5745-4ffa-9e7a-2bd614b8cc9a None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:53.804822 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857975f-5745-4ffa-9e7a-2bd614b8cc9a None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:53.805103 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857975f-5745-4ffa-9e7a-2bd614b8cc9a None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:53.806993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 282/566] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:53.807707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857975f-5745-4ffa-9e7a-2bd614b8cc9a None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:53.854394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef501ab6-5d1b-4603-bf3a-29c10ef93742 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:53.872932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:53.894130 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d5b8a-63f2-4e7b-a72a-0c7f682e9819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:53.894805 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d5b8a-63f2-4e7b-a72a-0c7f682e9819 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:53.895081 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d5b8a-63f2-4e7b-a72a-0c7f682e9819 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:53.895355 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d5b8a-63f2-4e7b-a72a-0c7f682e9819 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:53.907312 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d5b8a-63f2-4e7b-a72a-0c7f682e9819 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:53.908773 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d5b8a-63f2-4e7b-a72a-0c7f682e9819 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:53.933175 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857975f-5745-4ffa-9e7a-2bd614b8cc9a None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:53.938840 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-c89d5b8a-63f2-4e7b-a72a-0c7f682e9819 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:53.938840 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:53.938840 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:53.938840 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:53.938840 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:53.938840 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:53.938840 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:53.938840 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:53.938840 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:53.938840 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:53.938840 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:53.938840 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:53.938840 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:50:53.938840 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:50:53.938840 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:50:53.939934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:50:53.939934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:53.939934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:53.939934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:53.939934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:53.939934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:53.939934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:53.939934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:53.939934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:53.939934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:53.939934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:53.939934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:53.939934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:53.939934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:53.939934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:53.939934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:53.939934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:53.940807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:50:53.940807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:50:53.940807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:53.940807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:53.940807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 285/567] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:50:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:53.942059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d5b8a-63f2-4e7b-a72a-0c7f682e9819 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:53.980928 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:53.985714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab78532-47ca-421b-aba9-1f79da17899b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:53.986399 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab78532-47ca-421b-aba9-1f79da17899b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:53.986692 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab78532-47ca-421b-aba9-1f79da17899b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:53.986976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab78532-47ca-421b-aba9-1f79da17899b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:53.995657 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab78532-47ca-421b-aba9-1f79da17899b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:53.997181 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab78532-47ca-421b-aba9-1f79da17899b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:54.009494 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-5ab78532-47ca-421b-aba9-1f79da17899b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 08:50:54.009494 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:54.009494 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:54.009494 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:54.009494 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:54.009494 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:54.009494 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:54.009494 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:54.009494 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:54.009494 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:54.009494 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:54.009494 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:54.009494 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:50:54.009494 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:50:54.009494 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:50:54.009494 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:50:54.010653 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:54.010653 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:54.010653 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:50:54.010653 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:50:54.010653 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:50:54.010653 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:50:54.010653 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:54.010653 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:54.010653 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:54.010653 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:54.010653 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:54.010653 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:54.010653 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:54.010653 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:54.010653 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:54.010653 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:54.010653 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:54.010653 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:54.011584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:54.011584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:54.011584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:50:54.011584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:50:54.011584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:50:54.011584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:50:54.011584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:50:54.011584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:50:54.011584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 08:50:54.011584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:54.011584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 283/568] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:50:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:54.011584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab78532-47ca-421b-aba9-1f79da17899b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:54.073185 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d5b8a-63f2-4e7b-a72a-0c7f682e9819 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:54.117713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadeee3-96cc-46d5-a6cc-ec8f5f3b73cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:54.119292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadeee3-96cc-46d5-a6cc-ec8f5f3b73cd None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:54.119857 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadeee3-96cc-46d5-a6cc-ec8f5f3b73cd None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:54.120158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadeee3-96cc-46d5-a6cc-ec8f5f3b73cd None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:54.121093 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadeee3-96cc-46d5-a6cc-ec8f5f3b73cd None admin] RBAC: Adding query filter params (name=service) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:54.121596 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadeee3-96cc-46d5-a6cc-ec8f5f3b73cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:54.123298 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadeee3-96cc-46d5-a6cc-ec8f5f3b73cd None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:54.127594 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab78532-47ca-421b-aba9-1f79da17899b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:54.133059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 286/569] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 08:50:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:54.134648 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc739a-84e5-4ca9-a7b1-f9c0fa0dc802 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:54.134937 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc739a-84e5-4ca9-a7b1-f9c0fa0dc802 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:54.135211 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc739a-84e5-4ca9-a7b1-f9c0fa0dc802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:54.143663 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:54.155569 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-42cc739a-84e5-4ca9-a7b1-f9c0fa0dc802 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:54.156857 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-42cc739a-84e5-4ca9-a7b1-f9c0fa0dc802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:54.167828 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35c241-7926-403c-b85c-8faebee7519d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:54.168623 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35c241-7926-403c-b85c-8faebee7519d None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:54.168895 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35c241-7926-403c-b85c-8faebee7519d None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:54.169172 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35c241-7926-403c-b85c-8faebee7519d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:54.176716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35c241-7926-403c-b85c-8faebee7519d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:54.178200 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35c241-7926-403c-b85c-8faebee7519d None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:54.198287 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-8a35c241-7926-403c-b85c-8faebee7519d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:50:54.198287 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:54.198287 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:54.198287 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:54.198287 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:54.198287 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:54.198287 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:54.198287 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:54.198287 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:54.198287 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:54.198287 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:54.198287 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:54.198287 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:50:54.198287 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:50:54.198287 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:50:54.199306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:50:54.199306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:54.199306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:54.199306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:54.199306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:54.199306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:54.199306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:54.199306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:54.199306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:54.199306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:54.199306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:54.199306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:54.199306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:54.199306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:54.199306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:54.199306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:54.199306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:54.200190 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:50:54.200190 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:50:54.200190 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:50:54.200190 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:50:54.200190 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:50:54.200190 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:50:54.200190 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:50:54.200190 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:54.200627 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 284/570] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:50:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:54.201713 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35c241-7926-403c-b85c-8faebee7519d None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:54.246066 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 287/571] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:54.247009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc739a-84e5-4ca9-a7b1-f9c0fa0dc802 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:54.280919 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:54.375987 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35c241-7926-403c-b85c-8faebee7519d None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:54.387608 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc739a-84e5-4ca9-a7b1-f9c0fa0dc802 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:54.426884 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd561d5-35cb-442a-b7c6-83a3f22fa755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:54.428168 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd561d5-35cb-442a-b7c6-83a3f22fa755 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:54.428620 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd561d5-35cb-442a-b7c6-83a3f22fa755 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:54.429063 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd561d5-35cb-442a-b7c6-83a3f22fa755 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:54.430130 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd561d5-35cb-442a-b7c6-83a3f22fa755 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:54.431189 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd561d5-35cb-442a-b7c6-83a3f22fa755 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:54.433553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd561d5-35cb-442a-b7c6-83a3f22fa755 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:54.446945 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c008b64-0810-4e8f-a17c-4c0901254837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:54.447797 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c008b64-0810-4e8f-a17c-4c0901254837 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:54.448187 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c008b64-0810-4e8f-a17c-4c0901254837 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:54.448569 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c008b64-0810-4e8f-a17c-4c0901254837 None admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:54.449371 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 285/572] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:54.449692 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c008b64-0810-4e8f-a17c-4c0901254837 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:54.450123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c008b64-0810-4e8f-a17c-4c0901254837 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:54.450588 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd561d5-35cb-442a-b7c6-83a3f22fa755 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:54.452955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c008b64-0810-4e8f-a17c-4c0901254837 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:54.474624 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 288/573] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Jul 27 08:50:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:54.475998 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c008b64-0810-4e8f-a17c-4c0901254837 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:54.494562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:54.582752 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:54.588411 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd561d5-35cb-442a-b7c6-83a3f22fa755 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:54.611391 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c008b64-0810-4e8f-a17c-4c0901254837 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:54.636692 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d911cc7-e11c-4507-b933-b894f796f047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:54.637430 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d911cc7-e11c-4507-b933-b894f796f047 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:54.637820 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d911cc7-e11c-4507-b933-b894f796f047 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:54.638248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d911cc7-e11c-4507-b933-b894f796f047 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:54.651369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d911cc7-e11c-4507-b933-b894f796f047 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:54.653613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d911cc7-e11c-4507-b933-b894f796f047 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:54.657459 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a061d1-b873-44c9-b257-bfa34df7951b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:54.658107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a061d1-b873-44c9-b257-bfa34df7951b None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:54.658423 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a061d1-b873-44c9-b257-bfa34df7951b None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:54.658735 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a061d1-b873-44c9-b257-bfa34df7951b None admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:54.659503 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a061d1-b873-44c9-b257-bfa34df7951b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:54.659811 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a061d1-b873-44c9-b257-bfa34df7951b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:54.661258 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a061d1-b873-44c9-b257-bfa34df7951b None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:54.672259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-2d911cc7-e11c-4507-b933-b894f796f047 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:54.672259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:54.672259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:54.672259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:54.672259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:54.672259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:54.672259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:54.672259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:54.672259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:54.672259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:54.672259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:54.672259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:54.672259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:50:54.672259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:50:54.672259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:50:54.674186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:50:54.674186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:54.674186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:54.674186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:54.674186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:54.674186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:54.674186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:54.674186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:54.674186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:54.674186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:54.674186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:54.674186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:54.674186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:54.674186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:54.674186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:54.674186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:54.674186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:54.676004 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:50:54.676004 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:50:54.676004 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:54.676004 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:54.676004 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 286/574] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:50:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:54.676004 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d911cc7-e11c-4507-b933-b894f796f047 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:54.677917 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 289/575] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:50:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:54.678456 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a061d1-b873-44c9-b257-bfa34df7951b None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:54.800184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:54.824445 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a061d1-b873-44c9-b257-bfa34df7951b None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:54.824826 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d911cc7-e11c-4507-b933-b894f796f047 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:54.865558 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a1617-2d99-4469-81fb-a2dde222ef51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:54.866390 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a1617-2d99-4469-81fb-a2dde222ef51 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:54.866800 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a1617-2d99-4469-81fb-a2dde222ef51 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:54.867202 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a1617-2d99-4469-81fb-a2dde222ef51 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:54.867365 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cbc24-6d32-4691-b43d-f84e57f14ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:54.868847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cbc24-6d32-4691-b43d-f84e57f14ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:54.868847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cbc24-6d32-4691-b43d-f84e57f14ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:54.868847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cbc24-6d32-4691-b43d-f84e57f14ee1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:54.871307 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:54.879032 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a1617-2d99-4469-81fb-a2dde222ef51 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:54.880687 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a1617-2d99-4469-81fb-a2dde222ef51 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:54.882310 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98cbc24-6d32-4691-b43d-f84e57f14ee1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:54.888830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-e98cbc24-6d32-4691-b43d-f84e57f14ee1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:50:54.888830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:54.888830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:54.888830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:54.888830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:54.888830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:54.888830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:54.888830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:54.888830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:54.888830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:54.888830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:54.888830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:54.888830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:54.888830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:54.888830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:54.888830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:54.890628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:54.890628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:54.890628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:54.890628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:54.890628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:54.890628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:54.890628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:54.890628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:54.890628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:54.890628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:54.890628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:54.890628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:54.890628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:54.890628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:54.890628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:54.890628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:54.892242 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:54.892242 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:54.892242 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:54.892242 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:54.892242 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:54.892242 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:54.892242 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:54.892242 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:54.892242 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:54.892242 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:54.892242 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:50:54.892242 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:54.896253 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 287/576] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 08:50:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:54.897160 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cbc24-6d32-4691-b43d-f84e57f14ee1 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:54.899739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-cd3a1617-2d99-4469-81fb-a2dde222ef51 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 08:50:54.899739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:54.899739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:54.899739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:54.899739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:54.899739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:54.899739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:54.899739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:54.899739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:54.899739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:54.899739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:54.899739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:54.899739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:50:54.899739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:50:54.899739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:50:54.899739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:50:54.903848 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:54.903848 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:54.903848 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:50:54.903848 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:50:54.903848 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:50:54.903848 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:50:54.903848 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:54.903848 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:54.903848 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:54.903848 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:54.903848 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:54.903848 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:54.903848 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:54.903848 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:54.903848 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:54.903848 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:54.903848 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:54.903848 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:54.906849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:54.906849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:54.906849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:50:54.906849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:50:54.906849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:50:54.906849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:50:54.906849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:50:54.906849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:50:54.906849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 08:50:54.906849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:54.906849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 290/577] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:50:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:54.906849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a1617-2d99-4469-81fb-a2dde222ef51 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:55.026932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cbc24-6d32-4691-b43d-f84e57f14ee1 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:55.031075 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a1617-2d99-4469-81fb-a2dde222ef51 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:55.066901 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734474c-9e30-4b03-81dc-b1cd9e43b6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:55.067612 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734474c-9e30-4b03-81dc-b1cd9e43b6bf None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:55.067988 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734474c-9e30-4b03-81dc-b1cd9e43b6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:55.068328 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734474c-9e30-4b03-81dc-b1cd9e43b6bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:55.071126 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b40934-13aa-4da3-8323-07528da0ad26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:55.071886 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b40934-13aa-4da3-8323-07528da0ad26 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:55.072268 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b40934-13aa-4da3-8323-07528da0ad26 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:55.072624 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b40934-13aa-4da3-8323-07528da0ad26 None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:55.073422 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b40934-13aa-4da3-8323-07528da0ad26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:55.073813 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b40934-13aa-4da3-8323-07528da0ad26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:55.075339 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b40934-13aa-4da3-8323-07528da0ad26 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:55.081590 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734474c-9e30-4b03-81dc-b1cd9e43b6bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:55.083267 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734474c-9e30-4b03-81dc-b1cd9e43b6bf None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:55.091127 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 291/578] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:55.091466 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:55.092410 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b40934-13aa-4da3-8323-07528da0ad26 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:55.106377 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-b734474c-9e30-4b03-81dc-b1cd9e43b6bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:55.106377 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:55.106377 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:55.106377 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:55.106377 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:55.106377 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:55.106377 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:55.106377 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:55.106377 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:55.106377 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:55.106377 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:55.106377 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:55.106377 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:50:55.106377 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:50:55.106377 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:50:55.108369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:50:55.108369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:55.108369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:55.108369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:55.108369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:55.108369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:55.108369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:55.108369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:55.108369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:55.108369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:55.108369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:55.108369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:55.108369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:55.108369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:55.108369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:55.108369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:55.108369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:55.110126 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:50:55.110126 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:50:55.110126 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:55.110126 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:55.110126 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 288/579] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:50:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:55.110126 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734474c-9e30-4b03-81dc-b1cd9e43b6bf None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:55.174669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:55.230960 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b40934-13aa-4da3-8323-07528da0ad26 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:55.239930 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734474c-9e30-4b03-81dc-b1cd9e43b6bf None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:55.277011 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f35c1-a600-4f04-b978-a1d0fe1ecb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:55.278196 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f35c1-a600-4f04-b978-a1d0fe1ecb59 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:55.278576 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f35c1-a600-4f04-b978-a1d0fe1ecb59 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:55.279019 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f35c1-a600-4f04-b978-a1d0fe1ecb59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:55.280446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f35c1-a600-4f04-b978-a1d0fe1ecb59 None admin] RBAC: Adding query filter params (role.id=e476894ef72943f9b83d98d0704edfea, scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267, user.id=158ea5c9dd5142eebd903d5f732997ad) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:55.280943 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f35c1-a600-4f04-b978-a1d0fe1ecb59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:55.283559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f35c1-a600-4f04-b978-a1d0fe1ecb59 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:55.291870 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 292/580] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:50:55 2022] GET /identity/v3/role_assignments?user.id=158ea5c9dd5142eebd903d5f732997ad&scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267&role.id=e476894ef72943f9b83d98d0704edfea => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:55.292313 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013f686-7658-43d4-abb0-7eacd12d9076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:55.292731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f35c1-a600-4f04-b978-a1d0fe1ecb59 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:55.293562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013f686-7658-43d4-abb0-7eacd12d9076 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:55.294139 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013f686-7658-43d4-abb0-7eacd12d9076 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:55.294709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013f686-7658-43d4-abb0-7eacd12d9076 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:55.296134 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013f686-7658-43d4-abb0-7eacd12d9076 None admin] RBAC: Adding query filter params (name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:55.296682 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013f686-7658-43d4-abb0-7eacd12d9076 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:55.299403 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013f686-7658-43d4-abb0-7eacd12d9076 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:55.317413 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 289/581] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 08:50:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:55.318959 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013f686-7658-43d4-abb0-7eacd12d9076 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:55.431907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:55.455317 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f35c1-a600-4f04-b978-a1d0fe1ecb59 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:55.488808 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:55.507228 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013f686-7658-43d4-abb0-7eacd12d9076 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:55.509454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5073d5-b430-4c23-940f-836abaca2041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:55.510555 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5073d5-b430-4c23-940f-836abaca2041 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:55.511041 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5073d5-b430-4c23-940f-836abaca2041 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:55.511541 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5073d5-b430-4c23-940f-836abaca2041 None admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:55.513062 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5073d5-b430-4c23-940f-836abaca2041 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:55.513588 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5073d5-b430-4c23-940f-836abaca2041 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:55.516332 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5073d5-b430-4c23-940f-836abaca2041 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:55.549594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 293/582] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Jul 27 08:50:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:55.551177 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5073d5-b430-4c23-940f-836abaca2041 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:55.559292 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc448e9-45f2-40b9-a14d-bc62516f8472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:55.560480 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc448e9-45f2-40b9-a14d-bc62516f8472 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:55.561030 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc448e9-45f2-40b9-a14d-bc62516f8472 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:55.561578 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc448e9-45f2-40b9-a14d-bc62516f8472 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:55.578475 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc448e9-45f2-40b9-a14d-bc62516f8472 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:55.580306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc448e9-45f2-40b9-a14d-bc62516f8472 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:55.595861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-3dc448e9-45f2-40b9-a14d-bc62516f8472 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:50:55.595861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:55.595861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:55.595861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:55.595861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:55.595861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:55.595861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:55.595861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:55.595861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:55.595861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:55.595861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:55.595861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:55.595861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:50:55.595861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:50:55.595861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:50:55.595861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:50:55.598562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:55.598562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:55.598562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:50:55.598562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:50:55.598562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:50:55.598562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:50:55.598562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:55.598562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:55.598562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:55.598562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:55.598562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:55.598562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:55.598562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:55.598562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:55.598562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:55.598562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:55.598562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:55.598562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:55.602946 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:55.602946 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:55.602946 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:50:55.602946 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:50:55.602946 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:50:55.602946 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:50:55.602946 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:50:55.602946 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:50:55.602946 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:50:55.602946 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:55.602946 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 290/583] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Jul 27 08:50:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:55.602946 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc448e9-45f2-40b9-a14d-bc62516f8472 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:55.737249 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5073d5-b430-4c23-940f-836abaca2041 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:55.775636 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc448e9-45f2-40b9-a14d-bc62516f8472 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:55.800667 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:55.804588 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09761620-974b-4101-9ab2-36bcb687160b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:55.806146 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09761620-974b-4101-9ab2-36bcb687160b None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:55.806767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09761620-974b-4101-9ab2-36bcb687160b None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:55.807131 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09761620-974b-4101-9ab2-36bcb687160b None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:55.808394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09761620-974b-4101-9ab2-36bcb687160b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:55.809128 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09761620-974b-4101-9ab2-36bcb687160b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:55.811593 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09761620-974b-4101-9ab2-36bcb687160b None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:55.820325 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835a61e-5dbb-4de1-90b0-51f1ca3faee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:55.821871 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835a61e-5dbb-4de1-90b0-51f1ca3faee6 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:55.821871 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835a61e-5dbb-4de1-90b0-51f1ca3faee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:55.822422 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835a61e-5dbb-4de1-90b0-51f1ca3faee6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:55.834297 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 294/584] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:55.835863 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835a61e-5dbb-4de1-90b0-51f1ca3faee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:55.837476 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835a61e-5dbb-4de1-90b0-51f1ca3faee6 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:55.841096 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09761620-974b-4101-9ab2-36bcb687160b None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:55.855187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-8835a61e-5dbb-4de1-90b0-51f1ca3faee6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:55.855187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:55.855187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:55.855187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:55.855187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:55.855187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:55.855187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:55.855187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:55.855187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:55.855187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:55.855187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:55.855187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:55.855187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:50:55.855187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:50:55.855187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:50:55.856910 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:50:55.856910 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:55.856910 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:55.856910 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:55.856910 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:55.856910 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:55.856910 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:55.856910 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:55.856910 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:55.856910 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:55.856910 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:55.856910 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:55.856910 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:55.856910 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:55.856910 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:55.856910 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:55.856910 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:55.859254 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:50:55.859254 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:50:55.859254 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:55.859254 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:55.861118 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 291/585] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:50:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:55.862060 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835a61e-5dbb-4de1-90b0-51f1ca3faee6 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:55.918533 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:56.005749 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835a61e-5dbb-4de1-90b0-51f1ca3faee6 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:56.028885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09761620-974b-4101-9ab2-36bcb687160b None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:56.073819 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536988d9-fc1c-40c4-87f6-d1f2b00ee257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:56.074624 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8622ba8-0999-4450-9038-c8885f95ecb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:56.074907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536988d9-fc1c-40c4-87f6-d1f2b00ee257 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:56.075396 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536988d9-fc1c-40c4-87f6-d1f2b00ee257 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:56.075553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8622ba8-0999-4450-9038-c8885f95ecb2 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:56.075884 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536988d9-fc1c-40c4-87f6-d1f2b00ee257 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:56.076064 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8622ba8-0999-4450-9038-c8885f95ecb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:56.076405 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8622ba8-0999-4450-9038-c8885f95ecb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:56.077388 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536988d9-fc1c-40c4-87f6-d1f2b00ee257 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:56.077945 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536988d9-fc1c-40c4-87f6-d1f2b00ee257 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:56.080725 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536988d9-fc1c-40c4-87f6-d1f2b00ee257 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:56.090765 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8622ba8-0999-4450-9038-c8885f95ecb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:56.092433 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8622ba8-0999-4450-9038-c8885f95ecb2 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:56.111312 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-f8622ba8-0999-4450-9038-c8885f95ecb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:56.111312 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:56.111312 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:56.111312 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:56.111312 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:56.111312 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:56.111312 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:56.111312 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:56.111312 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:56.111312 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:56.111312 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:56.111312 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:56.111312 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:50:56.111312 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:50:56.111312 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:50:56.113072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:50:56.113072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:56.113072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:56.113072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:56.113072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:56.113072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:56.113072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:56.113072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:56.113072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:56.113072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:56.113072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:56.113072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:56.113072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:56.113072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:56.113072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:56.113072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:56.113072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:56.114847 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:50:56.114847 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:50:56.114847 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:56.114847 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:56.114847 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 295/586] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:50:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:56.114847 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8622ba8-0999-4450-9038-c8885f95ecb2 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:56.125157 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 292/587] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Jul 27 08:50:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:56.126774 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536988d9-fc1c-40c4-87f6-d1f2b00ee257 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:56.173905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:56.268972 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536988d9-fc1c-40c4-87f6-d1f2b00ee257 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:56.279068 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:56.303924 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8622ba8-0999-4450-9038-c8885f95ecb2 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:56.319805 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442587f-7bb4-4ef5-bba7-eaae3640282b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:56.320690 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442587f-7bb4-4ef5-bba7-eaae3640282b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:56.321017 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442587f-7bb4-4ef5-bba7-eaae3640282b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:56.321405 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442587f-7bb4-4ef5-bba7-eaae3640282b None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:56.322114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442587f-7bb4-4ef5-bba7-eaae3640282b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:56.322458 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442587f-7bb4-4ef5-bba7-eaae3640282b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:56.323850 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442587f-7bb4-4ef5-bba7-eaae3640282b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:56.343861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 293/588] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:56.343861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442587f-7bb4-4ef5-bba7-eaae3640282b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:56.380911 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25754c0-388f-47fc-89ac-c8c750692ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:56.381919 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25754c0-388f-47fc-89ac-c8c750692ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:56.382429 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25754c0-388f-47fc-89ac-c8c750692ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:56.382895 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25754c0-388f-47fc-89ac-c8c750692ac2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:56.394575 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25754c0-388f-47fc-89ac-c8c750692ac2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:56.397966 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25754c0-388f-47fc-89ac-c8c750692ac2 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:56.421599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-b25754c0-388f-47fc-89ac-c8c750692ac2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:50:56.421599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:56.421599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:56.421599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:56.421599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:56.421599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:56.421599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:56.421599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:56.421599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:56.421599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:56.421599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:56.421599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:56.421599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:50:56.421599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:50:56.421599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:50:56.431849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:50:56.431849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:56.431849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:56.431849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:56.431849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:56.431849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:56.431849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:56.431849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:56.431849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:56.431849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:56.431849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:56.431849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:56.431849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:56.431849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:56.431849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:56.431849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:56.431849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:56.434089 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:50:56.434089 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:50:56.434089 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:50:56.434089 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:50:56.434089 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:50:56.434089 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:50:56.434089 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:50:56.434089 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:56.434089 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 296/589] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:50:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:56.434089 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25754c0-388f-47fc-89ac-c8c750692ac2 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:56.469831 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:56.484214 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442587f-7bb4-4ef5-bba7-eaae3640282b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:56.528537 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1a597-3315-4ba6-8c29-65fe44c7ea2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:56.529070 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1a597-3315-4ba6-8c29-65fe44c7ea2b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:56.529352 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1a597-3315-4ba6-8c29-65fe44c7ea2b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:56.529890 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1a597-3315-4ba6-8c29-65fe44c7ea2b None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:56.530350 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1a597-3315-4ba6-8c29-65fe44c7ea2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:56.530686 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1a597-3315-4ba6-8c29-65fe44c7ea2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:56.532094 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1a597-3315-4ba6-8c29-65fe44c7ea2b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:56.551213 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 294/590] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:56.552171 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1a597-3315-4ba6-8c29-65fe44c7ea2b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:56.600182 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25754c0-388f-47fc-89ac-c8c750692ac2 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:56.650765 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9eefb-1637-4e26-bead-ca44a4b58f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:56.651759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9eefb-1637-4e26-bead-ca44a4b58f3d None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:56.652204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9eefb-1637-4e26-bead-ca44a4b58f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:56.652645 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9eefb-1637-4e26-bead-ca44a4b58f3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:56.671189 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9eefb-1637-4e26-bead-ca44a4b58f3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:56.673681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9eefb-1637-4e26-bead-ca44a4b58f3d None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:56.699657 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-ada9eefb-1637-4e26-bead-ca44a4b58f3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:56.699657 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:56.699657 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:56.699657 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:56.699657 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:56.699657 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:56.699657 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:56.699657 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:56.699657 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:56.699657 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:56.699657 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:56.699657 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:56.699657 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:50:56.699657 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:50:56.699657 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:50:56.700667 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:50:56.700667 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:56.700667 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:56.700667 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:56.700667 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:56.700667 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:56.700667 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:56.700667 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:56.700667 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:56.700667 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:56.700667 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:56.700667 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:56.700667 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:56.700667 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:56.700667 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:56.700667 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:56.700667 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:56.701559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:50:56.701559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:50:56.701559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:56.701559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:56.701802 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1a597-3315-4ba6-8c29-65fe44c7ea2b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:56.702208 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 297/591] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:50:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:56.703489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9eefb-1637-4e26-bead-ca44a4b58f3d None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:56.708177 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:56.750265 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a67aec-1862-44f0-9d80-b8df4ddad65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:56.750947 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a67aec-1862-44f0-9d80-b8df4ddad65e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:56.751235 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a67aec-1862-44f0-9d80-b8df4ddad65e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:56.751554 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a67aec-1862-44f0-9d80-b8df4ddad65e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:56.760278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a67aec-1862-44f0-9d80-b8df4ddad65e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:56.761748 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a67aec-1862-44f0-9d80-b8df4ddad65e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:56.775777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-e8a67aec-1862-44f0-9d80-b8df4ddad65e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 08:50:56.775777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:56.775777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:56.775777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:56.775777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:56.775777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:56.775777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:56.775777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:56.775777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:56.775777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:56.775777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:56.775777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:56.775777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:50:56.775777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:50:56.775777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:50:56.775777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:50:56.777671 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:56.777671 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:56.777671 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:50:56.777671 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:50:56.777671 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:50:56.777671 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:50:56.777671 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:56.777671 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:56.777671 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:56.777671 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:56.777671 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:56.777671 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:56.777671 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:56.777671 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:56.777671 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:56.777671 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:56.777671 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:56.777671 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:56.779925 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:56.779925 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:56.779925 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:50:56.779925 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:50:56.779925 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:50:56.779925 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:50:56.779925 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:50:56.779925 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:50:56.779925 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 08:50:56.779925 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:56.779925 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 295/592] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 08:50:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:56.779925 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a67aec-1862-44f0-9d80-b8df4ddad65e None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:56.797637 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:56.856690 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9eefb-1637-4e26-bead-ca44a4b58f3d None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:56.902258 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a67aec-1862-44f0-9d80-b8df4ddad65e None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:56.918624 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77aaec8-ede0-413f-a3a8-ee165f96ba1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:56.919855 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77aaec8-ede0-413f-a3a8-ee165f96ba1c None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:56.920460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77aaec8-ede0-413f-a3a8-ee165f96ba1c None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:56.921070 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77aaec8-ede0-413f-a3a8-ee165f96ba1c None admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:56.922614 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77aaec8-ede0-413f-a3a8-ee165f96ba1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:56.923276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77aaec8-ede0-413f-a3a8-ee165f96ba1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:56.926111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77aaec8-ede0-413f-a3a8-ee165f96ba1c None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:56.940693 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc99b7f-e0ca-489c-9d39-faf681adba6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:56.941350 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc99b7f-e0ca-489c-9d39-faf681adba6d None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:56.941636 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc99b7f-e0ca-489c-9d39-faf681adba6d None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:56.941919 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc99b7f-e0ca-489c-9d39-faf681adba6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:56.949776 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc99b7f-e0ca-489c-9d39-faf681adba6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:56.956027 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc99b7f-e0ca-489c-9d39-faf681adba6d None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:56.956200 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 298/593] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:50:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:56.956200 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77aaec8-ede0-413f-a3a8-ee165f96ba1c None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:56.969123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-bdc99b7f-e0ca-489c-9d39-faf681adba6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:50:56.969123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:56.969123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:56.969123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:56.969123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:56.969123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:56.969123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:56.969123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:56.969123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:56.969123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:56.969123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:56.969123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:56.969123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:50:56.969123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:50:56.969123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:50:56.970117 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:50:56.970117 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:56.970117 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:56.970117 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:56.970117 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:56.970117 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:56.970117 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:56.970117 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:56.970117 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:56.970117 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:56.970117 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:56.970117 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:56.970117 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:56.970117 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:56.970117 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:56.970117 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:56.970117 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:56.971037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:50:56.971037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:50:56.971037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:50:56.971037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:50:56.971037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:50:56.971037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:50:56.971037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:50:56.971037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:56.971037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 296/594] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:50:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:56.972112 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc99b7f-e0ca-489c-9d39-faf681adba6d None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:57.058861 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:57.108874 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:57.136648 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77aaec8-ede0-413f-a3a8-ee165f96ba1c None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:57.167925 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc99b7f-e0ca-489c-9d39-faf681adba6d None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:57.194058 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b3cd7-fb57-453f-8082-a94f1b040f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:57.195081 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b3cd7-fb57-453f-8082-a94f1b040f2d None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:57.195537 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b3cd7-fb57-453f-8082-a94f1b040f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:57.196523 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b3cd7-fb57-453f-8082-a94f1b040f2d None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:57.197733 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b3cd7-fb57-453f-8082-a94f1b040f2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:57.198233 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b3cd7-fb57-453f-8082-a94f1b040f2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:57.200537 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b3cd7-fb57-453f-8082-a94f1b040f2d None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:57.226754 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 299/595] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:57.226754 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b3cd7-fb57-453f-8082-a94f1b040f2d None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:57.237996 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1f437-b128-4b2f-9e6c-014dd2db1cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:57.239026 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1f437-b128-4b2f-9e6c-014dd2db1cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:57.239439 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1f437-b128-4b2f-9e6c-014dd2db1cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:57.239880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1f437-b128-4b2f-9e6c-014dd2db1cf5 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:57.241444 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1f437-b128-4b2f-9e6c-014dd2db1cf5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:57.241986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1f437-b128-4b2f-9e6c-014dd2db1cf5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:57.244101 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1f437-b128-4b2f-9e6c-014dd2db1cf5 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:57.275266 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 297/596] 10.222.0.65 () {56 vars in 1139 bytes} [Wed Jul 27 08:50:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:57.276623 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1f437-b128-4b2f-9e6c-014dd2db1cf5 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:57.397218 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b3cd7-fb57-453f-8082-a94f1b040f2d None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:57.428853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1f437-b128-4b2f-9e6c-014dd2db1cf5 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:57.442663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:57.467001 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76096b06-8578-48df-86c8-a323441ec528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:57.467996 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76096b06-8578-48df-86c8-a323441ec528 None admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:57.468452 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76096b06-8578-48df-86c8-a323441ec528 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:57.468907 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76096b06-8578-48df-86c8-a323441ec528 None admin] PATH_INFO: `/v3/projects/3f77fdd017ea4a9b9b49f6e87ba7f267/users/713805e0f1174a01987014319075ec03/roles/e476894ef72943f9b83d98d0704edfea` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:57.470433 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:57.487133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d0b19-bd42-453f-8cac-5c4e95c3be91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:57.488003 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d0b19-bd42-453f-8cac-5c4e95c3be91 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:57.488436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d0b19-bd42-453f-8cac-5c4e95c3be91 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:57.488926 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d0b19-bd42-453f-8cac-5c4e95c3be91 None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:57.489904 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d0b19-bd42-453f-8cac-5c4e95c3be91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:57.490378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d0b19-bd42-453f-8cac-5c4e95c3be91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:57.492216 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d0b19-bd42-453f-8cac-5c4e95c3be91 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:57.499325 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76096b06-8578-48df-86c8-a323441ec528 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f77fdd017ea4a9b9b49f6e87ba7f267, user_id=713805e0f1174a01987014319075ec03, role_id=e476894ef72943f9b83d98d0704edfea)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:57.503121 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76096b06-8578-48df-86c8-a323441ec528 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:57.514591 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 298/597] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:50:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:57.514591 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d0b19-bd42-453f-8cac-5c4e95c3be91 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:57.536283 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 300/598] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 08:50:57 2022] PUT /identity/v3/projects/3f77fdd017ea4a9b9b49f6e87ba7f267/users/713805e0f1174a01987014319075ec03/roles/e476894ef72943f9b83d98d0704edfea => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:50:57.537931 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76096b06-8578-48df-86c8-a323441ec528 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:57.734930 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d0b19-bd42-453f-8cac-5c4e95c3be91 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:57.755488 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76096b06-8578-48df-86c8-a323441ec528 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:57.811741 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978b3fd-bcf8-4d05-a231-64b81ffd85ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:57.813332 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978b3fd-bcf8-4d05-a231-64b81ffd85ee None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:57.814121 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978b3fd-bcf8-4d05-a231-64b81ffd85ee None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:57.814805 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978b3fd-bcf8-4d05-a231-64b81ffd85ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:57.815191 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d290b66-4006-497b-9b13-7c4c3fe6fdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:57.815849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d290b66-4006-497b-9b13-7c4c3fe6fdc3 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:57.816293 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d290b66-4006-497b-9b13-7c4c3fe6fdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:57.816762 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d290b66-4006-497b-9b13-7c4c3fe6fdc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:57.827448 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978b3fd-bcf8-4d05-a231-64b81ffd85ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:57.829387 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978b3fd-bcf8-4d05-a231-64b81ffd85ee None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:57.832525 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d290b66-4006-497b-9b13-7c4c3fe6fdc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:57.835535 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d290b66-4006-497b-9b13-7c4c3fe6fdc3 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:57.846907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-3978b3fd-bcf8-4d05-a231-64b81ffd85ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:50:57.846907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:57.846907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:57.846907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:57.846907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:57.846907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:57.846907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:57.846907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:57.846907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:57.846907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:57.846907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:57.846907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:57.846907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:50:57.846907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:50:57.846907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:50:57.847847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:50:57.847847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:57.847847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:57.847847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:57.847847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:57.847847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:57.847847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:57.847847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:57.847847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:57.847847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:57.847847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:57.847847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:57.847847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:57.847847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:57.847847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:57.847847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:57.847847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:57.849216 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:50:57.849216 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:50:57.849216 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:50:57.849216 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:50:57.849216 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:50:57.849216 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:50:57.849216 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:50:57.849216 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:57.849216 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 299/599] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:50:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:57.850078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978b3fd-bcf8-4d05-a231-64b81ffd85ee None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:57.862379 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-9d290b66-4006-497b-9b13-7c4c3fe6fdc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:57.862379 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:57.862379 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:57.862379 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:57.862379 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:57.862379 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:57.862379 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:57.862379 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:57.862379 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:57.862379 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:57.862379 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:57.862379 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:57.862379 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:50:57.862379 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:50:57.862379 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:50:57.863401 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:50:57.863401 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:57.863401 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:57.863401 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:57.863401 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:57.863401 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:57.863401 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:57.863401 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:57.863401 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:57.863401 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:57.863401 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:57.863401 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:57.863401 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:57.863401 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:57.863401 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:57.863401 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:57.863401 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:57.864305 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:50:57.864305 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:50:57.864305 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:57.864305 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:57.866808 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 301/600] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:50:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:57.869703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71d0ee-d6e2-437a-b4ff-b174fb472065 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:57.870360 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71d0ee-d6e2-437a-b4ff-b174fb472065 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:57.870847 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71d0ee-d6e2-437a-b4ff-b174fb472065 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:57.874413 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 302/601] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:50:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:50:57.877883 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71d0ee-d6e2-437a-b4ff-b174fb472065 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:57.910486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:57.940121 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:58.022712 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71d0ee-d6e2-437a-b4ff-b174fb472065 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:58.052372 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978b3fd-bcf8-4d05-a231-64b81ffd85ee None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:58.070409 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74849d7e-9e41-4a87-a6ee-c552d02c4ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:58.071190 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74849d7e-9e41-4a87-a6ee-c552d02c4ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:58.071544 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74849d7e-9e41-4a87-a6ee-c552d02c4ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:58.071810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74849d7e-9e41-4a87-a6ee-c552d02c4ae9 None admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:58.072618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74849d7e-9e41-4a87-a6ee-c552d02c4ae9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:58.072914 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74849d7e-9e41-4a87-a6ee-c552d02c4ae9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:58.074460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74849d7e-9e41-4a87-a6ee-c552d02c4ae9 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:58.093993 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 303/602] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:50:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:58.095859 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74849d7e-9e41-4a87-a6ee-c552d02c4ae9 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:58.124360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b0f57-6cd7-41f4-b93e-c80122906f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:58.125086 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b0f57-6cd7-41f4-b93e-c80122906f7e None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:58.125347 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b0f57-6cd7-41f4-b93e-c80122906f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:58.125623 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b0f57-6cd7-41f4-b93e-c80122906f7e None admin] PATH_INFO: `/v3/projects/3f77fdd017ea4a9b9b49f6e87ba7f267/users/72763a52df364a4a8a660ec1be4aba79/roles/e476894ef72943f9b83d98d0704edfea` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:58.145966 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b0f57-6cd7-41f4-b93e-c80122906f7e None admin] RBAC: Authorizing `identity:create_grant(project_id=3f77fdd017ea4a9b9b49f6e87ba7f267, user_id=72763a52df364a4a8a660ec1be4aba79, role_id=e476894ef72943f9b83d98d0704edfea)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:58.147532 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b0f57-6cd7-41f4-b93e-c80122906f7e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:58.164796 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 300/603] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 08:50:57 2022] PUT /identity/v3/projects/3f77fdd017ea4a9b9b49f6e87ba7f267/users/72763a52df364a4a8a660ec1be4aba79/roles/e476894ef72943f9b83d98d0704edfea => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:50:58.166963 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b223bd-68db-453e-9841-29936fedd3f6 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:58.167276 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b223bd-68db-453e-9841-29936fedd3f6 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:58.167519 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b223bd-68db-453e-9841-29936fedd3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:58.193150 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-c9b223bd-68db-453e-9841-29936fedd3f6 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:50:58.194644 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c9b223bd-68db-453e-9841-29936fedd3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:50:58.285534 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:58.305163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 301/604] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:50:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:50:58.306586 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b223bd-68db-453e-9841-29936fedd3f6 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:58.334577 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74849d7e-9e41-4a87-a6ee-c552d02c4ae9 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:58.372821 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:58.398906 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f845ca4-9e66-4787-a9a1-ccd8025f9083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:58.402434 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f845ca4-9e66-4787-a9a1-ccd8025f9083 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:58.402609 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f845ca4-9e66-4787-a9a1-ccd8025f9083 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:58.403968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f845ca4-9e66-4787-a9a1-ccd8025f9083 None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:58.405070 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f845ca4-9e66-4787-a9a1-ccd8025f9083 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:58.405070 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f845ca4-9e66-4787-a9a1-ccd8025f9083 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:58.406873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f845ca4-9e66-4787-a9a1-ccd8025f9083 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:58.427941 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 304/605] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:58.429738 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f845ca4-9e66-4787-a9a1-ccd8025f9083 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:58.531231 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b223bd-68db-453e-9841-29936fedd3f6 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:58.576757 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e96ac-8738-43fb-817f-2f838e0faa1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:58.577436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e96ac-8738-43fb-817f-2f838e0faa1e None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:58.577722 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e96ac-8738-43fb-817f-2f838e0faa1e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:58.578035 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e96ac-8738-43fb-817f-2f838e0faa1e None admin] PATH_INFO: `/v3/projects/3f77fdd017ea4a9b9b49f6e87ba7f267/users/c30bc55c6a1348bb961f0d010422da87/roles/e476894ef72943f9b83d98d0704edfea` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:58.596764 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e96ac-8738-43fb-817f-2f838e0faa1e None admin] RBAC: Authorizing `identity:create_grant(project_id=3f77fdd017ea4a9b9b49f6e87ba7f267, user_id=c30bc55c6a1348bb961f0d010422da87, role_id=e476894ef72943f9b83d98d0704edfea)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:58.598233 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e96ac-8738-43fb-817f-2f838e0faa1e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:58.616425 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 302/606] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 08:50:58 2022] PUT /identity/v3/projects/3f77fdd017ea4a9b9b49f6e87ba7f267/users/c30bc55c6a1348bb961f0d010422da87/roles/e476894ef72943f9b83d98d0704edfea => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:50:58.617460 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e96ac-8738-43fb-817f-2f838e0faa1e None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:58.620296 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f845ca4-9e66-4787-a9a1-ccd8025f9083 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:58.713800 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67334e14-cd77-4477-8a5e-bd82d2480f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:58.715138 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67334e14-cd77-4477-8a5e-bd82d2480f54 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:58.715749 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67334e14-cd77-4477-8a5e-bd82d2480f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:58.716366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67334e14-cd77-4477-8a5e-bd82d2480f54 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:58.725666 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:58.756453 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e96ac-8738-43fb-817f-2f838e0faa1e None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:58.761883 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67334e14-cd77-4477-8a5e-bd82d2480f54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:50:58.784815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-67334e14-cd77-4477-8a5e-bd82d2480f54 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:50:58.784815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:58.784815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:58.784815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:58.784815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:58.784815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:58.784815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:58.784815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:58.784815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:58.784815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:58.784815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:58.784815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:58.784815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:50:58.784815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:50:58.784815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:50:58.784815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:50:58.788330 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:50:58.788330 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:50:58.788330 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:50:58.788330 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:50:58.788330 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:58.788330 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:58.788330 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:58.788330 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:58.788330 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:58.788330 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:58.788330 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:58.788330 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:58.788330 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:58.788330 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:58.788330 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:58.788330 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:58.791660 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:58.791660 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:58.791660 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:58.791660 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:58.791660 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:50:58.791660 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:50:58.791660 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:50:58.791660 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:50:58.791660 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:50:58.791660 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:50:58.791660 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:50:58.791660 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:58.791660 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 305/607] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 08:50:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:58.794278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67334e14-cd77-4477-8a5e-bd82d2480f54 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:58.802653 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:58.812194 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92cd6a-e09d-408a-abee-1c5dc1709ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:58.812938 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92cd6a-e09d-408a-abee-1c5dc1709ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:58.813226 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92cd6a-e09d-408a-abee-1c5dc1709ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:58.813633 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92cd6a-e09d-408a-abee-1c5dc1709ef9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:58.841043 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92cd6a-e09d-408a-abee-1c5dc1709ef9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:58.845906 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92cd6a-e09d-408a-abee-1c5dc1709ef9 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:58.885993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-ec92cd6a-e09d-408a-abee-1c5dc1709ef9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:50:58.885993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:58.885993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:58.885993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:58.885993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:58.885993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:58.885993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:58.885993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:58.885993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:58.885993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:58.885993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:58.885993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:58.885993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:50:58.885993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:50:58.885993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:50:58.887750 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:50:58.887750 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:58.887750 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:58.887750 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:58.887750 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:58.887750 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:58.887750 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:58.887750 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:58.887750 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:58.887750 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:58.887750 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:58.887750 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:58.887750 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:58.887750 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:58.887750 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:58.887750 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:58.887750 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:58.889481 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:50:58.889481 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:50:58.889481 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:50:58.889481 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:50:58.889481 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:50:58.889481 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:50:58.889481 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:50:58.889481 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:50:58.894068 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 303/608] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:50:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:58.901778 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92cd6a-e09d-408a-abee-1c5dc1709ef9 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:59.041671 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67334e14-cd77-4477-8a5e-bd82d2480f54 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:59.128399 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c343f3-d2e2-4d73-b494-98ba25d58d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:59.130233 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c343f3-d2e2-4d73-b494-98ba25d58d6a None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:59.134080 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c343f3-d2e2-4d73-b494-98ba25d58d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:59.137603 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c343f3-d2e2-4d73-b494-98ba25d58d6a None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:59.139304 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c343f3-d2e2-4d73-b494-98ba25d58d6a None admin] RBAC: Adding query filter params (name=service) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:59.143055 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c343f3-d2e2-4d73-b494-98ba25d58d6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:59.146017 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c343f3-d2e2-4d73-b494-98ba25d58d6a None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:59.177383 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 306/609] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 08:50:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:59.184404 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c343f3-d2e2-4d73-b494-98ba25d58d6a None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:59.198017 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92cd6a-e09d-408a-abee-1c5dc1709ef9 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:59.276353 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4998c6-a7ab-4f6a-8bdf-ea09dda9bcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:59.278024 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4998c6-a7ab-4f6a-8bdf-ea09dda9bcb1 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:59.281044 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4998c6-a7ab-4f6a-8bdf-ea09dda9bcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:59.283278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4998c6-a7ab-4f6a-8bdf-ea09dda9bcb1 None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:59.286006 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4998c6-a7ab-4f6a-8bdf-ea09dda9bcb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:59.287102 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4998c6-a7ab-4f6a-8bdf-ea09dda9bcb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:59.292736 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4998c6-a7ab-4f6a-8bdf-ea09dda9bcb1 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:59.312224 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:59.344970 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 304/610] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:50:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:59.346547 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4998c6-a7ab-4f6a-8bdf-ea09dda9bcb1 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:59.382589 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:59.489939 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c343f3-d2e2-4d73-b494-98ba25d58d6a None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:59.573838 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82d8a2-8c08-44cb-9083-fa8b8db42cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:59.573838 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82d8a2-8c08-44cb-9083-fa8b8db42cac None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:59.573838 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82d8a2-8c08-44cb-9083-fa8b8db42cac None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:59.573838 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82d8a2-8c08-44cb-9083-fa8b8db42cac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:59.587551 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4998c6-a7ab-4f6a-8bdf-ea09dda9bcb1 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:59.594344 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab82d8a2-8c08-44cb-9083-fa8b8db42cac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:59.597336 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab82d8a2-8c08-44cb-9083-fa8b8db42cac None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:59.627212 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185af6d-0f2f-427b-86ac-8b479a390832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:59.628157 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185af6d-0f2f-427b-86ac-8b479a390832 None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:59.628586 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185af6d-0f2f-427b-86ac-8b479a390832 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:59.629006 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185af6d-0f2f-427b-86ac-8b479a390832 None admin] PATH_INFO: `/v3/projects/3f77fdd017ea4a9b9b49f6e87ba7f267/users/b018ac10ad804c6cbbe7fdcc1cec61e8/roles/e476894ef72943f9b83d98d0704edfea` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:59.631262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-ab82d8a2-8c08-44cb-9083-fa8b8db42cac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:59.631262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:50:59.631262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:50:59.631262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:50:59.631262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:50:59.631262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:50:59.631262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:50:59.631262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:50:59.631262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:50:59.631262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:50:59.631262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:50:59.631262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:50:59.631262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:50:59.631262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:50:59.631262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:50:59.632157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:50:59.632157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:50:59.632157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:50:59.632157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:50:59.632157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:50:59.632157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:50:59.632157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:50:59.632157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:50:59.632157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:50:59.632157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:50:59.632157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:50:59.632157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:50:59.632157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:50:59.632157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:50:59.632157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:50:59.632157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:50:59.632157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:50:59.633111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:50:59.633111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:50:59.633111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:50:59.633111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:50:59.635503 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 307/611] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:50:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 452 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:50:59.645318 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82d8a2-8c08-44cb-9083-fa8b8db42cac None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:59.652364 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185af6d-0f2f-427b-86ac-8b479a390832 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f77fdd017ea4a9b9b49f6e87ba7f267, user_id=b018ac10ad804c6cbbe7fdcc1cec61e8, role_id=e476894ef72943f9b83d98d0704edfea)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:59.654992 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185af6d-0f2f-427b-86ac-8b479a390832 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:59.679259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 305/612] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 08:50:59 2022] PUT /identity/v3/projects/3f77fdd017ea4a9b9b49f6e87ba7f267/users/b018ac10ad804c6cbbe7fdcc1cec61e8/roles/e476894ef72943f9b83d98d0704edfea => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:50:59.832832 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82d8a2-8c08-44cb-9083-fa8b8db42cac None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:50:59.857797 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:50:59.880631 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45cc2d-d50a-4bbb-bc2a-c41982af3fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:50:59.881680 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45cc2d-d50a-4bbb-bc2a-c41982af3fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:50:59.882169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45cc2d-d50a-4bbb-bc2a-c41982af3fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:50:59.882702 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45cc2d-d50a-4bbb-bc2a-c41982af3fc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:50:59.884403 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45cc2d-d50a-4bbb-bc2a-c41982af3fc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:50:59.884936 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45cc2d-d50a-4bbb-bc2a-c41982af3fc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:50:59.886595 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45cc2d-d50a-4bbb-bc2a-c41982af3fc9 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:50:59.906631 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 308/613] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:50:59.911941 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185af6d-0f2f-427b-86ac-8b479a390832 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:50:59.972266 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:00.031421 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6f60d-c035-404a-af3c-e9fb2e7c9656 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:00.031856 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6f60d-c035-404a-af3c-e9fb2e7c9656 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:00.032122 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6f60d-c035-404a-af3c-e9fb2e7c9656 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:00.036097 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 309/614] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:51:00.043153 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185af6d-0f2f-427b-86ac-8b479a390832 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:00.047654 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23027c8c-a8c8-4462-a45d-cb00d509d3d9 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:00.048392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23027c8c-a8c8-4462-a45d-cb00d509d3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:00.049122 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23027c8c-a8c8-4462-a45d-cb00d509d3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:00.095624 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-23027c8c-a8c8-4462-a45d-cb00d509d3d9 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:00.099846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-23027c8c-a8c8-4462-a45d-cb00d509d3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:00.103091 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8b33d-b9cd-45b1-b036-85a4a2152a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:00.104247 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8b33d-b9cd-45b1-b036-85a4a2152a1f None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:00.104419 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8b33d-b9cd-45b1-b036-85a4a2152a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:00.104692 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8b33d-b9cd-45b1-b036-85a4a2152a1f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:00.114742 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8b33d-b9cd-45b1-b036-85a4a2152a1f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:00.116347 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8b33d-b9cd-45b1-b036-85a4a2152a1f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:00.132290 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-48c8b33d-b9cd-45b1-b036-85a4a2152a1f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 08:51:00.132290 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:00.132290 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:00.132290 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:00.132290 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:00.132290 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:00.132290 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:00.132290 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:00.132290 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:00.132290 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:00.132290 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:00.132290 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:00.132290 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:51:00.132290 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:51:00.132290 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:51:00.132290 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:51:00.134062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:00.134062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:00.134062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:51:00.134062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:00.134062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:51:00.134062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:00.134062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:00.134062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:00.134062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:00.134062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:00.134062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:00.134062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:00.134062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:00.134062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:00.134062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:00.134062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:00.134062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:00.134062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:00.135119 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:00.135119 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:00.135119 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:51:00.135119 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:51:00.135119 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:51:00.135119 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:51:00.135119 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:51:00.135119 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:51:00.135119 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 08:51:00.135119 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:00.137828 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 306/615] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:50:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:51:00.143825 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8b33d-b9cd-45b1-b036-85a4a2152a1f None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:00.230789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 310/616] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:51:00.266270 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23027c8c-a8c8-4462-a45d-cb00d509d3d9 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:00.304143 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8b33d-b9cd-45b1-b036-85a4a2152a1f None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:00.317420 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:00.370001 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7d6b2-c8a2-4b5d-b3af-280ef6673300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:00.371157 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7d6b2-c8a2-4b5d-b3af-280ef6673300 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:00.371684 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7d6b2-c8a2-4b5d-b3af-280ef6673300 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:00.372159 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7d6b2-c8a2-4b5d-b3af-280ef6673300 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:00.373193 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7d6b2-c8a2-4b5d-b3af-280ef6673300 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:00.378256 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7d6b2-c8a2-4b5d-b3af-280ef6673300 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:00.380103 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7d6b2-c8a2-4b5d-b3af-280ef6673300 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:00.427180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 307/617] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Jul 27 08:51:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:00.435448 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7d6b2-c8a2-4b5d-b3af-280ef6673300 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:00.550171 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23027c8c-a8c8-4462-a45d-cb00d509d3d9 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:00.563649 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:00.596897 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175a9ac-0e1f-4fd7-83d5-15780ec5428b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:00.597944 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175a9ac-0e1f-4fd7-83d5-15780ec5428b None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:00.598463 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175a9ac-0e1f-4fd7-83d5-15780ec5428b None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:00.599213 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175a9ac-0e1f-4fd7-83d5-15780ec5428b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:00.639957 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175a9ac-0e1f-4fd7-83d5-15780ec5428b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:51:00.641391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7d6b2-c8a2-4b5d-b3af-280ef6673300 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:00.659011 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-1175a9ac-0e1f-4fd7-83d5-15780ec5428b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:51:00.659011 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:00.659011 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:00.659011 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:00.659011 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:00.659011 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:00.659011 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:00.659011 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:00.659011 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:00.659011 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:00.659011 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:00.659011 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:00.659011 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:51:00.659011 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:51:00.659011 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:51:00.659011 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:51:00.660145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:51:00.660145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:51:00.660145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:51:00.660145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:51:00.660145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:00.660145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:00.660145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:00.660145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:00.660145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:00.660145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:00.660145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:00.660145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:00.660145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:00.660145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:00.660145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:00.660145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:00.661035 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:00.661035 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:00.661035 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:00.661035 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:00.661035 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:51:00.661035 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:51:00.661035 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:51:00.661035 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:51:00.661035 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:51:00.661035 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:51:00.661035 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:51:00.661035 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:00.662429 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 311/618] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 08:51:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:00.670073 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175a9ac-0e1f-4fd7-83d5-15780ec5428b None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:00.694605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed956fe-1949-4de2-b3d0-f8a5607a7111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:00.695642 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed956fe-1949-4de2-b3d0-f8a5607a7111 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:00.696960 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed956fe-1949-4de2-b3d0-f8a5607a7111 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:00.697483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed956fe-1949-4de2-b3d0-f8a5607a7111 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:00.710429 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed956fe-1949-4de2-b3d0-f8a5607a7111 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:00.712599 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed956fe-1949-4de2-b3d0-f8a5607a7111 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:00.739070 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-9ed956fe-1949-4de2-b3d0-f8a5607a7111 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:00.739070 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:00.739070 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:00.739070 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:00.739070 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:00.739070 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:00.739070 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:00.739070 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:00.739070 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:00.739070 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:00.739070 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:00.739070 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:00.739070 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:00.739070 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:00.739070 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:00.740078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:00.740078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:00.740078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:00.740078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:00.740078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:00.740078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:00.740078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:00.740078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:00.740078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:00.740078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:00.740078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:00.740078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:00.740078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:00.740078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:00.740078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:00.740078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:00.740078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:00.740981 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:00.740981 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:00.740981 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:00.740981 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:00.743621 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 308/619] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:51:00.755675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed956fe-1949-4de2-b3d0-f8a5607a7111 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:00.790566 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:00.870619 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175a9ac-0e1f-4fd7-83d5-15780ec5428b None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:00.941509 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc313ad7-fe4b-4f65-9292-b8b9d8d5357c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:00.942661 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc313ad7-fe4b-4f65-9292-b8b9d8d5357c None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:00.943216 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc313ad7-fe4b-4f65-9292-b8b9d8d5357c None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:00.943681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc313ad7-fe4b-4f65-9292-b8b9d8d5357c None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:00.945246 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc313ad7-fe4b-4f65-9292-b8b9d8d5357c None admin] RBAC: Adding query filter params (name=service) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:00.945723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc313ad7-fe4b-4f65-9292-b8b9d8d5357c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:00.951420 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc313ad7-fe4b-4f65-9292-b8b9d8d5357c None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:00.986554 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 312/620] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 08:51:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:00.989672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc313ad7-fe4b-4f65-9292-b8b9d8d5357c None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:01.059517 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:01.072201 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed956fe-1949-4de2-b3d0-f8a5607a7111 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:01.203603 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186f9d0-129c-439f-bdf5-d68d83daba11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:01.204561 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186f9d0-129c-439f-bdf5-d68d83daba11 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:01.205059 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186f9d0-129c-439f-bdf5-d68d83daba11 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:01.205517 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186f9d0-129c-439f-bdf5-d68d83daba11 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:01.206885 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186f9d0-129c-439f-bdf5-d68d83daba11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:01.207391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186f9d0-129c-439f-bdf5-d68d83daba11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:01.209942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186f9d0-129c-439f-bdf5-d68d83daba11 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:01.214548 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc313ad7-fe4b-4f65-9292-b8b9d8d5357c None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:01.252832 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 309/621] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 497 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:51:01.263960 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186f9d0-129c-439f-bdf5-d68d83daba11 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:01.274565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0047f8e-8092-4ee8-96eb-3ba8d8d4ec2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:01.276156 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0047f8e-8092-4ee8-96eb-3ba8d8d4ec2b None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:01.276156 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0047f8e-8092-4ee8-96eb-3ba8d8d4ec2b None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:01.276378 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0047f8e-8092-4ee8-96eb-3ba8d8d4ec2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:01.298516 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0047f8e-8092-4ee8-96eb-3ba8d8d4ec2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:01.301269 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0047f8e-8092-4ee8-96eb-3ba8d8d4ec2b None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:01.332164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-a0047f8e-8092-4ee8-96eb-3ba8d8d4ec2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:01.332164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:01.332164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:01.332164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:01.332164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:01.332164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:01.332164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:01.332164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:01.332164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:01.332164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:01.332164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:01.332164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:01.332164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:01.332164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:01.332164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:01.333149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:01.333149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:01.333149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:01.333149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:01.333149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:01.333149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:01.333149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:01.333149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:01.333149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:01.333149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:01.333149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:01.333149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:01.333149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:01.333149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:01.333149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:01.333149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:01.333149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:01.334034 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:01.334034 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:01.334034 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:01.334034 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:01.334838 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 313/622] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:51:01.343306 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0047f8e-8092-4ee8-96eb-3ba8d8d4ec2b None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:01.439470 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:01.523310 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186f9d0-129c-439f-bdf5-d68d83daba11 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:01.597889 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:01.627578 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16926163-6444-4ac1-a142-66e3ca6d53b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:01.630501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16926163-6444-4ac1-a142-66e3ca6d53b7 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:01.631587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16926163-6444-4ac1-a142-66e3ca6d53b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:01.634534 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16926163-6444-4ac1-a142-66e3ca6d53b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:01.650375 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0047f8e-8092-4ee8-96eb-3ba8d8d4ec2b None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:01.650672 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16926163-6444-4ac1-a142-66e3ca6d53b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:01.654007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16926163-6444-4ac1-a142-66e3ca6d53b7 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:01.684778 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-16926163-6444-4ac1-a142-66e3ca6d53b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:01.684778 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:01.684778 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:01.684778 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:01.684778 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:01.684778 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:01.684778 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:01.684778 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:01.684778 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:01.684778 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:01.684778 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:01.684778 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:01.684778 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:51:01.684778 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:51:01.684778 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:51:01.686595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:51:01.686595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:01.686595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:01.686595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:01.686595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:01.686595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:01.686595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:01.686595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:01.686595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:01.686595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:01.686595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:01.686595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:01.686595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:01.686595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:01.686595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:01.686595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:01.686595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:01.688311 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:51:01.688311 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:51:01.688311 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:51:01.688311 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:51:01.688311 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:51:01.688311 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:51:01.688311 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:01.688311 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:01.692979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 310/623] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:51:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:01.702928 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16926163-6444-4ac1-a142-66e3ca6d53b7 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:01.756518 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c28527-0f1b-45fb-bbb8-3ef1d3efb807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:01.757817 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c28527-0f1b-45fb-bbb8-3ef1d3efb807 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:01.758289 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c28527-0f1b-45fb-bbb8-3ef1d3efb807 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:01.759006 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c28527-0f1b-45fb-bbb8-3ef1d3efb807 None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:01.760848 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c28527-0f1b-45fb-bbb8-3ef1d3efb807 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:01.761362 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c28527-0f1b-45fb-bbb8-3ef1d3efb807 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:01.764567 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c28527-0f1b-45fb-bbb8-3ef1d3efb807 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:01.798456 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 314/624] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:51:01.798456 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a394118-e2ae-4edd-8a6a-2d86ecc050df None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:01.798456 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a394118-e2ae-4edd-8a6a-2d86ecc050df None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:01.798456 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a394118-e2ae-4edd-8a6a-2d86ecc050df None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:01.802444 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 315/625] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:01.804338 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a394118-e2ae-4edd-8a6a-2d86ecc050df None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:01.932981 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16926163-6444-4ac1-a142-66e3ca6d53b7 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:02.008407 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f1319-5c95-4f80-aa50-743e4d74b8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:02.010538 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f1319-5c95-4f80-aa50-743e4d74b8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:02.011342 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f1319-5c95-4f80-aa50-743e4d74b8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:02.012099 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f1319-5c95-4f80-aa50-743e4d74b8e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:02.021899 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a394118-e2ae-4edd-8a6a-2d86ecc050df None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:02.022846 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f1319-5c95-4f80-aa50-743e4d74b8e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:02.023775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f1319-5c95-4f80-aa50-743e4d74b8e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:02.027864 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f1319-5c95-4f80-aa50-743e4d74b8e5 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:02.045331 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:02.062796 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 311/626] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:51:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:51:02.065295 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14552d-c190-48ba-a853-fd4ebb2a3fe6 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:02.065935 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14552d-c190-48ba-a853-fd4ebb2a3fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:02.066570 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14552d-c190-48ba-a853-fd4ebb2a3fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:02.067326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a8dec-48dc-42ca-ad08-d81aab2f728c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:02.068144 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a8dec-48dc-42ca-ad08-d81aab2f728c None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:02.068572 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a8dec-48dc-42ca-ad08-d81aab2f728c None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:02.068989 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a8dec-48dc-42ca-ad08-d81aab2f728c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:02.078215 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a8dec-48dc-42ca-ad08-d81aab2f728c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:02.079950 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a8dec-48dc-42ca-ad08-d81aab2f728c None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:02.096691 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-ec5a8dec-48dc-42ca-ad08-d81aab2f728c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 08:51:02.096691 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:02.096691 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:02.096691 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:02.096691 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:02.096691 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:02.096691 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:02.096691 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:02.096691 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:02.096691 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:02.096691 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:02.096691 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:02.096691 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:51:02.096691 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:51:02.096691 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:51:02.096691 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:51:02.097749 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:02.097749 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:02.097749 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:51:02.097749 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:02.097749 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:51:02.097749 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:02.097749 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:02.097749 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:02.097749 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:02.097749 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:02.097749 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:02.097749 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:02.097749 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:02.097749 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:02.097749 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:02.097749 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:02.097749 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:02.097749 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:02.098747 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:02.098747 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:02.098747 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:51:02.098747 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:51:02.098747 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:51:02.098747 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:51:02.098747 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:51:02.098747 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:51:02.098747 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 08:51:02.098747 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:02.101751 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 316/627] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:51:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:02.103037 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a8dec-48dc-42ca-ad08-d81aab2f728c None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:02.105581 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-4e14552d-c190-48ba-a853-fd4ebb2a3fe6 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:02.106847 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:02.107774 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4e14552d-c190-48ba-a853-fd4ebb2a3fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:02.234678 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 312/628] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:51:02.235887 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14552d-c190-48ba-a853-fd4ebb2a3fe6 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:02.246450 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a8dec-48dc-42ca-ad08-d81aab2f728c None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:02.287641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c9003-c606-4b19-9fad-33d1bfa9e24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:02.288319 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c9003-c606-4b19-9fad-33d1bfa9e24f None admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:02.288599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c9003-c606-4b19-9fad-33d1bfa9e24f None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:02.288970 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c9003-c606-4b19-9fad-33d1bfa9e24f None admin] PATH_INFO: `/v3/projects/3f77fdd017ea4a9b9b49f6e87ba7f267/users/158ea5c9dd5142eebd903d5f732997ad/roles/e476894ef72943f9b83d98d0704edfea` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:02.306757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c9003-c606-4b19-9fad-33d1bfa9e24f None admin] RBAC: Authorizing `identity:create_grant(project_id=3f77fdd017ea4a9b9b49f6e87ba7f267, user_id=158ea5c9dd5142eebd903d5f732997ad, role_id=e476894ef72943f9b83d98d0704edfea)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:02.308247 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c9003-c606-4b19-9fad-33d1bfa9e24f None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:02.330727 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 317/629] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 08:51:02 2022] PUT /identity/v3/projects/3f77fdd017ea4a9b9b49f6e87ba7f267/users/158ea5c9dd5142eebd903d5f732997ad/roles/e476894ef72943f9b83d98d0704edfea => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:51:02.330727 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d3c9d-0f11-43d9-bfd3-ab55bb90852b None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:02.330727 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d3c9d-0f11-43d9-bfd3-ab55bb90852b None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:02.330727 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d3c9d-0f11-43d9-bfd3-ab55bb90852b None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:02.331111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 318/630] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:02.331836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d3c9d-0f11-43d9-bfd3-ab55bb90852b None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:02.410002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14552d-c190-48ba-a853-fd4ebb2a3fe6 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:02.416752 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:02.457896 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:02.475841 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d6c24-9643-4a74-9aad-c22ef5abc3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:02.477021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d6c24-9643-4a74-9aad-c22ef5abc3b7 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:02.477726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d6c24-9643-4a74-9aad-c22ef5abc3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:02.478536 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d6c24-9643-4a74-9aad-c22ef5abc3b7 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:02.481870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d6c24-9643-4a74-9aad-c22ef5abc3b7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:02.482855 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d6c24-9643-4a74-9aad-c22ef5abc3b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:02.487403 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d6c24-9643-4a74-9aad-c22ef5abc3b7 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:02.497636 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d3c9d-0f11-43d9-bfd3-ab55bb90852b None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:02.529039 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 313/631] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Jul 27 08:51:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:02.534884 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441e5f8-ea23-485d-bc65-202b430f9f9c None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:02.535159 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441e5f8-ea23-485d-bc65-202b430f9f9c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:02.535517 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441e5f8-ea23-485d-bc65-202b430f9f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:02.554117 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888483a-8a55-4fff-8ff6-2f07a1cdc9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:02.554809 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888483a-8a55-4fff-8ff6-2f07a1cdc9bb None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:02.555086 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888483a-8a55-4fff-8ff6-2f07a1cdc9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:02.556280 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888483a-8a55-4fff-8ff6-2f07a1cdc9bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:02.559223 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-b441e5f8-ea23-485d-bc65-202b430f9f9c None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:02.560543 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b441e5f8-ea23-485d-bc65-202b430f9f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:02.573778 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888483a-8a55-4fff-8ff6-2f07a1cdc9bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:51:02.581956 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-a888483a-8a55-4fff-8ff6-2f07a1cdc9bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:51:02.581956 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:02.581956 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:02.581956 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:02.581956 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:02.581956 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:02.581956 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:02.581956 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:02.581956 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:02.581956 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:02.581956 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:02.581956 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:02.581956 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:51:02.581956 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:51:02.581956 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:51:02.581956 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:51:02.583163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:51:02.583163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:51:02.583163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:51:02.583163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:51:02.583163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:02.583163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:02.583163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:02.583163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:02.583163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:02.583163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:02.583163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:02.583163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:02.583163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:02.583163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:02.583163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:02.583163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:02.584238 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:02.584238 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:02.584238 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:02.584238 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:02.584238 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:51:02.584238 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:51:02.584238 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:51:02.584238 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:51:02.584238 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:51:02.584238 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:51:02.584238 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:51:02.584238 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:02.586744 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 319/632] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 08:51:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:02.588580 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888483a-8a55-4fff-8ff6-2f07a1cdc9bb None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:02.682491 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 314/633] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:51:02.684025 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441e5f8-ea23-485d-bc65-202b430f9f9c None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:02.751235 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888483a-8a55-4fff-8ff6-2f07a1cdc9bb None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:02.793984 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbea778-99e0-4e89-b7d6-6c57f101e739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:02.794846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbea778-99e0-4e89-b7d6-6c57f101e739 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:02.795177 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbea778-99e0-4e89-b7d6-6c57f101e739 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:02.795509 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbea778-99e0-4e89-b7d6-6c57f101e739 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:02.814767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:02.896314 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbea778-99e0-4e89-b7d6-6c57f101e739 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:02.898378 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbea778-99e0-4e89-b7d6-6c57f101e739 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:02.918729 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441e5f8-ea23-485d-bc65-202b430f9f9c None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:02.950976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:02.990255 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f73dd8-49b8-4d8d-ba69-b6954dcca2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:02.991563 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f73dd8-49b8-4d8d-ba69-b6954dcca2ca None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:02.992146 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f73dd8-49b8-4d8d-ba69-b6954dcca2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:02.992701 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f73dd8-49b8-4d8d-ba69-b6954dcca2ca None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:02.994805 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f73dd8-49b8-4d8d-ba69-b6954dcca2ca None admin] RBAC: Adding query filter params (name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:02.995441 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f73dd8-49b8-4d8d-ba69-b6954dcca2ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:02.999028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f73dd8-49b8-4d8d-ba69-b6954dcca2ca None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:03.027155 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 315/634] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 08:51:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:03.028853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f73dd8-49b8-4d8d-ba69-b6954dcca2ca None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:03.049449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 320/635] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:51:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:51:03.051356 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbea778-99e0-4e89-b7d6-6c57f101e739 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:03.070756 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:03.152769 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f73dd8-49b8-4d8d-ba69-b6954dcca2ca None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:03.194447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94fb4c-bf38-489b-a50c-43178020e8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:03.195120 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94fb4c-bf38-489b-a50c-43178020e8ee None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:03.195395 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94fb4c-bf38-489b-a50c-43178020e8ee None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:03.195938 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94fb4c-bf38-489b-a50c-43178020e8ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:03.204132 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbea778-99e0-4e89-b7d6-6c57f101e739 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:03.208814 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94fb4c-bf38-489b-a50c-43178020e8ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:51:03.215539 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-9c94fb4c-bf38-489b-a50c-43178020e8ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:51:03.215539 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:03.215539 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:03.215539 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:03.215539 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:03.215539 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:03.215539 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:03.215539 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:03.215539 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:03.215539 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:03.215539 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:03.215539 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:03.215539 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:51:03.215539 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:51:03.215539 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:51:03.215539 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:51:03.216549 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:51:03.216549 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:51:03.216549 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:51:03.216549 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:51:03.216549 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:03.216549 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:03.216549 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:03.216549 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:03.216549 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:03.216549 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:03.216549 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:03.216549 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:03.216549 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:03.216549 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:03.216549 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:03.216549 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:03.217419 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:03.217419 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:03.217419 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:03.217419 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:03.217419 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:51:03.217419 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:51:03.217419 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:51:03.217419 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:51:03.217419 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:51:03.217419 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:51:03.217419 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:51:03.217419 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:03.217419 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 316/636] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 08:51:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:03.218794 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94fb4c-bf38-489b-a50c-43178020e8ee None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:03.254367 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e7238-f1e6-469f-9f18-cce675d4785c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:03.255218 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e7238-f1e6-469f-9f18-cce675d4785c None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:03.255635 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e7238-f1e6-469f-9f18-cce675d4785c None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:03.256132 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e7238-f1e6-469f-9f18-cce675d4785c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:03.269494 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:03.275831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e7238-f1e6-469f-9f18-cce675d4785c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:03.278666 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e7238-f1e6-469f-9f18-cce675d4785c None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:03.307951 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-871e7238-f1e6-469f-9f18-cce675d4785c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:03.307951 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:03.307951 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:03.307951 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:03.307951 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:03.307951 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:03.307951 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:03.307951 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:03.307951 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:03.307951 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:03.307951 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:03.307951 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:03.307951 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:03.307951 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:03.307951 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:03.309102 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:03.309102 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:03.309102 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:03.309102 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:03.309102 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:03.309102 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:03.309102 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:03.309102 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:03.309102 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:03.309102 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:03.309102 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:03.309102 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:03.309102 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:03.309102 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:03.309102 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:03.309102 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:03.309102 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:03.310154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:03.310154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:03.310154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:03.310154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:03.310154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 321/637] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:03.312444 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a388512-8386-4fc2-9aa9-cb90ef84bb9f None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:03.312826 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a388512-8386-4fc2-9aa9-cb90ef84bb9f None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:03.313318 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a388512-8386-4fc2-9aa9-cb90ef84bb9f None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:03.316061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 322/638] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:03.317575 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a388512-8386-4fc2-9aa9-cb90ef84bb9f None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:03.356498 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94fb4c-bf38-489b-a50c-43178020e8ee None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:03.400902 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:03.402242 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3875036-30b6-4a49-a252-eb7ada39cf2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:03.403048 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3875036-30b6-4a49-a252-eb7ada39cf2d None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:03.403234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3875036-30b6-4a49-a252-eb7ada39cf2d None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:03.403740 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3875036-30b6-4a49-a252-eb7ada39cf2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:03.418197 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3875036-30b6-4a49-a252-eb7ada39cf2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:03.419714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3875036-30b6-4a49-a252-eb7ada39cf2d None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:03.435278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-d3875036-30b6-4a49-a252-eb7ada39cf2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:03.435278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:03.435278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:03.435278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:03.435278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:03.435278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:03.435278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:03.435278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:03.435278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:03.435278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:03.435278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:03.435278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:03.435278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:03.435278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:03.435278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:03.437124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:03.437124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:03.437124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:03.437124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:03.437124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:03.437124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:03.437124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:03.437124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:03.437124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:03.437124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:03.437124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:03.437124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:03.437124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:03.437124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:03.437124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:03.437124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:03.437124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:03.439446 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:03.439446 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:03.439446 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:03.439446 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:03.439446 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 317/639] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:03.439446 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3875036-30b6-4a49-a252-eb7ada39cf2d None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:03.457748 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a388512-8386-4fc2-9aa9-cb90ef84bb9f None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:03.496030 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611a5e8-27bb-4176-aafe-72c4a4322acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:03.496664 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611a5e8-27bb-4176-aafe-72c4a4322acb None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:03.496942 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611a5e8-27bb-4176-aafe-72c4a4322acb None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:03.497218 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611a5e8-27bb-4176-aafe-72c4a4322acb None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:03.497943 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611a5e8-27bb-4176-aafe-72c4a4322acb None admin] RBAC: Adding query filter params (name=service) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:03.498253 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611a5e8-27bb-4176-aafe-72c4a4322acb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:03.499657 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611a5e8-27bb-4176-aafe-72c4a4322acb None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:03.509424 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 323/640] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 08:51:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:03.515451 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044e64d-ffe3-49a7-9244-31fcb28b07c3 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:03.515738 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044e64d-ffe3-49a7-9244-31fcb28b07c3 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:03.516029 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044e64d-ffe3-49a7-9244-31fcb28b07c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:03.535319 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-1044e64d-ffe3-49a7-9244-31fcb28b07c3 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:03.536535 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-1044e64d-ffe3-49a7-9244-31fcb28b07c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:03.554029 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:03.567544 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3875036-30b6-4a49-a252-eb7ada39cf2d None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:03.613057 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f47fef-9592-4992-8515-7511e6e0a18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:03.613690 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f47fef-9592-4992-8515-7511e6e0a18f None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:03.613976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f47fef-9592-4992-8515-7511e6e0a18f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:03.614257 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f47fef-9592-4992-8515-7511e6e0a18f None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:03.615019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f47fef-9592-4992-8515-7511e6e0a18f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:03.615332 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f47fef-9592-4992-8515-7511e6e0a18f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:03.616716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f47fef-9592-4992-8515-7511e6e0a18f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:03.630545 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 318/641] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:03.631408 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f47fef-9592-4992-8515-7511e6e0a18f None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:03.637677 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 324/642] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:51:03.638595 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044e64d-ffe3-49a7-9244-31fcb28b07c3 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:03.720168 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:03.766183 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f47fef-9592-4992-8515-7511e6e0a18f None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:03.771306 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044e64d-ffe3-49a7-9244-31fcb28b07c3 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:03.809433 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826de6f-1c49-4464-bef9-84c609910cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:03.810604 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826de6f-1c49-4464-bef9-84c609910cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:03.810892 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826de6f-1c49-4464-bef9-84c609910cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:03.811172 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826de6f-1c49-4464-bef9-84c609910cc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:03.811892 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d826de6f-1c49-4464-bef9-84c609910cc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:03.812368 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d826de6f-1c49-4464-bef9-84c609910cc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:03.813762 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d826de6f-1c49-4464-bef9-84c609910cc1 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:03.827579 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 319/643] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:03.828176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826de6f-1c49-4464-bef9-84c609910cc1 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:03.836151 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451c691-e47c-423b-b1ab-d9b9c4eb10c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:03.837942 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451c691-e47c-423b-b1ab-d9b9c4eb10c8 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:03.838560 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451c691-e47c-423b-b1ab-d9b9c4eb10c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:03.839069 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451c691-e47c-423b-b1ab-d9b9c4eb10c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:03.847294 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:03.856630 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451c691-e47c-423b-b1ab-d9b9c4eb10c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:03.859224 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451c691-e47c-423b-b1ab-d9b9c4eb10c8 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:03.884389 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-6451c691-e47c-423b-b1ab-d9b9c4eb10c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:03.884389 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:03.884389 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:03.884389 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:03.884389 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:03.884389 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:03.884389 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:03.884389 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:03.884389 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:03.884389 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:03.884389 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:03.884389 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:03.884389 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:03.884389 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:03.884389 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:03.885559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:03.885559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:03.885559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:03.885559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:03.885559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:03.885559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:03.885559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:03.885559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:03.885559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:03.885559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:03.885559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:03.885559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:03.885559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:03.885559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:03.885559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:03.885559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:03.885559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:03.886654 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:03.886654 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:03.886654 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:03.886654 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:03.891690 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 325/644] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:03.892690 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451c691-e47c-423b-b1ab-d9b9c4eb10c8 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:03.990952 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826de6f-1c49-4464-bef9-84c609910cc1 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:04.043319 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889c68c-89f1-4e32-8a75-d7d11343d8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:04.044368 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889c68c-89f1-4e32-8a75-d7d11343d8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:04.044841 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889c68c-89f1-4e32-8a75-d7d11343d8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:04.045289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889c68c-89f1-4e32-8a75-d7d11343d8d4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:04.054972 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451c691-e47c-423b-b1ab-d9b9c4eb10c8 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:04.061360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c889c68c-89f1-4e32-8a75-d7d11343d8d4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:04.064187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c889c68c-89f1-4e32-8a75-d7d11343d8d4 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:04.070552 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:04.087790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-c889c68c-89f1-4e32-8a75-d7d11343d8d4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 08:51:04.087790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:04.087790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:04.087790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:04.087790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:04.087790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:04.087790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:04.087790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:04.087790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:04.087790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:04.087790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:04.087790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:04.087790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:51:04.087790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:51:04.087790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:51:04.087790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:51:04.089036 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:04.089036 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:04.089036 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:51:04.089036 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:04.089036 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:51:04.089036 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:04.089036 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:04.089036 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:04.089036 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:04.089036 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:04.089036 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:04.089036 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:04.089036 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:04.089036 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:04.089036 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:04.089036 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:04.089036 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:04.089036 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:04.090124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:04.090124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:04.090124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:51:04.090124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:51:04.090124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:51:04.090124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:51:04.090124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:51:04.090124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:51:04.090124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 08:51:04.090124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:04.097470 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 320/645] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:51:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:04.098809 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889c68c-89f1-4e32-8a75-d7d11343d8d4 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:04.123826 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81de1f-2d05-4aad-a8f2-b371338e86f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:04.124491 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81de1f-2d05-4aad-a8f2-b371338e86f1 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:04.124947 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81de1f-2d05-4aad-a8f2-b371338e86f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:04.125108 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81de1f-2d05-4aad-a8f2-b371338e86f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:04.138214 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81de1f-2d05-4aad-a8f2-b371338e86f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:51:04.144390 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-7c81de1f-2d05-4aad-a8f2-b371338e86f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:51:04.144390 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:04.144390 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:04.144390 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:04.144390 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:04.144390 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:04.144390 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:04.144390 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:04.144390 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:04.144390 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:04.144390 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:04.144390 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:04.144390 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:51:04.144390 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:51:04.144390 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:51:04.144390 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:51:04.145416 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:51:04.145416 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:51:04.145416 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:51:04.145416 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:51:04.145416 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:04.145416 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:04.145416 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:04.145416 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:04.145416 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:04.145416 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:04.145416 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:04.145416 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:04.145416 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:04.145416 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:04.145416 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:04.145416 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:04.147767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:04.147767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:04.147767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:04.147767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:04.147767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:51:04.147767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:51:04.147767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:51:04.147767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:51:04.147767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:51:04.147767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:51:04.147767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:51:04.147767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:04.147767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 326/646] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 08:51:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:04.147767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81de1f-2d05-4aad-a8f2-b371338e86f1 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:04.202214 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:04.240595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889c68c-89f1-4e32-8a75-d7d11343d8d4 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:04.297469 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496de43f-fd6c-4d48-8094-26797abeb1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:04.298117 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496de43f-fd6c-4d48-8094-26797abeb1c6 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:04.298424 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496de43f-fd6c-4d48-8094-26797abeb1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:04.298714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496de43f-fd6c-4d48-8094-26797abeb1c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:04.306947 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496de43f-fd6c-4d48-8094-26797abeb1c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:04.308403 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81de1f-2d05-4aad-a8f2-b371338e86f1 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:04.308597 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496de43f-fd6c-4d48-8094-26797abeb1c6 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:04.322945 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-496de43f-fd6c-4d48-8094-26797abeb1c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:04.322945 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:04.322945 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:04.322945 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:04.322945 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:04.322945 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:04.322945 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:04.322945 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:04.322945 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:04.322945 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:04.322945 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:04.322945 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:04.322945 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:51:04.322945 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:51:04.322945 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:51:04.332390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:51:04.332390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:04.332390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:04.332390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:04.332390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:04.332390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:04.332390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:04.332390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:04.332390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:04.332390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:04.332390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:04.332390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:04.332390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:04.332390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:04.332390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:04.332390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:04.332390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:04.334513 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:51:04.334513 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:51:04.334513 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:51:04.334513 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:51:04.334513 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:51:04.334513 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:51:04.334513 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:04.334513 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:04.334513 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 321/647] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:51:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:04.334513 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496de43f-fd6c-4d48-8094-26797abeb1c6 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:04.376347 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fb850-63b0-45c6-aab7-626af711eaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:04.377287 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fb850-63b0-45c6-aab7-626af711eaaf None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:04.379269 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fb850-63b0-45c6-aab7-626af711eaaf None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:04.379269 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fb850-63b0-45c6-aab7-626af711eaaf None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:04.379269 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fb850-63b0-45c6-aab7-626af711eaaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:04.379645 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fb850-63b0-45c6-aab7-626af711eaaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:04.381259 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fb850-63b0-45c6-aab7-626af711eaaf None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:04.399836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 327/648] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:04.405975 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fb850-63b0-45c6-aab7-626af711eaaf None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:04.458167 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:04.478388 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496de43f-fd6c-4d48-8094-26797abeb1c6 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:04.516630 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:04.523167 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea3851-ba94-4bd1-8e93-0079d638be1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:04.523796 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea3851-ba94-4bd1-8e93-0079d638be1e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:04.524073 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea3851-ba94-4bd1-8e93-0079d638be1e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:04.524881 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea3851-ba94-4bd1-8e93-0079d638be1e None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:04.526428 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea3851-ba94-4bd1-8e93-0079d638be1e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:04.526735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea3851-ba94-4bd1-8e93-0079d638be1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:04.528181 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea3851-ba94-4bd1-8e93-0079d638be1e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:04.548068 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 322/649] 10.222.0.65 () {56 vars in 1137 bytes} [Wed Jul 27 08:51:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:04.548985 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea3851-ba94-4bd1-8e93-0079d638be1e None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:04.551002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fb850-63b0-45c6-aab7-626af711eaaf None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:04.590821 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326a847-6152-4169-b1d5-76e823c89c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:04.591467 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326a847-6152-4169-b1d5-76e823c89c9e None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:04.591741 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326a847-6152-4169-b1d5-76e823c89c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:04.592021 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326a847-6152-4169-b1d5-76e823c89c9e None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:04.592756 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326a847-6152-4169-b1d5-76e823c89c9e None admin] RBAC: Adding query filter params (name=service) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:04.593062 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326a847-6152-4169-b1d5-76e823c89c9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:04.594465 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326a847-6152-4169-b1d5-76e823c89c9e None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:04.603214 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 328/650] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 08:51:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:04.604073 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326a847-6152-4169-b1d5-76e823c89c9e None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:04.669748 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea3851-ba94-4bd1-8e93-0079d638be1e None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:04.707325 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a50f6-4161-4e81-92f5-352680ba5286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:04.707954 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a50f6-4161-4e81-92f5-352680ba5286 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:04.708237 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a50f6-4161-4e81-92f5-352680ba5286 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:04.708512 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a50f6-4161-4e81-92f5-352680ba5286 None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:04.709275 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a50f6-4161-4e81-92f5-352680ba5286 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:04.709578 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a50f6-4161-4e81-92f5-352680ba5286 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:04.711142 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a50f6-4161-4e81-92f5-352680ba5286 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:04.723960 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 323/651] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:51:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:04.725236 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad75495-c777-45e8-bcdd-7b1aa16699ee None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:04.725526 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad75495-c777-45e8-bcdd-7b1aa16699ee None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:04.725804 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad75495-c777-45e8-bcdd-7b1aa16699ee None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:04.727094 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 324/652] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:04.727865 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad75495-c777-45e8-bcdd-7b1aa16699ee None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:04.741537 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:04.754744 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326a847-6152-4169-b1d5-76e823c89c9e None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:04.790913 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:04.796708 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95e344-9e38-4a5c-ba69-b7b4a2c86e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:04.797488 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95e344-9e38-4a5c-ba69-b7b4a2c86e2b None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:04.797673 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95e344-9e38-4a5c-ba69-b7b4a2c86e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:04.797892 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95e344-9e38-4a5c-ba69-b7b4a2c86e2b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:04.806900 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be95e344-9e38-4a5c-ba69-b7b4a2c86e2b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:04.808807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be95e344-9e38-4a5c-ba69-b7b4a2c86e2b None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:04.829490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-be95e344-9e38-4a5c-ba69-b7b4a2c86e2b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:51:04.829490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:04.829490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:04.829490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:04.829490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:04.829490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:04.829490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:04.829490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:04.829490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:04.829490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:04.829490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:04.829490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:04.829490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:51:04.829490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:51:04.829490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:51:04.829490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:51:04.831134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:04.831134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:04.831134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:51:04.831134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:04.831134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:51:04.831134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:04.831134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:04.831134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:04.831134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:04.831134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:04.831134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:04.831134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:04.831134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:04.831134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:04.831134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:04.831134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:04.831134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:04.831134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:04.832799 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:04.832799 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:04.832799 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:51:04.832799 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:51:04.832799 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:51:04.832799 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:51:04.832799 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:51:04.832799 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:51:04.832799 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:51:04.832799 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:04.832799 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 329/653] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Jul 27 08:51:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:04.832799 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95e344-9e38-4a5c-ba69-b7b4a2c86e2b None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:04.865730 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad75495-c777-45e8-bcdd-7b1aa16699ee None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:04.910783 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832e974-dd97-4039-be7e-0d40204f8e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:04.911408 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832e974-dd97-4039-be7e-0d40204f8e1c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:04.911690 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832e974-dd97-4039-be7e-0d40204f8e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:04.911969 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832e974-dd97-4039-be7e-0d40204f8e1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:04.949223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95e344-9e38-4a5c-ba69-b7b4a2c86e2b None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:04.984949 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761d63a-b4da-4dc7-aa95-f9c30d3a5472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:04.985597 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761d63a-b4da-4dc7-aa95-f9c30d3a5472 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:04.985882 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761d63a-b4da-4dc7-aa95-f9c30d3a5472 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:04.986152 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761d63a-b4da-4dc7-aa95-f9c30d3a5472 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:04.998692 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761d63a-b4da-4dc7-aa95-f9c30d3a5472 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:05.000155 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761d63a-b4da-4dc7-aa95-f9c30d3a5472 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:05.012012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832e974-dd97-4039-be7e-0d40204f8e1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:05.014625 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832e974-dd97-4039-be7e-0d40204f8e1c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:05.019723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-0761d63a-b4da-4dc7-aa95-f9c30d3a5472 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:05.019723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:05.019723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:05.019723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:05.019723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:05.019723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:05.019723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:05.019723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:05.019723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:05.019723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:05.019723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:05.019723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:05.019723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:05.019723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:05.019723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:05.021538 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:05.021538 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:05.021538 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:05.021538 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:05.021538 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:05.021538 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:05.021538 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:05.021538 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:05.021538 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:05.021538 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:05.021538 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:05.021538 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:05.021538 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:05.021538 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:05.021538 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:05.021538 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:05.021538 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:05.024001 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:05.024001 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:05.024001 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:05.024001 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:05.024001 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 330/654] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:05.024001 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd9e45-4967-4ad1-8d2b-4d769015f81e None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:05.024698 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd9e45-4967-4ad1-8d2b-4d769015f81e None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:05.024856 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd9e45-4967-4ad1-8d2b-4d769015f81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:05.032774 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:05.046014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-a0dd9e45-4967-4ad1-8d2b-4d769015f81e None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:05.047320 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-a0dd9e45-4967-4ad1-8d2b-4d769015f81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:05.082063 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:05.146198 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 325/655] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:51:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:51:05.147114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832e974-dd97-4039-be7e-0d40204f8e1c None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:05.163178 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 331/656] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:51:05.164876 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd9e45-4967-4ad1-8d2b-4d769015f81e None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:05.301646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832e974-dd97-4039-be7e-0d40204f8e1c None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:05.302455 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd9e45-4967-4ad1-8d2b-4d769015f81e None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:05.343595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab38d8d-f729-40ea-a0c4-d3d9a3afabdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:05.344152 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab38d8d-f729-40ea-a0c4-d3d9a3afabdb None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:05.344351 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:05.344510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab38d8d-f729-40ea-a0c4-d3d9a3afabdb None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:05.344688 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab38d8d-f729-40ea-a0c4-d3d9a3afabdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:05.345508 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab38d8d-f729-40ea-a0c4-d3d9a3afabdb None admin] RBAC: Adding query filter params (role.id=e476894ef72943f9b83d98d0704edfea, scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267, user.id=713805e0f1174a01987014319075ec03) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:05.345807 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab38d8d-f729-40ea-a0c4-d3d9a3afabdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:05.347375 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab38d8d-f729-40ea-a0c4-d3d9a3afabdb None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:05.351353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2721b6-80c5-411b-bfde-768dccc7a016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:05.352112 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2721b6-80c5-411b-bfde-768dccc7a016 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:05.352570 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2721b6-80c5-411b-bfde-768dccc7a016 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:05.352933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2721b6-80c5-411b-bfde-768dccc7a016 None admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:05.354022 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2721b6-80c5-411b-bfde-768dccc7a016 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:05.354198 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 326/657] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:51:05 2022] GET /identity/v3/role_assignments?user.id=713805e0f1174a01987014319075ec03&scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267&role.id=e476894ef72943f9b83d98d0704edfea => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:05.370596 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2721b6-80c5-411b-bfde-768dccc7a016 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:05.370812 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab38d8d-f729-40ea-a0c4-d3d9a3afabdb None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:05.370992 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2721b6-80c5-411b-bfde-768dccc7a016 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:05.376761 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:05.397463 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 332/658] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Jul 27 08:51:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:05.397463 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2721b6-80c5-411b-bfde-768dccc7a016 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:05.532147 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab38d8d-f729-40ea-a0c4-d3d9a3afabdb None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:05.548073 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2721b6-80c5-411b-bfde-768dccc7a016 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:05.589347 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56be1e-829e-4859-95ac-2c54d129635b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:05.590615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56be1e-829e-4859-95ac-2c54d129635b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:05.590919 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56be1e-829e-4859-95ac-2c54d129635b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:05.591319 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56be1e-829e-4859-95ac-2c54d129635b None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:05.592490 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56be1e-829e-4859-95ac-2c54d129635b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:05.593022 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56be1e-829e-4859-95ac-2c54d129635b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:05.595163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56be1e-829e-4859-95ac-2c54d129635b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:05.613952 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 327/659] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:05.615202 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56be1e-829e-4859-95ac-2c54d129635b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:05.618911 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d4de0-d4df-42c8-9d76-d3754b7034f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:05.620001 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d4de0-d4df-42c8-9d76-d3754b7034f7 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:05.620502 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d4de0-d4df-42c8-9d76-d3754b7034f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:05.621059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d4de0-d4df-42c8-9d76-d3754b7034f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:05.641895 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d4de0-d4df-42c8-9d76-d3754b7034f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:05.644793 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d4de0-d4df-42c8-9d76-d3754b7034f7 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:05.665805 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-571d4de0-d4df-42c8-9d76-d3754b7034f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:05.665805 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:05.665805 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:05.665805 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:05.665805 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:05.665805 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:05.665805 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:05.665805 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:05.665805 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:05.665805 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:05.665805 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:05.665805 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:05.665805 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:05.665805 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:05.665805 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:05.667460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:05.667460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:05.667460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:05.667460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:05.667460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:05.667460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:05.667460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:05.667460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:05.667460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:05.667460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:05.667460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:05.667460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:05.667460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:05.667460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:05.667460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:05.667460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:05.667460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:05.669247 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:05.669247 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:05.669247 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:05.669247 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:05.669247 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 333/660] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:05.669247 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d4de0-d4df-42c8-9d76-d3754b7034f7 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:05.729843 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:05.743326 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:05.802160 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56be1e-829e-4859-95ac-2c54d129635b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:05.823439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d4de0-d4df-42c8-9d76-d3754b7034f7 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:05.857157 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae391a-b9d6-4177-9451-7a2cf9597733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:05.858269 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae391a-b9d6-4177-9451-7a2cf9597733 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:05.858872 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae391a-b9d6-4177-9451-7a2cf9597733 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:05.859463 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae391a-b9d6-4177-9451-7a2cf9597733 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:05.877967 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae391a-b9d6-4177-9451-7a2cf9597733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:51:05.887158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec15640-a0ef-4dfb-834b-d53580a8009d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:05.887510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-21ae391a-b9d6-4177-9451-7a2cf9597733 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:51:05.887510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:05.887510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:05.887510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:05.887510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:05.887510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:05.887510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:05.887510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:05.887510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:05.887510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:05.887510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:05.887510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:05.887510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:51:05.887510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:51:05.887510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:51:05.887510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:51:05.889581 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:51:05.889581 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:51:05.889581 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:51:05.889581 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:51:05.889581 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:05.889581 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:05.889581 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:05.889581 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:05.889581 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:05.889581 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:05.889581 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:05.889581 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:05.889581 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:05.889581 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:05.889581 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:05.889581 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:05.891567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:05.891567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:05.891567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:05.891567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:05.891567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:51:05.891567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:51:05.891567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:51:05.891567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:51:05.891567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:51:05.891567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:51:05.891567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:51:05.891567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:05.892974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec15640-a0ef-4dfb-834b-d53580a8009d None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:05.892974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec15640-a0ef-4dfb-834b-d53580a8009d None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:05.892974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec15640-a0ef-4dfb-834b-d53580a8009d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:05.893344 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 328/661] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 08:51:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:05.895133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae391a-b9d6-4177-9451-7a2cf9597733 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:06.018286 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec15640-a0ef-4dfb-834b-d53580a8009d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:06.019852 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec15640-a0ef-4dfb-834b-d53580a8009d None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:06.040771 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae391a-b9d6-4177-9451-7a2cf9597733 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:06.078698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:06.086075 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e7582-bb2b-405e-8fc4-1be2dec033ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:06.087307 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e7582-bb2b-405e-8fc4-1be2dec033ab None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:06.087602 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e7582-bb2b-405e-8fc4-1be2dec033ab None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:06.088015 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e7582-bb2b-405e-8fc4-1be2dec033ab None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:06.097428 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:06.097956 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e7582-bb2b-405e-8fc4-1be2dec033ab None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:06.099785 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e7582-bb2b-405e-8fc4-1be2dec033ab None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:06.115289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-005e7582-bb2b-405e-8fc4-1be2dec033ab None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 08:51:06.115289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:06.115289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:06.115289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:06.115289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:06.115289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:06.115289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:06.115289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:06.115289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:06.115289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:06.115289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:06.115289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:06.115289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:51:06.115289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:51:06.115289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:51:06.115289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:51:06.116932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:06.116932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:06.116932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:51:06.116932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:06.116932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:51:06.116932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:06.116932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:06.116932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:06.116932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:06.116932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:06.116932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:06.116932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:06.116932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:06.116932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:06.116932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:06.116932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:06.116932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:06.116932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:06.120274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:06.120274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:06.120274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:51:06.120274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:51:06.120274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:51:06.120274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:51:06.120274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:51:06.120274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:51:06.120274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 08:51:06.120274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:06.122222 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 329/662] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 08:51:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:06.123519 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e7582-bb2b-405e-8fc4-1be2dec033ab None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:06.187439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 334/663] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:51:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:51:06.187439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec15640-a0ef-4dfb-834b-d53580a8009d None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:06.303231 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e7582-bb2b-405e-8fc4-1be2dec033ab None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:06.312225 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec15640-a0ef-4dfb-834b-d53580a8009d None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:06.362341 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d7aad-98ce-43e4-8ef4-41d80c71e46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:06.363090 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d7aad-98ce-43e4-8ef4-41d80c71e46c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:06.363446 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d7aad-98ce-43e4-8ef4-41d80c71e46c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:06.363725 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d7aad-98ce-43e4-8ef4-41d80c71e46c None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:06.364703 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d7aad-98ce-43e4-8ef4-41d80c71e46c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:06.365193 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d7aad-98ce-43e4-8ef4-41d80c71e46c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:06.366821 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9099a-fb77-454d-8bf6-0cb5427033da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:06.366944 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d7aad-98ce-43e4-8ef4-41d80c71e46c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:06.367794 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9099a-fb77-454d-8bf6-0cb5427033da None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:06.368322 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9099a-fb77-454d-8bf6-0cb5427033da None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:06.368809 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9099a-fb77-454d-8bf6-0cb5427033da None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:06.370343 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9099a-fb77-454d-8bf6-0cb5427033da None admin] RBAC: Adding query filter params (name=service) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:06.370858 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9099a-fb77-454d-8bf6-0cb5427033da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:06.373393 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9099a-fb77-454d-8bf6-0cb5427033da None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:06.386446 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 330/664] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:06.387676 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d7aad-98ce-43e4-8ef4-41d80c71e46c None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:06.392750 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 335/665] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 08:51:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:06.392750 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9099a-fb77-454d-8bf6-0cb5427033da None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:06.399184 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:06.476925 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:06.560860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d7aad-98ce-43e4-8ef4-41d80c71e46c None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:06.562481 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9099a-fb77-454d-8bf6-0cb5427033da None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:06.618057 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb13352-666a-47f8-bb22-255b3b055bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:06.619103 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb13352-666a-47f8-bb22-255b3b055bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:06.619581 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb13352-666a-47f8-bb22-255b3b055bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:06.620049 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb13352-666a-47f8-bb22-255b3b055bd3 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:06.621488 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb13352-666a-47f8-bb22-255b3b055bd3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:06.622013 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb13352-666a-47f8-bb22-255b3b055bd3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:06.624665 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb13352-666a-47f8-bb22-255b3b055bd3 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:06.625671 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832d1af-a475-4a5e-8326-66e205928274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:06.626801 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832d1af-a475-4a5e-8326-66e205928274 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:06.627298 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832d1af-a475-4a5e-8326-66e205928274 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:06.628053 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832d1af-a475-4a5e-8326-66e205928274 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:06.641999 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832d1af-a475-4a5e-8326-66e205928274 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:06.643659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832d1af-a475-4a5e-8326-66e205928274 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:06.666371 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 331/666] 10.222.0.65 () {56 vars in 1139 bytes} [Wed Jul 27 08:51:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:06.666371 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb13352-666a-47f8-bb22-255b3b055bd3 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:06.666681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-3832d1af-a475-4a5e-8326-66e205928274 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:06.666681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:06.666681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:06.666681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:06.666681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:06.666681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:06.666681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:06.666681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:06.666681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:06.666681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:06.666681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:06.666681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:06.666681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:06.666681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:06.666681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:06.667492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:06.667492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:06.667492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:06.667492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:06.667492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:06.667492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:06.667492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:06.667492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:06.667492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:06.667492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:06.667492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:06.667492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:06.667492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:06.667492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:06.667492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:06.667492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:06.667492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:06.668371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:06.668371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:06.668371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:06.668371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:06.668371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 336/667] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:06.668371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832d1af-a475-4a5e-8326-66e205928274 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:06.781236 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:06.849319 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832d1af-a475-4a5e-8326-66e205928274 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:06.850310 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb13352-666a-47f8-bb22-255b3b055bd3 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:06.871922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:06.892133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99800278-c28c-4742-ac63-4e846dab5a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:06.892781 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99800278-c28c-4742-ac63-4e846dab5a4b None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:06.893056 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99800278-c28c-4742-ac63-4e846dab5a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:06.893328 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99800278-c28c-4742-ac63-4e846dab5a4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:06.907540 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99800278-c28c-4742-ac63-4e846dab5a4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:06.909010 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99800278-c28c-4742-ac63-4e846dab5a4b None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:06.921909 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be407b40-c1c3-4471-909d-c73eb03a9fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:06.923061 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be407b40-c1c3-4471-909d-c73eb03a9fce None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:06.923569 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be407b40-c1c3-4471-909d-c73eb03a9fce None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:06.924068 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be407b40-c1c3-4471-909d-c73eb03a9fce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:06.925672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-99800278-c28c-4742-ac63-4e846dab5a4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:06.925672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:06.925672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:06.925672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:06.925672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:06.925672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:06.925672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:06.925672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:06.925672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:06.925672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:06.925672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:06.925672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:06.925672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:06.925672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:06.925672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:06.935716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:06.935716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:06.935716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:06.935716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:06.935716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:06.935716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:06.935716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:06.935716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:06.935716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:06.935716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:06.935716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:06.935716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:06.935716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:06.935716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:06.935716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:06.935716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:06.935716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:06.938783 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:06.938783 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:06.938783 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:06.938783 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:06.938783 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 337/668] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:06.938783 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99800278-c28c-4742-ac63-4e846dab5a4b None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:06.946332 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be407b40-c1c3-4471-909d-c73eb03a9fce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:06.949026 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be407b40-c1c3-4471-909d-c73eb03a9fce None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:06.970523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-be407b40-c1c3-4471-909d-c73eb03a9fce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:06.970523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:06.970523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:06.970523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:06.970523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:06.970523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:06.970523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:06.970523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:06.970523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:06.970523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:06.970523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:06.970523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:06.970523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:51:06.970523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:51:06.970523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:51:06.972361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:51:06.972361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:06.972361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:06.972361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:06.972361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:06.972361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:06.972361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:06.972361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:06.972361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:06.972361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:06.972361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:06.972361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:06.972361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:06.972361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:06.972361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:06.972361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:06.972361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:06.975870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:51:06.975870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:51:06.975870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:51:06.975870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:51:06.975870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:51:06.975870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:51:06.975870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:06.975870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:06.975870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 332/669] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:51:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:06.975870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be407b40-c1c3-4471-909d-c73eb03a9fce None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:07.124140 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99800278-c28c-4742-ac63-4e846dab5a4b None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:07.138007 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:07.141634 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be407b40-c1c3-4471-909d-c73eb03a9fce None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:07.187734 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b2ce2-5dc7-4a06-9e99-f15680568519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:07.188019 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398de5a0-b852-486d-ab64-b61854016feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:07.188445 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b2ce2-5dc7-4a06-9e99-f15680568519 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:07.188703 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b2ce2-5dc7-4a06-9e99-f15680568519 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:07.188856 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398de5a0-b852-486d-ab64-b61854016feb None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:07.188993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b2ce2-5dc7-4a06-9e99-f15680568519 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:07.189397 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398de5a0-b852-486d-ab64-b61854016feb None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:07.189578 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b2ce2-5dc7-4a06-9e99-f15680568519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:07.189876 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b2ce2-5dc7-4a06-9e99-f15680568519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:07.190028 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398de5a0-b852-486d-ab64-b61854016feb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:07.191348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b2ce2-5dc7-4a06-9e99-f15680568519 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:07.214016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 333/670] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:07.214016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b2ce2-5dc7-4a06-9e99-f15680568519 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:07.259784 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:07.320222 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398de5a0-b852-486d-ab64-b61854016feb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:07.323888 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398de5a0-b852-486d-ab64-b61854016feb None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:07.350875 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b2ce2-5dc7-4a06-9e99-f15680568519 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:07.409117 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fb8e9-dd52-4dfd-876b-d517079a68ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:07.410769 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fb8e9-dd52-4dfd-876b-d517079a68ad None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:07.411373 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fb8e9-dd52-4dfd-876b-d517079a68ad None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:07.411764 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fb8e9-dd52-4dfd-876b-d517079a68ad None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:07.413064 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fb8e9-dd52-4dfd-876b-d517079a68ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:07.413796 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fb8e9-dd52-4dfd-876b-d517079a68ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:07.416424 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fb8e9-dd52-4dfd-876b-d517079a68ad None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:07.446767 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 334/671] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:07.446767 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fb8e9-dd52-4dfd-876b-d517079a68ad None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:07.484919 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 338/672] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:51:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:51:07.484919 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398de5a0-b852-486d-ab64-b61854016feb None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:07.496317 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:07.593835 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:07.608578 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fb8e9-dd52-4dfd-876b-d517079a68ad None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:07.630298 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398de5a0-b852-486d-ab64-b61854016feb None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:07.662062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad42753-939b-4307-a31b-7cc3fd839167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:07.662618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad42753-939b-4307-a31b-7cc3fd839167 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:07.662896 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad42753-939b-4307-a31b-7cc3fd839167 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:07.663165 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad42753-939b-4307-a31b-7cc3fd839167 None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:07.663928 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad42753-939b-4307-a31b-7cc3fd839167 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:07.664264 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad42753-939b-4307-a31b-7cc3fd839167 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:07.666782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad42753-939b-4307-a31b-7cc3fd839167 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:07.668532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a16762-45f0-4ac2-adad-d0a4ce63a70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:07.669183 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a16762-45f0-4ac2-adad-d0a4ce63a70a None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:07.669460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a16762-45f0-4ac2-adad-d0a4ce63a70a None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:07.669735 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a16762-45f0-4ac2-adad-d0a4ce63a70a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:07.677993 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a16762-45f0-4ac2-adad-d0a4ce63a70a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:07.679548 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a16762-45f0-4ac2-adad-d0a4ce63a70a None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:07.679885 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 335/673] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:51:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:07.681325 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad42753-939b-4307-a31b-7cc3fd839167 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:07.695842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-46a16762-45f0-4ac2-adad-d0a4ce63a70a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:07.695842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:07.695842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:07.695842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:07.695842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:07.695842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:07.695842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:07.695842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:07.695842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:07.695842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:07.695842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:07.695842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:07.695842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:51:07.695842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:51:07.695842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:51:07.697688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:51:07.697688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:07.697688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:07.697688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:07.697688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:07.697688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:07.697688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:07.697688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:07.697688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:07.697688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:07.697688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:07.697688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:07.697688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:07.697688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:07.697688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:07.697688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:07.697688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:07.698662 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:51:07.698662 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:51:07.698662 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:51:07.698662 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:51:07.698662 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:51:07.698662 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:51:07.698662 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:07.698662 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:07.698662 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 339/674] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:51:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:07.698662 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a16762-45f0-4ac2-adad-d0a4ce63a70a None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:07.780811 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:07.830080 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad42753-939b-4307-a31b-7cc3fd839167 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:07.835518 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a16762-45f0-4ac2-adad-d0a4ce63a70a None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:07.870675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e445d7-4af0-44be-9c42-7d1067b915c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:07.871413 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e445d7-4af0-44be-9c42-7d1067b915c1 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:07.871752 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e445d7-4af0-44be-9c42-7d1067b915c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:07.872085 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e445d7-4af0-44be-9c42-7d1067b915c1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:07.880766 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e445d7-4af0-44be-9c42-7d1067b915c1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:07.882254 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e445d7-4af0-44be-9c42-7d1067b915c1 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:07.895592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-b1e445d7-4af0-44be-9c42-7d1067b915c1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 08:51:07.895592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:07.895592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:07.895592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:07.895592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:07.895592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:07.895592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:07.895592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:07.895592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:07.895592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:07.895592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:07.895592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:07.895592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:51:07.895592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:51:07.895592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:51:07.895592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:51:07.897587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:07.897587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:07.897587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:51:07.897587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:07.897587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:51:07.897587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:07.897587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:07.897587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:07.897587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:07.897587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:07.897587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:07.897587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:07.897587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:07.897587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:07.897587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:07.897587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:07.897587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:07.897587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:07.899061 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:07.899061 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:07.899061 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:51:07.899061 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:51:07.899061 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:51:07.899061 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:51:07.899061 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:51:07.899061 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:51:07.899061 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 08:51:07.899061 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:07.899723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64db40b-5dd6-4405-8da6-5715f9c8c964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:07.900225 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 336/675] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:51:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:07.900225 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958cd10-4bf6-4b5b-ba83-ca28496c885e None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:07.900225 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958cd10-4bf6-4b5b-ba83-ca28496c885e None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:07.900225 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958cd10-4bf6-4b5b-ba83-ca28496c885e None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:07.900818 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 337/676] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:07.901580 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958cd10-4bf6-4b5b-ba83-ca28496c885e None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:07.903330 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64db40b-5dd6-4405-8da6-5715f9c8c964 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:07.904087 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64db40b-5dd6-4405-8da6-5715f9c8c964 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:07.904572 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64db40b-5dd6-4405-8da6-5715f9c8c964 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:07.920046 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:07.921893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64db40b-5dd6-4405-8da6-5715f9c8c964 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:07.924803 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64db40b-5dd6-4405-8da6-5715f9c8c964 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:07.953299 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-d64db40b-5dd6-4405-8da6-5715f9c8c964 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:07.953299 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:07.953299 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:07.953299 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:07.953299 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:07.953299 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:07.953299 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:07.953299 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:07.953299 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:07.953299 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:07.953299 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:07.953299 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:07.953299 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:07.953299 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:07.953299 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:07.954336 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:07.954336 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:07.954336 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:07.954336 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:07.954336 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:07.954336 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:07.954336 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:07.954336 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:07.954336 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:07.954336 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:07.954336 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:07.954336 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:07.954336 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:07.954336 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:07.954336 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:07.954336 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:07.954336 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:07.955237 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:07.955237 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:07.955237 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:07.955237 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:07.955466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 340/677] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:07.956816 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64db40b-5dd6-4405-8da6-5715f9c8c964 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:08.058887 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958cd10-4bf6-4b5b-ba83-ca28496c885e None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:08.076126 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64db40b-5dd6-4405-8da6-5715f9c8c964 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:08.101042 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:08.118068 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d07fd-166f-4a70-be38-0d9956ee2023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:08.119442 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d07fd-166f-4a70-be38-0d9956ee2023 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:08.119849 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d07fd-166f-4a70-be38-0d9956ee2023 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:08.120341 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d07fd-166f-4a70-be38-0d9956ee2023 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:08.121344 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d07fd-166f-4a70-be38-0d9956ee2023 None admin] RBAC: Adding query filter params (role.id=e476894ef72943f9b83d98d0704edfea, scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267, user.id=72763a52df364a4a8a660ec1be4aba79) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:08.121889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d07fd-166f-4a70-be38-0d9956ee2023 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:08.122988 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb3784-e2c0-4acc-b658-f7ddc314e14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:08.123700 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb3784-e2c0-4acc-b658-f7ddc314e14f None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:08.123980 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb3784-e2c0-4acc-b658-f7ddc314e14f None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:08.124195 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d07fd-166f-4a70-be38-0d9956ee2023 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:08.124351 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb3784-e2c0-4acc-b658-f7ddc314e14f None admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:08.125160 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb3784-e2c0-4acc-b658-f7ddc314e14f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:08.125505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb3784-e2c0-4acc-b658-f7ddc314e14f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:08.127242 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb3784-e2c0-4acc-b658-f7ddc314e14f None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:08.133929 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 338/678] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:51:07 2022] GET /identity/v3/role_assignments?user.id=72763a52df364a4a8a660ec1be4aba79&scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267&role.id=e476894ef72943f9b83d98d0704edfea => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:08.135396 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d07fd-166f-4a70-be38-0d9956ee2023 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:08.150414 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 341/679] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:51:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:08.154292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71173e6-dd59-44bb-9d6b-01f0ed178543 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:08.155868 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71173e6-dd59-44bb-9d6b-01f0ed178543 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:08.157057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71173e6-dd59-44bb-9d6b-01f0ed178543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:08.191837 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-e71173e6-dd59-44bb-9d6b-01f0ed178543 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:08.193085 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-e71173e6-dd59-44bb-9d6b-01f0ed178543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:08.249464 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:08.292852 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d07fd-166f-4a70-be38-0d9956ee2023 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:08.334417 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 342/680] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:51:08.334417 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71173e6-dd59-44bb-9d6b-01f0ed178543 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:08.364967 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e520d1-ac42-49ba-8039-afa5fc6b9dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:08.365689 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e520d1-ac42-49ba-8039-afa5fc6b9dbc None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:08.365869 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e520d1-ac42-49ba-8039-afa5fc6b9dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:08.366750 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e520d1-ac42-49ba-8039-afa5fc6b9dbc None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:08.366987 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e520d1-ac42-49ba-8039-afa5fc6b9dbc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:08.367301 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e520d1-ac42-49ba-8039-afa5fc6b9dbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:08.370091 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e520d1-ac42-49ba-8039-afa5fc6b9dbc None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:08.392968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 339/681] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Jul 27 08:51:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:08.394152 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e520d1-ac42-49ba-8039-afa5fc6b9dbc None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:08.481662 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71173e6-dd59-44bb-9d6b-01f0ed178543 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:08.496269 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:08.521955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59434c12-35c6-4606-b280-d56604b453be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:08.522635 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59434c12-35c6-4606-b280-d56604b453be None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:08.522786 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e520d1-ac42-49ba-8039-afa5fc6b9dbc None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:08.522972 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59434c12-35c6-4606-b280-d56604b453be None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:08.523191 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59434c12-35c6-4606-b280-d56604b453be None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:08.523901 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59434c12-35c6-4606-b280-d56604b453be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:08.524250 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59434c12-35c6-4606-b280-d56604b453be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:08.525949 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59434c12-35c6-4606-b280-d56604b453be None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:08.538943 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 343/682] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:08.539812 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59434c12-35c6-4606-b280-d56604b453be None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:08.565506 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:08.573366 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e34182-9b83-4658-907d-ecc7c60f359c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:08.574186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e34182-9b83-4658-907d-ecc7c60f359c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:08.574403 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e34182-9b83-4658-907d-ecc7c60f359c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:08.574706 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e34182-9b83-4658-907d-ecc7c60f359c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:08.575529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e34182-9b83-4658-907d-ecc7c60f359c None admin] RBAC: Adding query filter params (role.id=e476894ef72943f9b83d98d0704edfea, scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267, user.id=c30bc55c6a1348bb961f0d010422da87) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:08.575780 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e34182-9b83-4658-907d-ecc7c60f359c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:08.577296 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e34182-9b83-4658-907d-ecc7c60f359c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:08.590373 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 340/683] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:51:08 2022] GET /identity/v3/role_assignments?user.id=c30bc55c6a1348bb961f0d010422da87&scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267&role.id=e476894ef72943f9b83d98d0704edfea => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:08.590373 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e34182-9b83-4658-907d-ecc7c60f359c None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:08.679251 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59434c12-35c6-4606-b280-d56604b453be None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:08.723972 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a9c6f-3a95-4e79-a6aa-cc6ecee9f1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:08.724735 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a9c6f-3a95-4e79-a6aa-cc6ecee9f1da None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:08.725083 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a9c6f-3a95-4e79-a6aa-cc6ecee9f1da None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:08.725424 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a9c6f-3a95-4e79-a6aa-cc6ecee9f1da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:08.740045 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a9c6f-3a95-4e79-a6aa-cc6ecee9f1da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:08.741668 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a9c6f-3a95-4e79-a6aa-cc6ecee9f1da None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:08.745948 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e34182-9b83-4658-907d-ecc7c60f359c None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:08.764779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-635a9c6f-3a95-4e79-a6aa-cc6ecee9f1da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:08.764779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:08.764779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:08.764779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:08.764779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:08.764779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:08.764779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:08.764779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:08.764779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:08.764779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:08.764779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:08.764779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:08.764779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:08.764779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:08.764779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:08.765925 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:08.765925 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:08.765925 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:08.765925 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:08.765925 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:08.765925 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:08.765925 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:08.765925 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:08.765925 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:08.765925 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:08.765925 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:08.765925 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:08.765925 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:08.765925 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:08.765925 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:08.765925 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:08.765925 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:08.767079 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:08.767079 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:08.767079 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:08.767079 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:08.768989 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 344/684] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:08.769788 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a9c6f-3a95-4e79-a6aa-cc6ecee9f1da None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:08.801699 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:08.806178 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd61de-4dae-4302-8e1e-cd37fdecbf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:08.806867 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd61de-4dae-4302-8e1e-cd37fdecbf3b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:08.807151 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd61de-4dae-4302-8e1e-cd37fdecbf3b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:08.807431 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd61de-4dae-4302-8e1e-cd37fdecbf3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:08.902397 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:08.913531 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd61de-4dae-4302-8e1e-cd37fdecbf3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:08.913790 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a9c6f-3a95-4e79-a6aa-cc6ecee9f1da None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:08.915127 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd61de-4dae-4302-8e1e-cd37fdecbf3b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:08.964048 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a07f9b-c33e-4bc2-a328-3182d5061170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:08.964720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a07f9b-c33e-4bc2-a328-3182d5061170 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:08.964996 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a07f9b-c33e-4bc2-a328-3182d5061170 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:08.965274 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a07f9b-c33e-4bc2-a328-3182d5061170 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:08.973746 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a07f9b-c33e-4bc2-a328-3182d5061170 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:08.975260 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a07f9b-c33e-4bc2-a328-3182d5061170 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:08.988528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-c9a07f9b-c33e-4bc2-a328-3182d5061170 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:08.988528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:08.988528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:08.988528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:08.988528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:08.988528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:08.988528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:08.988528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:08.988528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:08.988528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:08.988528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:08.988528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:08.988528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:51:08.988528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:51:08.988528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:51:08.990751 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:51:08.990751 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:08.990751 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:08.990751 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:08.990751 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:08.990751 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:08.990751 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:08.990751 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:08.990751 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:08.990751 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:08.990751 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:08.990751 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:08.990751 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:08.990751 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:08.990751 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:08.990751 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:08.990751 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:08.992841 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:51:08.992841 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:51:08.992841 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:51:08.992841 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:51:08.992841 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:51:08.992841 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:51:08.992841 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:08.992841 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:08.992841 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 345/685] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:51:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:08.995158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a07f9b-c33e-4bc2-a328-3182d5061170 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:09.091594 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 341/686] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:51:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:51:09.093451 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd61de-4dae-4302-8e1e-cd37fdecbf3b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:09.096022 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:09.120159 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a07f9b-c33e-4bc2-a328-3182d5061170 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:09.168045 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce46e89-2f56-4e8d-89b2-104a4013272e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:09.168967 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce46e89-2f56-4e8d-89b2-104a4013272e None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:09.169256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce46e89-2f56-4e8d-89b2-104a4013272e None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:09.169542 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce46e89-2f56-4e8d-89b2-104a4013272e None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:09.170259 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce46e89-2f56-4e8d-89b2-104a4013272e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:09.170782 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce46e89-2f56-4e8d-89b2-104a4013272e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:09.172862 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce46e89-2f56-4e8d-89b2-104a4013272e None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:09.189958 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 346/687] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:09.192483 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce46e89-2f56-4e8d-89b2-104a4013272e None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:09.221950 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:09.231451 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd61de-4dae-4302-8e1e-cd37fdecbf3b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:09.275264 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b65e8c-9695-41f3-b684-bccc12599df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:09.276307 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b65e8c-9695-41f3-b684-bccc12599df9 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:09.276870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b65e8c-9695-41f3-b684-bccc12599df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:09.277350 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b65e8c-9695-41f3-b684-bccc12599df9 None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:09.278428 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b65e8c-9695-41f3-b684-bccc12599df9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:09.279180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b65e8c-9695-41f3-b684-bccc12599df9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:09.280978 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b65e8c-9695-41f3-b684-bccc12599df9 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:09.301507 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 342/688] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:51:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:09.302971 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b65e8c-9695-41f3-b684-bccc12599df9 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:09.305861 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce46e89-2f56-4e8d-89b2-104a4013272e None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:09.345973 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1ebcf-a81a-4dd1-b14d-165a2580d625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:09.346665 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1ebcf-a81a-4dd1-b14d-165a2580d625 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:09.346944 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1ebcf-a81a-4dd1-b14d-165a2580d625 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:09.347222 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1ebcf-a81a-4dd1-b14d-165a2580d625 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:09.359288 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a1ebcf-a81a-4dd1-b14d-165a2580d625 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:09.360782 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a1ebcf-a81a-4dd1-b14d-165a2580d625 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:09.362965 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:09.378831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-d4a1ebcf-a81a-4dd1-b14d-165a2580d625 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:09.378831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:09.378831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:09.378831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:09.378831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:09.378831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:09.378831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:09.378831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:09.378831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:09.378831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:09.378831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:09.378831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:09.378831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:09.378831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:09.378831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:09.379789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:09.379789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:09.379789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:09.379789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:09.379789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:09.379789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:09.379789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:09.379789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:09.379789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:09.379789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:09.379789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:09.379789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:09.379789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:09.379789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:09.379789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:09.379789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:09.379789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:09.380659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:09.380659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:09.380659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:09.380659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:09.380659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 347/689] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:09.381274 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1ebcf-a81a-4dd1-b14d-165a2580d625 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:09.434635 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b65e8c-9695-41f3-b684-bccc12599df9 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:09.476240 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79c52c-6f98-47ef-8a75-9e4f5f494105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:09.477126 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79c52c-6f98-47ef-8a75-9e4f5f494105 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:09.478123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79c52c-6f98-47ef-8a75-9e4f5f494105 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:09.478862 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79c52c-6f98-47ef-8a75-9e4f5f494105 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:09.480019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79c52c-6f98-47ef-8a75-9e4f5f494105 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:09.481709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79c52c-6f98-47ef-8a75-9e4f5f494105 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:09.493192 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1ebcf-a81a-4dd1-b14d-165a2580d625 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:09.507801 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 343/690] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 08:51:09 2022] POST /identity/v3/users => generated 254 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:51:09.509875 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79c52c-6f98-47ef-8a75-9e4f5f494105 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:09.530599 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:09.532071 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f696b30-57a3-48eb-9e5b-ecff2749bc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:09.532730 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f696b30-57a3-48eb-9e5b-ecff2749bc29 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:09.533028 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f696b30-57a3-48eb-9e5b-ecff2749bc29 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:09.533300 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f696b30-57a3-48eb-9e5b-ecff2749bc29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:09.534147 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f696b30-57a3-48eb-9e5b-ecff2749bc29 None admin] RBAC: Adding query filter params (role.id=e476894ef72943f9b83d98d0704edfea, scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267, user.id=b018ac10ad804c6cbbe7fdcc1cec61e8) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:09.535086 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f696b30-57a3-48eb-9e5b-ecff2749bc29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:09.536078 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f696b30-57a3-48eb-9e5b-ecff2749bc29 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:09.550485 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 348/691] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:51:09 2022] GET /identity/v3/role_assignments?user.id=b018ac10ad804c6cbbe7fdcc1cec61e8&scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267&role.id=e476894ef72943f9b83d98d0704edfea => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:09.656501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79c52c-6f98-47ef-8a75-9e4f5f494105 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:09.702821 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37fefac-ccdc-4c62-8efa-203c23828b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:09.703813 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fefac-ccdc-4c62-8efa-203c23828b9a None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:09.704275 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fefac-ccdc-4c62-8efa-203c23828b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:09.704757 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fefac-ccdc-4c62-8efa-203c23828b9a None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:09.705663 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37fefac-ccdc-4c62-8efa-203c23828b9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:09.706153 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37fefac-ccdc-4c62-8efa-203c23828b9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:09.707829 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37fefac-ccdc-4c62-8efa-203c23828b9a None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:09.724796 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 344/692] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:09.733648 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f696b30-57a3-48eb-9e5b-ecff2749bc29 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:09.819010 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:09.873589 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f696b30-57a3-48eb-9e5b-ecff2749bc29 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:09.917101 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b83cc-27fa-41fc-bf3f-47e7d1da453f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:09.917929 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b83cc-27fa-41fc-bf3f-47e7d1da453f None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:09.918387 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b83cc-27fa-41fc-bf3f-47e7d1da453f None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:09.918804 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b83cc-27fa-41fc-bf3f-47e7d1da453f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:09.927856 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b83cc-27fa-41fc-bf3f-47e7d1da453f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:09.929482 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b83cc-27fa-41fc-bf3f-47e7d1da453f None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:09.943256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-f41b83cc-27fa-41fc-bf3f-47e7d1da453f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:09.943256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:09.943256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:09.943256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:09.943256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:09.943256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:09.943256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:09.943256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:09.943256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:09.943256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:09.943256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:09.943256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:09.943256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:51:09.943256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:51:09.943256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:51:09.944446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:51:09.944446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:09.944446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:09.944446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:09.944446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:09.944446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:09.944446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:09.944446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:09.944446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:09.944446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:09.944446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:09.944446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:09.944446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:09.944446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:09.944446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:09.944446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:09.944446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:09.945563 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:51:09.945563 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:51:09.945563 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:51:09.945563 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:51:09.945563 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:51:09.945563 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:51:09.945563 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:09.945563 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:09.947807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 349/693] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:51:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:09.956018 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37fefac-ccdc-4c62-8efa-203c23828b9a None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:10.037010 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:10.070101 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37fefac-ccdc-4c62-8efa-203c23828b9a None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:10.110188 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626aa4ff-886e-4d46-8380-e46ad6c09e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:10.110978 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626aa4ff-886e-4d46-8380-e46ad6c09e19 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:10.111350 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626aa4ff-886e-4d46-8380-e46ad6c09e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:10.111743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626aa4ff-886e-4d46-8380-e46ad6c09e19 None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:10.115705 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626aa4ff-886e-4d46-8380-e46ad6c09e19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:10.115705 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626aa4ff-886e-4d46-8380-e46ad6c09e19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:10.115705 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626aa4ff-886e-4d46-8380-e46ad6c09e19 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:10.128942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 345/694] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:51:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:10.135891 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b83cc-27fa-41fc-bf3f-47e7d1da453f None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:10.290445 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b83cc-27fa-41fc-bf3f-47e7d1da453f None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:10.319574 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:10.344387 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b57f61-e9fa-446f-b559-11a44da1c87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:10.345274 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b57f61-e9fa-446f-b559-11a44da1c87c None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:10.345715 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b57f61-e9fa-446f-b559-11a44da1c87c None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:10.346142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b57f61-e9fa-446f-b559-11a44da1c87c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:10.351403 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b57f61-e9fa-446f-b559-11a44da1c87c None admin] RBAC: Adding query filter params (role.id=e476894ef72943f9b83d98d0704edfea, scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267, user.id=158ea5c9dd5142eebd903d5f732997ad) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:10.351929 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b57f61-e9fa-446f-b559-11a44da1c87c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:10.354239 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b57f61-e9fa-446f-b559-11a44da1c87c None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:10.361604 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 350/695] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:51:10 2022] GET /identity/v3/role_assignments?user.id=158ea5c9dd5142eebd903d5f732997ad&scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267&role.id=e476894ef72943f9b83d98d0704edfea => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:10.791437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96801eba-71a6-43bb-af67-eb73757c2cae None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:10.791973 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96801eba-71a6-43bb-af67-eb73757c2cae None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:10.791973 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96801eba-71a6-43bb-af67-eb73757c2cae None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:10.793733 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 346/696] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:10.799536 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1e6e0-4750-42d1-9226-e1b591a28324 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:10.799819 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1e6e0-4750-42d1-9226-e1b591a28324 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:10.800103 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1e6e0-4750-42d1-9226-e1b591a28324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:10.820752 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-b3f1e6e0-4750-42d1-9226-e1b591a28324 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:10.822906 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-b3f1e6e0-4750-42d1-9226-e1b591a28324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:10.906857 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 351/697] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:51:10.929185 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96801eba-71a6-43bb-af67-eb73757c2cae None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:11.045646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96801eba-71a6-43bb-af67-eb73757c2cae None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:11.079064 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:11.084051 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed923c1f-d17d-4323-ad31-7d03da3e9f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:11.084717 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed923c1f-d17d-4323-ad31-7d03da3e9f0e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:11.085025 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed923c1f-d17d-4323-ad31-7d03da3e9f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:11.085303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed923c1f-d17d-4323-ad31-7d03da3e9f0e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:11.085942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed923c1f-d17d-4323-ad31-7d03da3e9f0e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:11.088047 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed923c1f-d17d-4323-ad31-7d03da3e9f0e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:11.100297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-ed923c1f-d17d-4323-ad31-7d03da3e9f0e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 08:51:11.100297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:11.100297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:51:11.100297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:51:11.100297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:51:11.100297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:51:11.100297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:51:11.100297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:11.100297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 08:51:11.100297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:11.100297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:51:11.100297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:11.100297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:11.100297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:11.100297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:11.100297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:11.101351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:11.101351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:11.101351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:11.101351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:11.101351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:11.101351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:11.101351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:11.101351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:51:11.101351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:51:11.101351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:51:11.101351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:51:11.101351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:11.101351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:11.101351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:11.101351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:11.101351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:11.102203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:11.102203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:11.102203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:11.102203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:11.102203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:11.102203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:11.102203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:11.102203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:11.102203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:11.102203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:11.102203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:11.102203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:51:11.102203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:11.102203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 08:51:11.102203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:11.103447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 347/698] 10.222.0.65 () {56 vars in 1129 bytes} [Wed Jul 27 08:51:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:11.108067 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1e6e0-4750-42d1-9226-e1b591a28324 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:11.259323 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1e6e0-4750-42d1-9226-e1b591a28324 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:11.282622 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:11.317466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9db73-db4b-4f08-9a50-3ff177ddcc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:11.318080 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9db73-db4b-4f08-9a50-3ff177ddcc6c None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:11.318393 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9db73-db4b-4f08-9a50-3ff177ddcc6c None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:11.318719 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9db73-db4b-4f08-9a50-3ff177ddcc6c None admin] PATH_INFO: `/v3/services` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:11.319421 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9db73-db4b-4f08-9a50-3ff177ddcc6c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:11.319726 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9db73-db4b-4f08-9a50-3ff177ddcc6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:11.321285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9db73-db4b-4f08-9a50-3ff177ddcc6c None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:11.330811 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 352/699] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Jul 27 08:51:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:11.338790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed923c1f-d17d-4323-ad31-7d03da3e9f0e None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:11.525365 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed923c1f-d17d-4323-ad31-7d03da3e9f0e None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:11.562740 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078679c-3445-42e1-9900-37e167d22c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:11.563372 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078679c-3445-42e1-9900-37e167d22c20 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:11.563656 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078679c-3445-42e1-9900-37e167d22c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:11.563935 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078679c-3445-42e1-9900-37e167d22c20 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:11.564625 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078679c-3445-42e1-9900-37e167d22c20 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:11.564933 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078679c-3445-42e1-9900-37e167d22c20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:11.566345 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078679c-3445-42e1-9900-37e167d22c20 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:11.578559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 348/700] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Jul 27 08:51:11 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:51:11.809567 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d790aa2-7b0b-4041-b4bf-236ee12662da None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:11.810783 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d790aa2-7b0b-4041-b4bf-236ee12662da None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:11.811504 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d790aa2-7b0b-4041-b4bf-236ee12662da None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:11.814489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 353/701] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:11.824454 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c476f-1d51-4e76-822b-4a5f2afb50f0 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:11.825994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c476f-1d51-4e76-822b-4a5f2afb50f0 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:11.826805 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c476f-1d51-4e76-822b-4a5f2afb50f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:11.856487 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-aa3c476f-1d51-4e76-822b-4a5f2afb50f0 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:11.858242 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-aa3c476f-1d51-4e76-822b-4a5f2afb50f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:11.938823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:11.959189 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 349/702] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:51:12.020116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d790aa2-7b0b-4041-b4bf-236ee12662da None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:12.225295 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d790aa2-7b0b-4041-b4bf-236ee12662da None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:12.298425 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631d560-d87c-4380-8f4d-ee83c843822c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:12.299986 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631d560-d87c-4380-8f4d-ee83c843822c None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:12.300758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631d560-d87c-4380-8f4d-ee83c843822c None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:12.301298 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631d560-d87c-4380-8f4d-ee83c843822c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:12.322061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631d560-d87c-4380-8f4d-ee83c843822c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:51:12.331728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-9631d560-d87c-4380-8f4d-ee83c843822c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:51:12.331728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:12.331728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:12.331728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:12.331728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:12.331728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:12.331728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:12.331728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:12.331728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:12.331728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:12.331728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:12.331728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:12.331728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:51:12.331728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:51:12.331728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:51:12.331728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:51:12.333682 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:51:12.333682 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:51:12.333682 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:51:12.333682 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:51:12.333682 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:12.333682 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:12.333682 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:12.333682 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:12.333682 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:12.333682 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:12.333682 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:12.333682 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:12.333682 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:12.333682 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:12.333682 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:12.333682 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:12.335145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:12.335145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:12.335145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:12.335145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:12.335145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:51:12.335145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:51:12.335145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:51:12.335145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:51:12.335145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:51:12.335145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:51:12.335145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:51:12.335145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:12.340403 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 354/703] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:51:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:12.346992 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c476f-1d51-4e76-822b-4a5f2afb50f0 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:12.548803 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c476f-1d51-4e76-822b-4a5f2afb50f0 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:12.575135 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e5e22-4710-4377-b096-f700081d4207 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:12.575423 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e5e22-4710-4377-b096-f700081d4207 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:12.575792 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e5e22-4710-4377-b096-f700081d4207 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:12.577430 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 355/704] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:51:12.583544 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1436f0-a083-4cda-870b-71b007a9414d None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:12.583889 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1436f0-a083-4cda-870b-71b007a9414d None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:12.584104 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1436f0-a083-4cda-870b-71b007a9414d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:12.608134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-7e1436f0-a083-4cda-870b-71b007a9414d None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:12.609379 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-7e1436f0-a083-4cda-870b-71b007a9414d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:12.622705 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb26e9-0f42-44ad-ad4c-51816a8d843c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:12.623423 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb26e9-0f42-44ad-ad4c-51816a8d843c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:12.623707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb26e9-0f42-44ad-ad4c-51816a8d843c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:12.623971 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb26e9-0f42-44ad-ad4c-51816a8d843c None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:12.626436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb26e9-0f42-44ad-ad4c-51816a8d843c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:12.626790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb26e9-0f42-44ad-ad4c-51816a8d843c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:12.628229 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb26e9-0f42-44ad-ad4c-51816a8d843c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:12.651822 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 350/705] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:51:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:12.659506 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb26e9-0f42-44ad-ad4c-51816a8d843c None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:12.690404 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:12.762298 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 356/706] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 08:51:12.763714 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fdb12-c161-4ddc-b267-c913fe5ab48a None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:12.764130 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fdb12-c161-4ddc-b267-c913fe5ab48a None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:12.764414 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fdb12-c161-4ddc-b267-c913fe5ab48a None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:12.769887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 357/707] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:12.771605 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18bb93-78b9-4729-a8b4-eae1f3d859a1 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:12.771969 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18bb93-78b9-4729-a8b4-eae1f3d859a1 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:12.772323 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18bb93-78b9-4729-a8b4-eae1f3d859a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:12.773779 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:12.811957 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-3d18bb93-78b9-4729-a8b4-eae1f3d859a1 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:12.813228 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-3d18bb93-78b9-4729-a8b4-eae1f3d859a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:12.883066 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb26e9-0f42-44ad-ad4c-51816a8d843c None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:12.892352 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 358/708] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:51:12.893326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18bb93-78b9-4729-a8b4-eae1f3d859a1 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:12.947878 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95eee4-f66e-40e5-b378-05f6b7d1a33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:12.949179 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95eee4-f66e-40e5-b378-05f6b7d1a33d None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:12.949674 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95eee4-f66e-40e5-b378-05f6b7d1a33d None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:12.950160 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95eee4-f66e-40e5-b378-05f6b7d1a33d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:12.971261 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95eee4-f66e-40e5-b378-05f6b7d1a33d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:12.973913 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95eee4-f66e-40e5-b378-05f6b7d1a33d None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:13.003362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-0e95eee4-f66e-40e5-b378-05f6b7d1a33d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:13.003362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:13.003362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:13.003362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:13.003362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:13.003362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:13.003362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:13.003362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:13.003362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:13.003362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:13.003362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:13.003362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:13.003362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:13.003362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:13.003362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:13.005154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:13.005154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:13.005154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:13.005154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:13.005154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:13.005154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:13.005154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:13.005154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:13.005154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:13.005154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:13.005154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:13.005154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:13.005154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:13.005154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:13.005154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:13.005154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:13.005154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:13.007968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:13.007968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:13.007968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:13.007968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:13.007968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 351/709] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:51:13.009153 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18bb93-78b9-4729-a8b4-eae1f3d859a1 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:13.009395 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95eee4-f66e-40e5-b378-05f6b7d1a33d None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:13.030749 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:13.048279 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074001f-cb9c-473c-a22d-3c719c6e24a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:13.048938 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074001f-cb9c-473c-a22d-3c719c6e24a6 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:13.049212 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074001f-cb9c-473c-a22d-3c719c6e24a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:13.049474 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074001f-cb9c-473c-a22d-3c719c6e24a6 None admin] PATH_INFO: `/v3/services/network` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:13.050113 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074001f-cb9c-473c-a22d-3c719c6e24a6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:13.051660 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074001f-cb9c-473c-a22d-3c719c6e24a6 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:13.064133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-2074001f-cb9c-473c-a22d-3c719c6e24a6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 08:51:13.064133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:13.064133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:51:13.064133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:51:13.064133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:51:13.064133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:51:13.064133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:51:13.064133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:13.064133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 08:51:13.064133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:13.064133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:51:13.064133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:13.064133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:13.064133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:13.064133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:13.064133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:13.064133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:13.067922 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:13.067922 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:13.067922 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:13.067922 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:13.067922 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:13.067922 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:13.067922 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:51:13.067922 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:51:13.067922 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:51:13.067922 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:51:13.067922 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:13.067922 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:13.067922 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:13.067922 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:13.067922 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:13.067922 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:13.070941 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:13.070941 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:13.070941 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:13.070941 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:13.070941 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:13.070941 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:13.070941 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:13.070941 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:13.070941 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:13.070941 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:13.070941 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:51:13.070941 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:13.070941 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 08:51:13.070941 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:13.070941 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 359/710] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:51:12 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:13.075911 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074001f-cb9c-473c-a22d-3c719c6e24a6 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:13.207934 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95eee4-f66e-40e5-b378-05f6b7d1a33d None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:13.211068 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:13.230018 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074001f-cb9c-473c-a22d-3c719c6e24a6 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:13.254083 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50171d70-1ffe-42af-b52b-1be7b4e4d370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:13.255135 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50171d70-1ffe-42af-b52b-1be7b4e4d370 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:13.255615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50171d70-1ffe-42af-b52b-1be7b4e4d370 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:13.256090 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50171d70-1ffe-42af-b52b-1be7b4e4d370 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:13.273627 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50171d70-1ffe-42af-b52b-1be7b4e4d370 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:51:13.280666 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-50171d70-1ffe-42af-b52b-1be7b4e4d370 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:51:13.280666 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:13.280666 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:13.280666 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:13.280666 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:13.280666 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:13.280666 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:13.280666 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:13.280666 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:13.280666 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:13.280666 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:13.280666 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:13.280666 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:51:13.280666 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:51:13.280666 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:51:13.280666 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:51:13.281698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:51:13.281698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:51:13.281698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:51:13.281698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:51:13.281698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:13.281698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:13.281698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:13.281698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:13.281698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:13.281698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:13.281698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:13.281698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:13.281698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:13.281698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:13.281698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:13.281698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:13.282560 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:13.282560 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:13.282560 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:13.282560 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:13.282560 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:51:13.282560 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:51:13.282560 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:51:13.282560 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:51:13.282560 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:51:13.282560 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:51:13.282560 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:51:13.282560 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:13.285355 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 352/711] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 08:51:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:13.286461 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50171d70-1ffe-42af-b52b-1be7b4e4d370 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:13.313305 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc0695-c5ff-472c-ac4b-b1b51c4589ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:13.315231 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc0695-c5ff-472c-ac4b-b1b51c4589ce None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:13.315760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc0695-c5ff-472c-ac4b-b1b51c4589ce None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:13.316335 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc0695-c5ff-472c-ac4b-b1b51c4589ce None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:13.317760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc0695-c5ff-472c-ac4b-b1b51c4589ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:13.318522 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc0695-c5ff-472c-ac4b-b1b51c4589ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:13.323198 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc0695-c5ff-472c-ac4b-b1b51c4589ce None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:13.351585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 360/712] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:13.353281 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc0695-c5ff-472c-ac4b-b1b51c4589ce None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:13.378169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:13.468899 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc0695-c5ff-472c-ac4b-b1b51c4589ce None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:13.481485 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50171d70-1ffe-42af-b52b-1be7b4e4d370 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:13.509842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8d9c7-035e-49e9-9fb7-9fbd05ad7726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:13.511036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8d9c7-035e-49e9-9fb7-9fbd05ad7726 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:13.511528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8d9c7-035e-49e9-9fb7-9fbd05ad7726 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:13.511977 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8d9c7-035e-49e9-9fb7-9fbd05ad7726 None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:13.512897 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8d9c7-035e-49e9-9fb7-9fbd05ad7726 None admin] RBAC: Adding query filter params (name=service) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:13.513370 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8d9c7-035e-49e9-9fb7-9fbd05ad7726 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:13.514978 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8d9c7-035e-49e9-9fb7-9fbd05ad7726 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:13.524866 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 361/713] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 08:51:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:13.526450 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8d9c7-035e-49e9-9fb7-9fbd05ad7726 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:13.543359 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d0431-47dc-43aa-a25a-9a1a58000cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:13.544053 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d0431-47dc-43aa-a25a-9a1a58000cad None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:13.544334 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d0431-47dc-43aa-a25a-9a1a58000cad None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:13.544607 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d0431-47dc-43aa-a25a-9a1a58000cad None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:13.545348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d0431-47dc-43aa-a25a-9a1a58000cad None admin] RBAC: Adding query filter params (name=network) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:13.545681 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d0431-47dc-43aa-a25a-9a1a58000cad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:13.547264 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d0431-47dc-43aa-a25a-9a1a58000cad None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:13.552842 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 353/714] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 08:51:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:13.553736 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d0431-47dc-43aa-a25a-9a1a58000cad None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:13.586471 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:13.625899 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:13.648135 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8d9c7-035e-49e9-9fb7-9fbd05ad7726 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:13.673649 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d0431-47dc-43aa-a25a-9a1a58000cad None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:13.690398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b64695-c4a4-456d-be20-24b3bd4eb672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:13.691059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b64695-c4a4-456d-be20-24b3bd4eb672 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:13.691386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b64695-c4a4-456d-be20-24b3bd4eb672 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:13.691713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b64695-c4a4-456d-be20-24b3bd4eb672 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:13.701065 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b64695-c4a4-456d-be20-24b3bd4eb672 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:13.702575 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b64695-c4a4-456d-be20-24b3bd4eb672 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:13.716613 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-43b64695-c4a4-456d-be20-24b3bd4eb672 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:51:13.716613 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:13.716613 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:13.716613 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:13.716613 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:13.716613 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:13.716613 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:13.716613 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:13.716613 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:13.716613 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:13.716613 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:13.716613 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:13.716613 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:51:13.716613 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:51:13.716613 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:51:13.716613 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:51:13.719111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:13.719111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:13.719111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:51:13.719111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:13.719111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:51:13.719111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:13.719111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:13.719111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:13.719111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:13.719111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:13.719111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:13.719111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:13.719111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:13.719111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:13.719111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:13.719111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:13.719111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:13.719111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:13.721014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:13.721014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:13.721014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:51:13.721014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:51:13.721014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:51:13.721014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:51:13.721014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:51:13.721014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:51:13.721014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:51:13.721014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:13.721014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 362/715] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Jul 27 08:51:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:13.721014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b64695-c4a4-456d-be20-24b3bd4eb672 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:13.723130 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38dd9e-63ce-4945-ac7d-d61c246ee3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:13.723925 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38dd9e-63ce-4945-ac7d-d61c246ee3f9 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:13.724210 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38dd9e-63ce-4945-ac7d-d61c246ee3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:13.724486 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38dd9e-63ce-4945-ac7d-d61c246ee3f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:13.744746 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38dd9e-63ce-4945-ac7d-d61c246ee3f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:13.747276 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38dd9e-63ce-4945-ac7d-d61c246ee3f9 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:13.773008 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-ff38dd9e-63ce-4945-ac7d-d61c246ee3f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:13.773008 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:13.773008 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:13.773008 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:13.773008 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:13.773008 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:13.773008 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:13.773008 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:13.773008 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:13.773008 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:13.773008 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:13.773008 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:13.773008 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:13.773008 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:13.773008 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:13.773976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:13.773976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:13.773976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:13.773976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:13.773976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:13.773976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:13.773976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:13.773976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:13.773976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:13.773976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:13.773976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:13.773976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:13.773976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:13.773976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:13.773976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:13.773976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:13.773976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:13.776345 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:13.776345 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:13.776345 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:13.776345 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:13.776345 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 354/716] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:13.776345 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41ea93-1fd2-4987-ac8a-f9bb4ffaeb74 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:13.776706 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41ea93-1fd2-4987-ac8a-f9bb4ffaeb74 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:13.776706 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41ea93-1fd2-4987-ac8a-f9bb4ffaeb74 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:13.778192 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 355/717] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:13.778801 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41ea93-1fd2-4987-ac8a-f9bb4ffaeb74 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:13.876987 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:13.912542 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41ea93-1fd2-4987-ac8a-f9bb4ffaeb74 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:13.913295 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b64695-c4a4-456d-be20-24b3bd4eb672 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:13.954890 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb9bc0-dffd-49cc-a929-e640ec7f9c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:13.955548 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb9bc0-dffd-49cc-a929-e640ec7f9c3d None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:13.955804 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb9bc0-dffd-49cc-a929-e640ec7f9c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:13.956131 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb9bc0-dffd-49cc-a929-e640ec7f9c3d None admin] PATH_INFO: `/v3/services` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:13.956759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb9bc0-dffd-49cc-a929-e640ec7f9c3d None admin] RBAC: Adding query filter params (type=network) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:13.957067 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb9bc0-dffd-49cc-a929-e640ec7f9c3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:13.958471 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb9bc0-dffd-49cc-a929-e640ec7f9c3d None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:13.963968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d3187-9732-458e-ab47-5559b3629aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:13.964621 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d3187-9732-458e-ab47-5559b3629aac None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:13.964889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d3187-9732-458e-ab47-5559b3629aac None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:13.965163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d3187-9732-458e-ab47-5559b3629aac None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:13.965975 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d3187-9732-458e-ab47-5559b3629aac None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:13.966278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d3187-9732-458e-ab47-5559b3629aac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:13.967867 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d3187-9732-458e-ab47-5559b3629aac None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:13.978927 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 363/718] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 08:51:13 2022] GET /identity/v3/services?type=network => generated 124 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:13.980211 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb9bc0-dffd-49cc-a929-e640ec7f9c3d None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:14.004941 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:14.008190 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 356/719] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Jul 27 08:51:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:14.011177 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f04b2b-e869-4e25-ba34-94b04d7aae85 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:14.011670 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f04b2b-e869-4e25-ba34-94b04d7aae85 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:14.012018 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f04b2b-e869-4e25-ba34-94b04d7aae85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:14.047978 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-89f04b2b-e869-4e25-ba34-94b04d7aae85 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:14.050269 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-89f04b2b-e869-4e25-ba34-94b04d7aae85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:14.175142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb9bc0-dffd-49cc-a929-e640ec7f9c3d None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:14.178856 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 357/720] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:51:14.181205 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f04b2b-e869-4e25-ba34-94b04d7aae85 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:14.229578 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2242ac-c34a-43a0-8ce2-6069a32cc17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:14.230404 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2242ac-c34a-43a0-8ce2-6069a32cc17d None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:14.230998 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2242ac-c34a-43a0-8ce2-6069a32cc17d None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:14.231573 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2242ac-c34a-43a0-8ce2-6069a32cc17d None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:14.232688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2242ac-c34a-43a0-8ce2-6069a32cc17d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:14.233223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2242ac-c34a-43a0-8ce2-6069a32cc17d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:14.236013 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2242ac-c34a-43a0-8ce2-6069a32cc17d None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:14.262482 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 364/721] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:14.264244 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2242ac-c34a-43a0-8ce2-6069a32cc17d None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:14.281917 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:14.323550 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f04b2b-e869-4e25-ba34-94b04d7aae85 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:14.370715 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:14.377676 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e857b-424d-4592-b209-d7810ce9bb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:14.378582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e857b-424d-4592-b209-d7810ce9bb09 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:14.378846 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e857b-424d-4592-b209-d7810ce9bb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:14.379121 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e857b-424d-4592-b209-d7810ce9bb09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:14.419932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2242ac-c34a-43a0-8ce2-6069a32cc17d None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:14.477425 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a951fd-2a36-4245-b132-19e65e58e450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:14.479626 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a951fd-2a36-4245-b132-19e65e58e450 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:14.480647 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a951fd-2a36-4245-b132-19e65e58e450 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:14.481422 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a951fd-2a36-4245-b132-19e65e58e450 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:14.502414 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a951fd-2a36-4245-b132-19e65e58e450 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:51:14.512479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-b5a951fd-2a36-4245-b132-19e65e58e450 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:51:14.512479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:14.512479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:14.512479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:14.512479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:14.512479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:14.512479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:14.512479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:14.512479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:14.512479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:14.512479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:14.512479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:14.512479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:51:14.512479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:51:14.512479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:51:14.512479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:51:14.513512 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:51:14.513512 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:51:14.513512 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:51:14.513512 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:51:14.513512 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:14.513512 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:14.513512 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:14.513512 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:14.513512 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:14.513512 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:14.513512 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:14.513512 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:14.513512 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:14.513512 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:14.513512 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:14.513512 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:14.514420 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:14.514420 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:14.514420 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:14.514420 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:14.514420 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:51:14.514420 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:51:14.514420 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:51:14.514420 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:51:14.514420 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:51:14.514420 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:51:14.514420 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:51:14.514420 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:14.515103 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 365/722] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:51:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:14.516020 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a951fd-2a36-4245-b132-19e65e58e450 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:14.519493 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e857b-424d-4592-b209-d7810ce9bb09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:14.521829 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e857b-424d-4592-b209-d7810ce9bb09 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:14.613256 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:14.658499 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a951fd-2a36-4245-b132-19e65e58e450 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:14.686348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 358/723] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:51:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:51:14.688700 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb97436-ccc0-4717-a3b9-2aae158b3ea2 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:14.689095 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb97436-ccc0-4717-a3b9-2aae158b3ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:14.689595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb97436-ccc0-4717-a3b9-2aae158b3ea2 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:14.692959 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 359/724] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:14.694587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb97436-ccc0-4717-a3b9-2aae158b3ea2 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:14.873812 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:14.892152 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f185b4-b510-43aa-bdcb-f13f404e84f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:14.893466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f185b4-b510-43aa-bdcb-f13f404e84f9 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:14.893968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f185b4-b510-43aa-bdcb-f13f404e84f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:14.894079 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb97436-ccc0-4717-a3b9-2aae158b3ea2 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:14.894489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f185b4-b510-43aa-bdcb-f13f404e84f9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:14.913463 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f185b4-b510-43aa-bdcb-f13f404e84f9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:14.916199 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f185b4-b510-43aa-bdcb-f13f404e84f9 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:14.940728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-c3f185b4-b510-43aa-bdcb-f13f404e84f9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 08:51:14.940728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:14.940728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:14.940728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:14.940728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:14.940728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:14.940728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:14.940728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:14.940728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:14.940728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:14.940728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:14.940728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:14.940728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:51:14.940728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:51:14.940728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:51:14.940728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:51:14.941758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:14.941758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:14.941758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:51:14.941758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:14.941758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:51:14.941758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:14.941758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:14.941758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:14.941758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:14.941758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:14.941758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:14.941758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:14.941758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:14.941758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:14.941758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:14.941758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:14.941758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:14.941758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:14.942846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:14.942846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:14.942846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:51:14.942846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:51:14.942846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:51:14.942846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:51:14.942846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:51:14.942846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:51:14.942846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 08:51:14.942846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:14.943387 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 366/725] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Jul 27 08:51:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:14.944400 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f185b4-b510-43aa-bdcb-f13f404e84f9 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:14.960174 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411b048-4326-4a23-b84a-c5db43ec6911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:14.961255 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411b048-4326-4a23-b84a-c5db43ec6911 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:14.961749 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411b048-4326-4a23-b84a-c5db43ec6911 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:14.962785 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411b048-4326-4a23-b84a-c5db43ec6911 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:14.964157 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411b048-4326-4a23-b84a-c5db43ec6911 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:14.964700 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411b048-4326-4a23-b84a-c5db43ec6911 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:14.967323 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411b048-4326-4a23-b84a-c5db43ec6911 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:14.983066 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 360/726] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:51:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:14.985247 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3a378-a14b-4e44-9ac0-04ed7f05d552 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:14.985738 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3a378-a14b-4e44-9ac0-04ed7f05d552 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:14.986220 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3a378-a14b-4e44-9ac0-04ed7f05d552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:15.018376 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-69a3a378-a14b-4e44-9ac0-04ed7f05d552 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:15.018376 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-69a3a378-a14b-4e44-9ac0-04ed7f05d552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:15.064240 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:15.129211 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f185b4-b510-43aa-bdcb-f13f404e84f9 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:15.143243 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 361/727] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:51:15.144465 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3a378-a14b-4e44-9ac0-04ed7f05d552 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:15.199078 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956d7a3-ed99-425b-855a-fc6146d3b641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:15.200133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956d7a3-ed99-425b-855a-fc6146d3b641 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:15.200612 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956d7a3-ed99-425b-855a-fc6146d3b641 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:15.201070 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956d7a3-ed99-425b-855a-fc6146d3b641 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:15.219654 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956d7a3-ed99-425b-855a-fc6146d3b641 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:15.222509 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956d7a3-ed99-425b-855a-fc6146d3b641 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:15.251016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-2956d7a3-ed99-425b-855a-fc6146d3b641 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:15.251016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:15.251016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:15.251016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:15.251016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:15.251016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:15.251016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:15.251016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:15.251016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:15.251016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:15.251016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:15.251016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:15.251016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:15.251016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:15.251016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:15.252627 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:15.252627 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:15.252627 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:15.252627 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:15.252627 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:15.252627 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:15.252627 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:15.252627 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:15.252627 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:15.252627 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:15.252627 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:15.252627 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:15.252627 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:15.252627 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:15.252627 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:15.252627 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:15.252627 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:15.253717 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:15.253717 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:15.253717 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:15.253717 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:15.257813 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 367/728] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:15.259712 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956d7a3-ed99-425b-855a-fc6146d3b641 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:15.275455 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3a378-a14b-4e44-9ac0-04ed7f05d552 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:15.316827 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe9fc3-c89e-4517-9904-dca02b84f338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:15.317762 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe9fc3-c89e-4517-9904-dca02b84f338 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:15.318034 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe9fc3-c89e-4517-9904-dca02b84f338 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:15.318691 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe9fc3-c89e-4517-9904-dca02b84f338 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:15.319522 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe9fc3-c89e-4517-9904-dca02b84f338 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:15.319826 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe9fc3-c89e-4517-9904-dca02b84f338 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:15.321870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe9fc3-c89e-4517-9904-dca02b84f338 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:15.325308 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:15.344341 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 362/729] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Jul 27 08:51:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:15.349724 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe9fc3-c89e-4517-9904-dca02b84f338 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:15.373913 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:15.428544 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956d7a3-ed99-425b-855a-fc6146d3b641 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:15.488583 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41323e-c41b-48bb-85bd-25d58604df8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:15.490595 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41323e-c41b-48bb-85bd-25d58604df8a None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:15.491085 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41323e-c41b-48bb-85bd-25d58604df8a None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:15.491557 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41323e-c41b-48bb-85bd-25d58604df8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:15.503761 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe9fc3-c89e-4517-9904-dca02b84f338 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:15.505392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41323e-c41b-48bb-85bd-25d58604df8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:15.506105 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41323e-c41b-48bb-85bd-25d58604df8a None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:15.522643 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-4b41323e-c41b-48bb-85bd-25d58604df8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:15.522643 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:15.522643 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:15.522643 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:15.522643 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:15.522643 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:15.522643 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:15.522643 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:15.522643 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:15.522643 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:15.522643 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:15.522643 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:15.522643 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:15.522643 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:15.522643 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:15.523760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:15.523760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:15.523760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:15.523760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:15.523760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:15.523760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:15.523760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:15.523760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:15.523760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:15.523760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:15.523760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:15.523760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:15.523760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:15.523760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:15.523760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:15.523760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:15.523760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:15.524844 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:15.524844 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:15.524844 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:15.524844 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:15.524844 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 368/730] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:15.525569 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41323e-c41b-48bb-85bd-25d58604df8a None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:15.567034 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd5f2c-08fc-48d2-a643-90122e25e105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:15.567999 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd5f2c-08fc-48d2-a643-90122e25e105 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:15.568399 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd5f2c-08fc-48d2-a643-90122e25e105 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:15.568841 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd5f2c-08fc-48d2-a643-90122e25e105 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:15.570035 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd5f2c-08fc-48d2-a643-90122e25e105 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:15.572626 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd5f2c-08fc-48d2-a643-90122e25e105 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:15.602345 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 363/731] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 08:51:15 2022] POST /identity/v3/services => generated 251 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:51:15.602345 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd5f2c-08fc-48d2-a643-90122e25e105 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:15.704629 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:15.724483 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41323e-c41b-48bb-85bd-25d58604df8a None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:15.785448 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:15.815584 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc968ad4-56e5-46e7-bf6b-e3623ffea45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:15.816910 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc968ad4-56e5-46e7-bf6b-e3623ffea45a None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:15.817367 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc968ad4-56e5-46e7-bf6b-e3623ffea45a None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:15.817809 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc968ad4-56e5-46e7-bf6b-e3623ffea45a None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:15.819036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc968ad4-56e5-46e7-bf6b-e3623ffea45a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:15.819544 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc968ad4-56e5-46e7-bf6b-e3623ffea45a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:15.822037 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc968ad4-56e5-46e7-bf6b-e3623ffea45a None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:15.829020 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd5f2c-08fc-48d2-a643-90122e25e105 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:15.846821 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 369/732] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:15.848362 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc968ad4-56e5-46e7-bf6b-e3623ffea45a None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:15.896688 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862b5d5-0b0d-463f-b1f0-e6de0ab63d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:15.897370 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862b5d5-0b0d-463f-b1f0-e6de0ab63d6c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:15.897766 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862b5d5-0b0d-463f-b1f0-e6de0ab63d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:15.898220 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862b5d5-0b0d-463f-b1f0-e6de0ab63d6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:16.014691 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862b5d5-0b0d-463f-b1f0-e6de0ab63d6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:16.021221 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862b5d5-0b0d-463f-b1f0-e6de0ab63d6c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:16.033946 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc968ad4-56e5-46e7-bf6b-e3623ffea45a None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:16.081412 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e995b-e52b-4bc3-a4a4-03432b398d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:16.082721 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e995b-e52b-4bc3-a4a4-03432b398d68 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:16.083234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e995b-e52b-4bc3-a4a4-03432b398d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:16.084720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e995b-e52b-4bc3-a4a4-03432b398d68 None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:16.085961 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e995b-e52b-4bc3-a4a4-03432b398d68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:16.086673 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e995b-e52b-4bc3-a4a4-03432b398d68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:16.089048 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e995b-e52b-4bc3-a4a4-03432b398d68 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:16.105990 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 370/733] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:16.107239 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e995b-e52b-4bc3-a4a4-03432b398d68 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:16.119385 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:16.163854 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:16.208487 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 364/734] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:51:15 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:51:16.210261 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862b5d5-0b0d-463f-b1f0-e6de0ab63d6c None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:16.255906 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e995b-e52b-4bc3-a4a4-03432b398d68 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:16.309320 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55ca60-9e71-4d8a-8ba4-dae7713724fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:16.310145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55ca60-9e71-4d8a-8ba4-dae7713724fa None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:16.310608 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55ca60-9e71-4d8a-8ba4-dae7713724fa None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:16.311116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55ca60-9e71-4d8a-8ba4-dae7713724fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:16.319587 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55ca60-9e71-4d8a-8ba4-dae7713724fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:16.321164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55ca60-9e71-4d8a-8ba4-dae7713724fa None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:16.334142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-8f55ca60-9e71-4d8a-8ba4-dae7713724fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:16.334142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:16.334142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:16.334142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:16.334142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:16.334142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:16.334142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:16.334142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:16.334142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:16.334142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:16.334142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:16.334142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:16.334142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:51:16.334142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:51:16.334142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:51:16.335158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:51:16.335158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:16.335158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:16.335158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:16.335158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:16.335158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:16.335158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:16.335158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:16.335158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:16.335158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:16.335158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:16.335158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:16.335158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:16.335158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:16.335158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:16.335158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:16.335158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:16.336057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:51:16.336057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:51:16.336057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:51:16.336057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:51:16.336057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:51:16.336057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:51:16.336057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:16.336057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:16.340372 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 371/735] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:51:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:16.341455 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55ca60-9e71-4d8a-8ba4-dae7713724fa None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:16.358560 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862b5d5-0b0d-463f-b1f0-e6de0ab63d6c None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:16.416419 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733527ea-0407-4413-9b28-1554a3567bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:16.417406 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:16.419702 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733527ea-0407-4413-9b28-1554a3567bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:16.420614 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733527ea-0407-4413-9b28-1554a3567bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:16.421337 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733527ea-0407-4413-9b28-1554a3567bc3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:16.437134 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733527ea-0407-4413-9b28-1554a3567bc3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:16.440190 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733527ea-0407-4413-9b28-1554a3567bc3 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:16.457196 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55ca60-9e71-4d8a-8ba4-dae7713724fa None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:16.465658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-733527ea-0407-4413-9b28-1554a3567bc3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 08:51:16.465658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:16.465658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:16.465658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:16.465658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:16.465658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:16.465658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:16.465658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:16.465658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:16.465658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:16.465658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:16.465658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:16.465658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:51:16.465658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:51:16.465658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:51:16.465658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:51:16.467559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:16.467559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:16.467559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:51:16.467559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:16.467559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:51:16.467559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:16.467559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:16.467559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:16.467559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:16.467559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:16.467559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:16.467559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:16.467559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:16.467559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:16.467559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:16.467559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:16.467559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:16.467559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:16.469459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:16.469459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:16.469459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:51:16.469459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:51:16.469459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:51:16.469459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:51:16.469459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:51:16.469459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:51:16.469459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 08:51:16.469459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:16.473689 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 365/736] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:51:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:16.475516 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733527ea-0407-4413-9b28-1554a3567bc3 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:16.511581 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd701b-8c2f-488d-9fb1-b7a577b03a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:16.512576 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd701b-8c2f-488d-9fb1-b7a577b03a1b None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:16.512990 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd701b-8c2f-488d-9fb1-b7a577b03a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:16.513946 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd701b-8c2f-488d-9fb1-b7a577b03a1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:16.540645 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:16.547140 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd701b-8c2f-488d-9fb1-b7a577b03a1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:16.547140 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd701b-8c2f-488d-9fb1-b7a577b03a1b None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:16.576620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-01cd701b-8c2f-488d-9fb1-b7a577b03a1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:16.576620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:16.576620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:16.576620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:16.576620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:16.576620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:16.576620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:16.576620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:16.576620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:16.576620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:16.576620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:16.576620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:16.576620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:16.576620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:16.576620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:16.577759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:16.577759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:16.577759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:16.577759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:16.577759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:16.577759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:16.577759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:16.577759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:16.577759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:16.577759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:16.577759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:16.577759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:16.577759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:16.577759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:16.577759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:16.577759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:16.577759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:16.579161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:16.579161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:16.579161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:16.579161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:16.579161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 372/737] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:16.580589 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd701b-8c2f-488d-9fb1-b7a577b03a1b None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:16.645370 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733527ea-0407-4413-9b28-1554a3567bc3 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:16.687013 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34124e02-e856-4c2d-baf1-58f76b7685ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:16.687640 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34124e02-e856-4c2d-baf1-58f76b7685ef None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:16.687929 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34124e02-e856-4c2d-baf1-58f76b7685ef None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:16.688184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34124e02-e856-4c2d-baf1-58f76b7685ef None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:16.688995 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34124e02-e856-4c2d-baf1-58f76b7685ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:16.689304 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34124e02-e856-4c2d-baf1-58f76b7685ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:16.690807 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34124e02-e856-4c2d-baf1-58f76b7685ef None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:16.705001 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 366/738] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:51:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:16.706642 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ddec7-c6a8-42af-bf44-33592904ca8e None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:16.707062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ddec7-c6a8-42af-bf44-33592904ca8e None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:16.707462 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ddec7-c6a8-42af-bf44-33592904ca8e None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:16.709119 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 367/739] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:16.715301 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ddec7-c6a8-42af-bf44-33592904ca8e None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:16.741162 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd701b-8c2f-488d-9fb1-b7a577b03a1b None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:16.766814 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:16.790886 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048a717-e3cf-45ee-b7ff-db95fc2fb798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:16.791529 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048a717-e3cf-45ee-b7ff-db95fc2fb798 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:16.792183 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048a717-e3cf-45ee-b7ff-db95fc2fb798 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:16.792183 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048a717-e3cf-45ee-b7ff-db95fc2fb798 None admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:16.792902 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048a717-e3cf-45ee-b7ff-db95fc2fb798 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:16.793247 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048a717-e3cf-45ee-b7ff-db95fc2fb798 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:16.794752 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048a717-e3cf-45ee-b7ff-db95fc2fb798 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:16.824095 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 373/740] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Jul 27 08:51:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:16.824095 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048a717-e3cf-45ee-b7ff-db95fc2fb798 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:16.873913 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:16.882067 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ddec7-c6a8-42af-bf44-33592904ca8e None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:16.937297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490bbeeb-6a3b-48e3-be27-c97daa762413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:16.937297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490bbeeb-6a3b-48e3-be27-c97daa762413 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:16.937736 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490bbeeb-6a3b-48e3-be27-c97daa762413 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:16.937736 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490bbeeb-6a3b-48e3-be27-c97daa762413 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:16.938353 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490bbeeb-6a3b-48e3-be27-c97daa762413 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:16.938671 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490bbeeb-6a3b-48e3-be27-c97daa762413 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:16.940057 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490bbeeb-6a3b-48e3-be27-c97daa762413 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:16.958360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 368/741] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:16.958360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480b4fc-5905-404d-be67-df98e112b91a None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:16.958360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480b4fc-5905-404d-be67-df98e112b91a None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:16.958360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480b4fc-5905-404d-be67-df98e112b91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:16.976080 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-c480b4fc-5905-404d-be67-df98e112b91a None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:16.977286 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c480b4fc-5905-404d-be67-df98e112b91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:16.999666 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048a717-e3cf-45ee-b7ff-db95fc2fb798 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:17.062338 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb2519-6018-4882-835a-eb4c8a157328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:17.063121 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb2519-6018-4882-835a-eb4c8a157328 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:17.063410 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb2519-6018-4882-835a-eb4c8a157328 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:17.063710 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb2519-6018-4882-835a-eb4c8a157328 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:17.065195 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb2519-6018-4882-835a-eb4c8a157328 None admin] RBAC: Adding query filter params (role.id=20bc872844094480b9dca67a25b69e84, scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267, user.id=c30bc55c6a1348bb961f0d010422da87) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:17.065910 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb2519-6018-4882-835a-eb4c8a157328 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:17.068141 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb2519-6018-4882-835a-eb4c8a157328 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:17.079068 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 374/742] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:51:16 2022] GET /identity/v3/role_assignments?user.id=c30bc55c6a1348bb961f0d010422da87&scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267&role.id=20bc872844094480b9dca67a25b69e84 => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:17.080563 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb2519-6018-4882-835a-eb4c8a157328 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:17.118726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 369/743] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 08:51:17.118726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480b4fc-5905-404d-be67-df98e112b91a None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:17.180889 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:17.273367 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb2519-6018-4882-835a-eb4c8a157328 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:17.299987 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:17.315988 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480b4fc-5905-404d-be67-df98e112b91a None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:17.340528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b7467-54e9-4395-9423-1cb24d9dfe9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:17.341573 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b7467-54e9-4395-9423-1cb24d9dfe9c None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:17.342058 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b7467-54e9-4395-9423-1cb24d9dfe9c None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:17.342584 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b7467-54e9-4395-9423-1cb24d9dfe9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:17.361762 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d183a-a96a-4d93-b6e3-9d517fadf0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:17.362473 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d183a-a96a-4d93-b6e3-9d517fadf0c8 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:17.362749 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d183a-a96a-4d93-b6e3-9d517fadf0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:17.363020 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d183a-a96a-4d93-b6e3-9d517fadf0c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:17.370807 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d183a-a96a-4d93-b6e3-9d517fadf0c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:17.372268 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d183a-a96a-4d93-b6e3-9d517fadf0c8 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:17.386454 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-895d183a-a96a-4d93-b6e3-9d517fadf0c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:17.386454 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:17.386454 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:17.386454 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:17.386454 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:17.386454 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:17.386454 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:17.386454 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:17.386454 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:17.386454 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:17.386454 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:17.386454 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:17.386454 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:51:17.386454 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:51:17.386454 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:51:17.388220 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:51:17.388220 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:17.388220 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:17.388220 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:17.388220 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:17.388220 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:17.388220 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:17.388220 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:17.388220 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:17.388220 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:17.388220 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:17.388220 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:17.388220 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:17.388220 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:17.388220 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:17.388220 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:17.388220 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:17.389986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:51:17.389986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:51:17.389986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:51:17.389986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:51:17.389986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:51:17.389986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:51:17.389986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:17.389986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:17.393431 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 370/744] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:51:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:17.394525 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d183a-a96a-4d93-b6e3-9d517fadf0c8 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:17.484408 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b7467-54e9-4395-9423-1cb24d9dfe9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:17.487502 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b7467-54e9-4395-9423-1cb24d9dfe9c None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:17.571899 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:17.579753 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d183a-a96a-4d93-b6e3-9d517fadf0c8 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:17.645421 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e8a4a-d217-4b69-b44e-c13932198c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:17.647005 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e8a4a-d217-4b69-b44e-c13932198c46 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:17.647789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e8a4a-d217-4b69-b44e-c13932198c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:17.648640 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e8a4a-d217-4b69-b44e-c13932198c46 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:17.650473 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e8a4a-d217-4b69-b44e-c13932198c46 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:17.654347 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e8a4a-d217-4b69-b44e-c13932198c46 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:17.685760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 371/745] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 08:51:17 2022] POST /identity/v3/services => generated 240 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:51:17.688153 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e8a4a-d217-4b69-b44e-c13932198c46 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:17.698566 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 375/746] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:51:17 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 08:51:17.704587 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b7467-54e9-4395-9423-1cb24d9dfe9c None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:17.715172 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:17.918003 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e8a4a-d217-4b69-b44e-c13932198c46 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:17.919820 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b7467-54e9-4395-9423-1cb24d9dfe9c None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:17.980339 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49adc5-bdfc-4cfb-bf1f-8ec8615315ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:17.981502 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49adc5-bdfc-4cfb-bf1f-8ec8615315ed None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:17.982013 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49adc5-bdfc-4cfb-bf1f-8ec8615315ed None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:17.982542 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49adc5-bdfc-4cfb-bf1f-8ec8615315ed None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:17.983987 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49adc5-bdfc-4cfb-bf1f-8ec8615315ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:17.984550 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49adc5-bdfc-4cfb-bf1f-8ec8615315ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:17.987441 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49adc5-bdfc-4cfb-bf1f-8ec8615315ed None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:17.988786 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcbc59-afdd-49cf-8d51-a09f2bbe92b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:17.989893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcbc59-afdd-49cf-8d51-a09f2bbe92b8 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:17.990698 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcbc59-afdd-49cf-8d51-a09f2bbe92b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:17.991178 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcbc59-afdd-49cf-8d51-a09f2bbe92b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:18.009097 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 372/747] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:51:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:18.011343 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa78311-746e-461b-a765-f93051e9db44 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:18.012405 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa78311-746e-461b-a765-f93051e9db44 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:18.012921 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa78311-746e-461b-a765-f93051e9db44 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:18.017220 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcbc59-afdd-49cf-8d51-a09f2bbe92b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:18.018168 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcbc59-afdd-49cf-8d51-a09f2bbe92b8 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:18.018777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 373/748] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:18.019476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:18.023874 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33beeccf-644c-4e4d-be59-a1c9a8c926fa None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:18.024855 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33beeccf-644c-4e4d-be59-a1c9a8c926fa None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:18.025820 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33beeccf-644c-4e4d-be59-a1c9a8c926fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:18.051295 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-33beeccf-644c-4e4d-be59-a1c9a8c926fa None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:18.053239 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-33beeccf-644c-4e4d-be59-a1c9a8c926fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:18.060292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-8bbcbc59-afdd-49cf-8d51-a09f2bbe92b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:18.060292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:18.060292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:18.060292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:18.060292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:18.060292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:18.060292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:18.060292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:18.060292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:18.060292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:18.060292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:18.060292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:18.060292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:18.060292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:18.060292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:18.061893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:18.061893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:18.061893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:18.061893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:18.061893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:18.061893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:18.061893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:18.061893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:18.061893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:18.061893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:18.061893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:18.061893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:18.061893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:18.061893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:18.061893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:18.061893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:18.061893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:18.063791 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:18.063791 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:18.063791 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:18.063791 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:18.063791 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 376/749] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:51:18.063791 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcbc59-afdd-49cf-8d51-a09f2bbe92b8 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:18.186754 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:18.197438 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 374/750] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:51:18.198884 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33beeccf-644c-4e4d-be59-a1c9a8c926fa None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:18.222721 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcbc59-afdd-49cf-8d51-a09f2bbe92b8 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:18.280895 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1e311-9fb6-40a9-a4b8-2e1e632ed3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:18.281895 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1e311-9fb6-40a9-a4b8-2e1e632ed3df None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:18.281895 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1e311-9fb6-40a9-a4b8-2e1e632ed3df None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:18.282172 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1e311-9fb6-40a9-a4b8-2e1e632ed3df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:18.282931 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1e311-9fb6-40a9-a4b8-2e1e632ed3df None admin] RBAC: Adding query filter params (role.id=e476894ef72943f9b83d98d0704edfea, scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267, user.id=c607472800fc49d5a75c5e6acb33f2a2) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:18.283283 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1e311-9fb6-40a9-a4b8-2e1e632ed3df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:18.284743 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1e311-9fb6-40a9-a4b8-2e1e632ed3df None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:18.294275 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 377/751] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:51:18 2022] GET /identity/v3/role_assignments?user.id=c607472800fc49d5a75c5e6acb33f2a2&scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267&role.id=e476894ef72943f9b83d98d0704edfea => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:18.295916 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1e311-9fb6-40a9-a4b8-2e1e632ed3df None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:18.388849 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33beeccf-644c-4e4d-be59-a1c9a8c926fa None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:18.417557 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:18.451627 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d1888-ec26-4e41-b600-233efdf8b1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:18.453148 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d1888-ec26-4e41-b600-233efdf8b1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:18.453931 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d1888-ec26-4e41-b600-233efdf8b1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:18.455000 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d1888-ec26-4e41-b600-233efdf8b1c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:18.456462 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d1888-ec26-4e41-b600-233efdf8b1c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:18.457285 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d1888-ec26-4e41-b600-233efdf8b1c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:18.461306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d1888-ec26-4e41-b600-233efdf8b1c1 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:18.488694 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 375/752] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:18.495531 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d1888-ec26-4e41-b600-233efdf8b1c1 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:18.553149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1e311-9fb6-40a9-a4b8-2e1e632ed3df None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:18.617290 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9935bba-69b7-42cd-8640-d0a0427d7475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:18.619391 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9935bba-69b7-42cd-8640-d0a0427d7475 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:18.620154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9935bba-69b7-42cd-8640-d0a0427d7475 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:18.620718 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9935bba-69b7-42cd-8640-d0a0427d7475 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:18.621968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9935bba-69b7-42cd-8640-d0a0427d7475 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:18.624389 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9935bba-69b7-42cd-8640-d0a0427d7475 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:18.635003 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:18.643276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-c9935bba-69b7-42cd-8640-d0a0427d7475 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 08:51:18.643276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:18.643276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:51:18.643276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:51:18.643276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:51:18.643276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:51:18.643276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:51:18.643276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:18.643276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 08:51:18.643276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:18.643276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:51:18.643276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:18.643276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:18.643276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:18.643276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:18.643276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:18.645161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:18.645161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:18.645161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:18.645161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:18.645161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:18.645161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:18.645161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:18.645161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:51:18.645161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:51:18.645161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:51:18.645161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:51:18.645161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:18.645161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:18.645161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:18.645161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:18.645161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:18.647501 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:18.647501 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:18.647501 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:18.647501 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:18.647501 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:18.647501 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:18.647501 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:18.647501 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:18.647501 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:18.647501 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:18.647501 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:18.647501 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:51:18.647501 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:18.647501 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 08:51:18.647501 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:18.647501 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 378/753] 10.222.0.65 () {56 vars in 1129 bytes} [Wed Jul 27 08:51:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:18.656233 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9935bba-69b7-42cd-8640-d0a0427d7475 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:18.751323 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d1888-ec26-4e41-b600-233efdf8b1c1 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:18.842780 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdebf8-709c-41b6-b7a1-5c584ab232b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:18.843465 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdebf8-709c-41b6-b7a1-5c584ab232b5 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:18.843754 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdebf8-709c-41b6-b7a1-5c584ab232b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:18.844011 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdebf8-709c-41b6-b7a1-5c584ab232b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:18.846735 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9935bba-69b7-42cd-8640-d0a0427d7475 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:18.863709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdebf8-709c-41b6-b7a1-5c584ab232b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:18.865291 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdebf8-709c-41b6-b7a1-5c584ab232b5 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:18.886743 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:18.913373 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be07cd-b596-40ab-9198-242288b6345f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:18.914666 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be07cd-b596-40ab-9198-242288b6345f None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:18.915291 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be07cd-b596-40ab-9198-242288b6345f None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:18.915919 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be07cd-b596-40ab-9198-242288b6345f None admin] PATH_INFO: `/v3/services` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:18.917260 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be07cd-b596-40ab-9198-242288b6345f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:18.917879 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be07cd-b596-40ab-9198-242288b6345f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:18.921023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be07cd-b596-40ab-9198-242288b6345f None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:18.934866 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 379/754] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Jul 27 08:51:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:18.940760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be07cd-b596-40ab-9198-242288b6345f None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:19.108922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-f8fdebf8-709c-41b6-b7a1-5c584ab232b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:19.108922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:19.108922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:19.108922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:19.108922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:19.108922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:19.108922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:19.108922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:19.108922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:19.108922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:19.108922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:19.108922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:19.108922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:51:19.108922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:51:19.108922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:51:19.110014 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:51:19.110014 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:19.110014 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:19.110014 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:19.110014 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:19.110014 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:19.110014 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:19.110014 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:19.110014 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:19.110014 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:19.110014 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:19.110014 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:19.110014 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:19.110014 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:19.110014 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:19.110014 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:19.110014 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:19.111115 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:51:19.111115 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:51:19.111115 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:51:19.111115 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:51:19.111115 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:51:19.111115 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:51:19.111115 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:19.111115 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:19.119634 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 376/755] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:51:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 626 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:19.127439 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdebf8-709c-41b6-b7a1-5c584ab232b5 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:19.152891 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be07cd-b596-40ab-9198-242288b6345f None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:19.229487 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1ef99-bc87-4a2e-bbfe-729b50dcd8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:19.230135 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1ef99-bc87-4a2e-bbfe-729b50dcd8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:19.230442 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1ef99-bc87-4a2e-bbfe-729b50dcd8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:19.230720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1ef99-bc87-4a2e-bbfe-729b50dcd8e7 None admin] PATH_INFO: `/v3/services` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:19.231439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1ef99-bc87-4a2e-bbfe-729b50dcd8e7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:19.231747 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1ef99-bc87-4a2e-bbfe-729b50dcd8e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:19.233186 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1ef99-bc87-4a2e-bbfe-729b50dcd8e7 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:19.247718 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 380/756] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Jul 27 08:51:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:51:19.260028 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1ef99-bc87-4a2e-bbfe-729b50dcd8e7 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:19.381215 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdebf8-709c-41b6-b7a1-5c584ab232b5 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:19.400882 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:19.417454 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:19.465052 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49c8eb-a786-4836-8e95-342d6d55d9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:19.465718 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49c8eb-a786-4836-8e95-342d6d55d9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:19.466004 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49c8eb-a786-4836-8e95-342d6d55d9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:19.466279 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49c8eb-a786-4836-8e95-342d6d55d9d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:19.467100 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49c8eb-a786-4836-8e95-342d6d55d9d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:19.467415 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49c8eb-a786-4836-8e95-342d6d55d9d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:19.468948 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49c8eb-a786-4836-8e95-342d6d55d9d5 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:19.498820 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 377/757] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:51:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:19.499799 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49c8eb-a786-4836-8e95-342d6d55d9d5 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:19.513248 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1ef99-bc87-4a2e-bbfe-729b50dcd8e7 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:19.599440 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d07c4-74ef-4045-9505-29c0665f0b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:19.600086 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d07c4-74ef-4045-9505-29c0665f0b39 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:19.600369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d07c4-74ef-4045-9505-29c0665f0b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:19.600646 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d07c4-74ef-4045-9505-29c0665f0b39 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:19.601428 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d07c4-74ef-4045-9505-29c0665f0b39 None admin] RBAC: Adding query filter params (interface=public, service_id=59261534445f4c7fbdc9a9e05f8c16cf, region_id=RegionOne) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:19.601741 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d07c4-74ef-4045-9505-29c0665f0b39 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:19.603351 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d07c4-74ef-4045-9505-29c0665f0b39 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:19.620758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 381/758] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Jul 27 08:51:19 2022] GET /identity/v3/endpoints?service_id=59261534445f4c7fbdc9a9e05f8c16cf&interface=public®ion_id=RegionOne => generated 194 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:19.629353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d07c4-74ef-4045-9505-29c0665f0b39 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:19.672402 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49c8eb-a786-4836-8e95-342d6d55d9d5 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:19.752461 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fe24c-7d47-4ca5-88fa-62a9e0d4c216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:19.753093 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fe24c-7d47-4ca5-88fa-62a9e0d4c216 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:19.753375 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fe24c-7d47-4ca5-88fa-62a9e0d4c216 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:19.753656 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fe24c-7d47-4ca5-88fa-62a9e0d4c216 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:19.754506 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70fe24c-7d47-4ca5-88fa-62a9e0d4c216 None admin] RBAC: Adding query filter params (role.id=20bc872844094480b9dca67a25b69e84, scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267, user.id=158ea5c9dd5142eebd903d5f732997ad) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:19.754820 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70fe24c-7d47-4ca5-88fa-62a9e0d4c216 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:19.756286 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70fe24c-7d47-4ca5-88fa-62a9e0d4c216 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:19.777631 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 378/759] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:51:19 2022] GET /identity/v3/role_assignments?user.id=158ea5c9dd5142eebd903d5f732997ad&scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267&role.id=20bc872844094480b9dca67a25b69e84 => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:19.812903 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d07c4-74ef-4045-9505-29c0665f0b39 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:19.839752 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:19.888643 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2b30b-7cdb-4fde-8065-b26413366d8f None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:19.888963 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2b30b-7cdb-4fde-8065-b26413366d8f None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:19.889209 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2b30b-7cdb-4fde-8065-b26413366d8f None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:19.890403 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3dcf5-13e3-4ad1-b612-17968540a1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:19.890769 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 379/760] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:51:19.891111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3dcf5-13e3-4ad1-b612-17968540a1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:19.891400 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3dcf5-13e3-4ad1-b612-17968540a1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:19.891678 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3dcf5-13e3-4ad1-b612-17968540a1b1 None admin] PATH_INFO: `/v3/services` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:19.892426 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd3dcf5-13e3-4ad1-b612-17968540a1b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:19.893901 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd3dcf5-13e3-4ad1-b612-17968540a1b1 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:19.901554 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 382/761] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Jul 27 08:51:19 2022] GET /identity/v3/services => generated 772 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:19.909555 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4de7a7-02a1-45b3-a3da-c9bf76e96561 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:19.910039 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4de7a7-02a1-45b3-a3da-c9bf76e96561 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:19.910489 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4de7a7-02a1-45b3-a3da-c9bf76e96561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:19.958454 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-1f4de7a7-02a1-45b3-a3da-c9bf76e96561 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:19.960336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1f4de7a7-02a1-45b3-a3da-c9bf76e96561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:20.041310 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:20.099023 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 380/762] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:51:20.139648 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3dcf5-13e3-4ad1-b612-17968540a1b1 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:20.335128 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3dcf5-13e3-4ad1-b612-17968540a1b1 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:20.399739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d77968-010a-46ee-8b7c-455f9d5c0320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:20.400863 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d77968-010a-46ee-8b7c-455f9d5c0320 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:20.401366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d77968-010a-46ee-8b7c-455f9d5c0320 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:20.401919 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d77968-010a-46ee-8b7c-455f9d5c0320 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:20.422978 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d77968-010a-46ee-8b7c-455f9d5c0320 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:51:20.430181 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-42d77968-010a-46ee-8b7c-455f9d5c0320 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:51:20.430181 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:20.430181 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:20.430181 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:20.430181 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:20.430181 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:20.430181 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:20.430181 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:20.430181 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:20.430181 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:20.430181 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:20.430181 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:20.430181 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:51:20.430181 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:51:20.430181 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:51:20.430181 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:51:20.432016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:51:20.432016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:51:20.432016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:51:20.432016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:51:20.432016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:20.432016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:20.432016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:20.432016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:20.432016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:20.432016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:20.432016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:20.432016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:20.432016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:20.432016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:20.432016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:20.432016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:20.433059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:20.433059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:20.433059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:20.433059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:20.433059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:51:20.433059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:51:20.433059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:51:20.433059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:51:20.433059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:51:20.433059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:51:20.433059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:51:20.433059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:20.433059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 383/763] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:51:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:20.439607 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4de7a7-02a1-45b3-a3da-c9bf76e96561 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:20.545518 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c2903-464e-462e-a94a-911e16711d50 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:20.545948 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c2903-464e-462e-a94a-911e16711d50 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:20.546232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c2903-464e-462e-a94a-911e16711d50 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:20.548417 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 384/764] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:51:20.555331 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06274792-451b-44a6-a920-010b0092c01d None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:20.555695 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06274792-451b-44a6-a920-010b0092c01d None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:20.556576 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06274792-451b-44a6-a920-010b0092c01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:20.580091 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-06274792-451b-44a6-a920-010b0092c01d None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:20.581773 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-06274792-451b-44a6-a920-010b0092c01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:20.661255 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4de7a7-02a1-45b3-a3da-c9bf76e96561 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:20.715122 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784c533-34fa-485c-b3c8-9e42a3a16cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:20.716125 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784c533-34fa-485c-b3c8-9e42a3a16cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:20.716605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784c533-34fa-485c-b3c8-9e42a3a16cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:20.717095 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784c533-34fa-485c-b3c8-9e42a3a16cc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:20.718054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784c533-34fa-485c-b3c8-9e42a3a16cc6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:20.718598 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784c533-34fa-485c-b3c8-9e42a3a16cc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:20.719816 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:20.720494 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784c533-34fa-485c-b3c8-9e42a3a16cc6 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:20.735297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 381/765] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:51:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:20.738776 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 385/766] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:51:20.745275 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784c533-34fa-485c-b3c8-9e42a3a16cc6 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:20.779513 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06274792-451b-44a6-a920-010b0092c01d None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:20.804905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:20.943901 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06274792-451b-44a6-a920-010b0092c01d None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:20.987744 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c9b51-8167-44fa-ab02-e2324af2416d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:20.988403 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c9b51-8167-44fa-ab02-e2324af2416d None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:20.988696 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c9b51-8167-44fa-ab02-e2324af2416d None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:20.988959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c9b51-8167-44fa-ab02-e2324af2416d None admin] PATH_INFO: `/v3/services/network` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:20.989621 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c9b51-8167-44fa-ab02-e2324af2416d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:20.991092 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c9b51-8167-44fa-ab02-e2324af2416d None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:20.991740 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784c533-34fa-485c-b3c8-9e42a3a16cc6 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:21.003265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-350c9b51-8167-44fa-ab02-e2324af2416d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 08:51:21.003265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:21.003265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:51:21.003265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:51:21.003265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:51:21.003265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:51:21.003265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:51:21.003265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:21.003265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 08:51:21.003265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:21.003265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:51:21.003265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:21.003265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:21.003265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:21.003265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:21.003265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:21.003265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:21.004553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:21.004553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:21.004553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:21.004553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:21.004553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:21.004553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:21.004553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:51:21.004553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:51:21.004553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:51:21.004553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:51:21.004553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:21.004553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:21.004553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:21.004553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:21.004553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:21.004553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:21.005861 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:21.005861 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:21.005861 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:21.005861 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:21.005861 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:21.005861 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:21.005861 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:21.005861 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:21.005861 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:21.005861 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:21.005861 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:51:21.005861 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:21.005861 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 08:51:21.005861 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:21.008570 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 386/767] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:51:20 2022] GET /identity/v3/services/network => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:21.015505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5693a0-2597-44d0-9813-a000367770bf None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:21.015505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5693a0-2597-44d0-9813-a000367770bf None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:21.015505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5693a0-2597-44d0-9813-a000367770bf None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:21.022504 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 387/768] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:21.022504 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5693a0-2597-44d0-9813-a000367770bf None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:21.068593 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:21.069057 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9f1f4-225d-498e-b503-c1211f3a0c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:21.072074 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9f1f4-225d-498e-b503-c1211f3a0c98 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:21.072650 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9f1f4-225d-498e-b503-c1211f3a0c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:21.073209 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9f1f4-225d-498e-b503-c1211f3a0c98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:21.088771 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9f1f4-225d-498e-b503-c1211f3a0c98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:21.091388 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9f1f4-225d-498e-b503-c1211f3a0c98 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:21.111208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-46e9f1f4-225d-498e-b503-c1211f3a0c98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:21.111208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:21.111208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:21.111208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:21.111208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:21.111208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:21.111208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:21.111208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:21.111208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:21.111208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:21.111208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:21.111208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:21.111208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:21.111208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:21.111208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:21.112180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:21.112180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:21.112180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:21.112180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:21.112180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:21.112180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:21.112180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:21.112180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:21.112180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:21.112180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:21.112180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:21.112180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:21.112180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:21.112180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:21.112180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:21.112180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:21.112180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:21.113529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:21.113529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:21.113529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:21.113529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:21.117390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 382/769] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:51:21.119574 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f6514-2075-440e-adbb-4c2820c093d1 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:21.119941 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f6514-2075-440e-adbb-4c2820c093d1 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:21.120544 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f6514-2075-440e-adbb-4c2820c093d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:21.139844 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-8e8f6514-2075-440e-adbb-4c2820c093d1 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:21.141151 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-8e8f6514-2075-440e-adbb-4c2820c093d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:21.178953 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5693a0-2597-44d0-9813-a000367770bf None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:21.226060 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893b9dc-2be2-4375-afa2-e936b71f41bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:21.226996 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893b9dc-2be2-4375-afa2-e936b71f41bb None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:21.227456 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893b9dc-2be2-4375-afa2-e936b71f41bb None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:21.228017 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893b9dc-2be2-4375-afa2-e936b71f41bb None admin] PATH_INFO: `/v3/services` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:21.229572 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893b9dc-2be2-4375-afa2-e936b71f41bb None admin] RBAC: Adding query filter params (name=network) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:21.230083 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893b9dc-2be2-4375-afa2-e936b71f41bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:21.232004 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893b9dc-2be2-4375-afa2-e936b71f41bb None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:21.239771 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 388/770] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 08:51:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:21.240980 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893b9dc-2be2-4375-afa2-e936b71f41bb None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:21.262172 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 383/771] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:51:21.262172 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f6514-2075-440e-adbb-4c2820c093d1 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:21.294738 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:21.430666 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f6514-2075-440e-adbb-4c2820c093d1 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:21.436905 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:21.446220 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893b9dc-2be2-4375-afa2-e936b71f41bb None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:21.493287 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424fe58-7ae9-4e14-936e-4f0213d32dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:21.494466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424fe58-7ae9-4e14-936e-4f0213d32dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:21.494466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424fe58-7ae9-4e14-936e-4f0213d32dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:21.494768 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424fe58-7ae9-4e14-936e-4f0213d32dc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:21.495359 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424fe58-7ae9-4e14-936e-4f0213d32dc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:21.495661 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424fe58-7ae9-4e14-936e-4f0213d32dc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:21.497392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424fe58-7ae9-4e14-936e-4f0213d32dc7 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:21.512222 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 389/772] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:21.513103 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424fe58-7ae9-4e14-936e-4f0213d32dc7 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:21.523835 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c10f2f-527e-4c68-8605-aee00a19ccba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:21.527491 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c10f2f-527e-4c68-8605-aee00a19ccba None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:21.529162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c10f2f-527e-4c68-8605-aee00a19ccba None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:21.530205 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c10f2f-527e-4c68-8605-aee00a19ccba None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:21.532066 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c10f2f-527e-4c68-8605-aee00a19ccba None admin] RBAC: Adding query filter params (type=network) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:21.533896 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c10f2f-527e-4c68-8605-aee00a19ccba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:21.537640 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c10f2f-527e-4c68-8605-aee00a19ccba None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:21.549297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 384/773] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 08:51:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:21.550908 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c10f2f-527e-4c68-8605-aee00a19ccba None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:21.662812 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424fe58-7ae9-4e14-936e-4f0213d32dc7 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:21.673545 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:21.709644 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c10f2f-527e-4c68-8605-aee00a19ccba None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:21.714697 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a86b3-0318-4ab0-8835-6afb0a4832d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:21.715618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a86b3-0318-4ab0-8835-6afb0a4832d6 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:21.716072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a86b3-0318-4ab0-8835-6afb0a4832d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:21.716514 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a86b3-0318-4ab0-8835-6afb0a4832d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:21.738863 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a86b3-0318-4ab0-8835-6afb0a4832d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:51:21.755444 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-054a86b3-0318-4ab0-8835-6afb0a4832d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:51:21.755444 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:21.755444 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:21.755444 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:21.755444 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:21.755444 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:21.755444 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:21.755444 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:21.755444 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:21.755444 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:21.755444 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:21.755444 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:21.755444 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:51:21.755444 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:51:21.755444 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:51:21.755444 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:51:21.757489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:51:21.757489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:51:21.757489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:51:21.757489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:51:21.757489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:21.757489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:21.757489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:21.757489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:21.757489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:21.757489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:21.757489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:21.757489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:21.757489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:21.757489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:21.757489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:21.757489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:21.759531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:21.759531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:21.759531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:21.759531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:21.759531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:51:21.759531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:51:21.759531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:51:21.759531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:51:21.759531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:51:21.759531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:51:21.759531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:51:21.759531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:21.762996 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a6fdd-d08e-4783-af15-6bbf11cd8c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:21.763783 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a6fdd-d08e-4783-af15-6bbf11cd8c5d None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:21.764156 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a6fdd-d08e-4783-af15-6bbf11cd8c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:21.764591 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a6fdd-d08e-4783-af15-6bbf11cd8c5d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:21.770585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 390/774] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 08:51:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:21.771507 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a86b3-0318-4ab0-8835-6afb0a4832d6 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:21.788879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a6fdd-d08e-4783-af15-6bbf11cd8c5d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:21.791666 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a6fdd-d08e-4783-af15-6bbf11cd8c5d None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:21.797436 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:21.810918 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-2f2a6fdd-d08e-4783-af15-6bbf11cd8c5d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:51:21.810918 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:21.810918 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:21.810918 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:21.810918 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:21.810918 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:21.810918 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:21.810918 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:21.810918 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:21.810918 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:21.810918 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:21.810918 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:21.810918 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:51:21.810918 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:51:21.810918 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:51:21.810918 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:51:21.811970 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:21.811970 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:21.811970 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:51:21.811970 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:21.811970 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:51:21.811970 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:21.811970 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:21.811970 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:21.811970 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:21.811970 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:21.811970 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:21.811970 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:21.811970 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:21.811970 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:21.811970 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:21.811970 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:21.811970 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:21.811970 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:21.813361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:21.813361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:21.813361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:51:21.813361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:51:21.813361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:51:21.813361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:51:21.813361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:51:21.813361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:51:21.813361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:51:21.813361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:21.813361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 385/775] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Jul 27 08:51:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:21.813361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a6fdd-d08e-4783-af15-6bbf11cd8c5d None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:21.928449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a86b3-0318-4ab0-8835-6afb0a4832d6 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:21.974602 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a6fdd-d08e-4783-af15-6bbf11cd8c5d None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:21.975420 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353443c-b875-4579-8725-3c193abb142a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:21.976609 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353443c-b875-4579-8725-3c193abb142a None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:21.978225 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353443c-b875-4579-8725-3c193abb142a None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:21.978778 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353443c-b875-4579-8725-3c193abb142a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:21.979830 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353443c-b875-4579-8725-3c193abb142a None admin] RBAC: Adding query filter params (interface=public, service_id=3324aeef32f147e2845ac3ed7e6f2d81, region_id=RegionOne) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:21.980372 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353443c-b875-4579-8725-3c193abb142a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:21.982009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353443c-b875-4579-8725-3c193abb142a None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:21.990720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 391/776] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Jul 27 08:51:21 2022] GET /identity/v3/endpoints?service_id=3324aeef32f147e2845ac3ed7e6f2d81&interface=public®ion_id=RegionOne => generated 194 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:21.992698 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353443c-b875-4579-8725-3c193abb142a None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:22.058129 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d975ba-8cbe-4332-9257-fd646ceb3082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:22.059500 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d975ba-8cbe-4332-9257-fd646ceb3082 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:22.060074 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d975ba-8cbe-4332-9257-fd646ceb3082 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:22.060727 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d975ba-8cbe-4332-9257-fd646ceb3082 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:22.062229 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d975ba-8cbe-4332-9257-fd646ceb3082 None admin] RBAC: Adding query filter params (name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:22.063347 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d975ba-8cbe-4332-9257-fd646ceb3082 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:22.065733 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d975ba-8cbe-4332-9257-fd646ceb3082 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:22.071968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:22.090675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 386/777] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 08:51:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:22.092415 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d975ba-8cbe-4332-9257-fd646ceb3082 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:22.175995 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:22.223759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353443c-b875-4579-8725-3c193abb142a None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:22.281672 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d975ba-8cbe-4332-9257-fd646ceb3082 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:22.288733 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d734a4-c079-4b8e-ac3e-81f1d289ae32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:22.289577 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d734a4-c079-4b8e-ac3e-81f1d289ae32 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:22.290890 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d734a4-c079-4b8e-ac3e-81f1d289ae32 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:22.291317 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d734a4-c079-4b8e-ac3e-81f1d289ae32 None admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:22.292309 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d734a4-c079-4b8e-ac3e-81f1d289ae32 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:22.292774 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d734a4-c079-4b8e-ac3e-81f1d289ae32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:22.294413 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d734a4-c079-4b8e-ac3e-81f1d289ae32 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:22.317306 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 392/778] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Jul 27 08:51:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:22.318479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d734a4-c079-4b8e-ac3e-81f1d289ae32 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:22.332632 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0b09c-bdfc-4ba7-a7a8-72a8e39a5e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:22.333448 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0b09c-bdfc-4ba7-a7a8-72a8e39a5e77 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:22.333819 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0b09c-bdfc-4ba7-a7a8-72a8e39a5e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:22.334160 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0b09c-bdfc-4ba7-a7a8-72a8e39a5e77 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:22.334963 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0b09c-bdfc-4ba7-a7a8-72a8e39a5e77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:22.336569 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0b09c-bdfc-4ba7-a7a8-72a8e39a5e77 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:22.343131 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 387/779] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Jul 27 08:51:22 2022] GET /identity/v3/services => generated 772 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:22.344318 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0b09c-bdfc-4ba7-a7a8-72a8e39a5e77 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:22.419795 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:22.449683 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d734a4-c079-4b8e-ac3e-81f1d289ae32 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:22.486227 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0b09c-bdfc-4ba7-a7a8-72a8e39a5e77 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:22.529543 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7e3e4-dad1-4581-a07b-35a79d2d3ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:22.530535 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7e3e4-dad1-4581-a07b-35a79d2d3ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:22.530535 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7e3e4-dad1-4581-a07b-35a79d2d3ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:22.530816 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7e3e4-dad1-4581-a07b-35a79d2d3ff4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:22.552973 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297a235-0b9e-4047-9de7-d1b0c67d23aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:22.554111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297a235-0b9e-4047-9de7-d1b0c67d23aa None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:22.554570 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297a235-0b9e-4047-9de7-d1b0c67d23aa None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:22.555062 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297a235-0b9e-4047-9de7-d1b0c67d23aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:22.564907 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:22.577223 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef7e3e4-dad1-4581-a07b-35a79d2d3ff4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:22.578945 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef7e3e4-dad1-4581-a07b-35a79d2d3ff4 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:22.594734 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297a235-0b9e-4047-9de7-d1b0c67d23aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:22.597161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297a235-0b9e-4047-9de7-d1b0c67d23aa None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:22.614154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-6ef7e3e4-dad1-4581-a07b-35a79d2d3ff4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:22.614154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:22.614154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:22.614154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:22.614154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:22.614154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:22.614154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:22.614154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:22.614154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:22.614154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:22.614154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:22.614154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:22.614154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:22.614154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:22.614154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:22.615250 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:22.615250 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:22.615250 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:22.615250 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:22.615250 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:22.615250 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:22.615250 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:22.615250 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:22.615250 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:22.615250 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:22.615250 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:22.615250 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:22.615250 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:22.615250 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:22.615250 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:22.615250 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:22.615250 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:22.616162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:22.616162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:22.616162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:22.616162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:22.616162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 388/780] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:22.623192 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7e3e4-dad1-4581-a07b-35a79d2d3ff4 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:22.627532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-9297a235-0b9e-4047-9de7-d1b0c67d23aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:22.627532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:22.627532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:22.627532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:22.627532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:22.627532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:22.627532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:22.627532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:22.627532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:22.627532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:22.627532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:22.627532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:22.627532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:22.627532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:22.627532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:22.628490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:22.628490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:22.628490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:22.628490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:22.628490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:22.628490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:22.628490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:22.628490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:22.628490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:22.628490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:22.628490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:22.628490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:22.628490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:22.628490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:22.628490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:22.628490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:22.628490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:22.630077 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:22.630077 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:22.630077 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:22.630077 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:22.630077 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 393/781] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:22.634982 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297a235-0b9e-4047-9de7-d1b0c67d23aa None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:22.783849 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7e3e4-dad1-4581-a07b-35a79d2d3ff4 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:22.791601 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297a235-0b9e-4047-9de7-d1b0c67d23aa None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:22.800785 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:22.831895 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1d088-cc03-4875-8cb8-6543b2768f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:22.832879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1d088-cc03-4875-8cb8-6543b2768f0b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:22.833453 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1d088-cc03-4875-8cb8-6543b2768f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:22.833947 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1d088-cc03-4875-8cb8-6543b2768f0b None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:22.835320 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c1d088-cc03-4875-8cb8-6543b2768f0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:22.835865 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c1d088-cc03-4875-8cb8-6543b2768f0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:22.838278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4160fc-62ee-4eca-8c53-7bd9ba7f841e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:22.838453 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c1d088-cc03-4875-8cb8-6543b2768f0b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:22.839346 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4160fc-62ee-4eca-8c53-7bd9ba7f841e None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:22.839838 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4160fc-62ee-4eca-8c53-7bd9ba7f841e None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:22.840331 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4160fc-62ee-4eca-8c53-7bd9ba7f841e None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:22.841611 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4160fc-62ee-4eca-8c53-7bd9ba7f841e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:22.842162 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4160fc-62ee-4eca-8c53-7bd9ba7f841e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:22.844460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4160fc-62ee-4eca-8c53-7bd9ba7f841e None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:22.862767 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 389/782] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:51:22.864485 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524efa5-5382-496a-bbef-9ae1f6b0f3b1 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:22.864984 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524efa5-5382-496a-bbef-9ae1f6b0f3b1 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:22.865473 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524efa5-5382-496a-bbef-9ae1f6b0f3b1 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:22.868582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 390/783] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:22.870971 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524efa5-5382-496a-bbef-9ae1f6b0f3b1 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:22.874732 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 394/784] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:51:22.885408 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b7bb1-5ae0-4f15-bc45-907329e62eeb None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:22.885917 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b7bb1-5ae0-4f15-bc45-907329e62eeb None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:22.886434 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b7bb1-5ae0-4f15-bc45-907329e62eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:22.918304 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-a13b7bb1-5ae0-4f15-bc45-907329e62eeb None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:22.920496 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-a13b7bb1-5ae0-4f15-bc45-907329e62eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:22.997059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:23.046345 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 395/785] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:51:23.046345 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b7bb1-5ae0-4f15-bc45-907329e62eeb None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:23.065613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524efa5-5382-496a-bbef-9ae1f6b0f3b1 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:23.110989 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c12d6-bcc5-49f7-8fa9-17c7f4ec3600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:23.111515 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c12d6-bcc5-49f7-8fa9-17c7f4ec3600 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:23.111791 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c12d6-bcc5-49f7-8fa9-17c7f4ec3600 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:23.112060 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c12d6-bcc5-49f7-8fa9-17c7f4ec3600 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:23.124098 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c12d6-bcc5-49f7-8fa9-17c7f4ec3600 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:23.125510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c12d6-bcc5-49f7-8fa9-17c7f4ec3600 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:23.139442 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-e87c12d6-bcc5-49f7-8fa9-17c7f4ec3600 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:23.139442 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:23.139442 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:23.139442 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:23.139442 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:23.139442 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:23.139442 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:23.139442 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:23.139442 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:23.139442 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:23.139442 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:23.139442 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:23.139442 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:51:23.139442 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:51:23.139442 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:51:23.141021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:51:23.141021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:23.141021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:23.141021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:23.141021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:23.141021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:23.141021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:23.141021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:23.141021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:23.141021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:23.141021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:23.141021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:23.141021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:23.141021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:23.141021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:23.141021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:23.141021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:23.142958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:51:23.142958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:51:23.142958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:51:23.142958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:51:23.142958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:51:23.142958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:51:23.142958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:23.142958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:23.145523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 391/786] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:51:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:51:23.146932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791cca8-15c1-4c86-bfb9-e4ca880ef8b8 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:23.147225 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791cca8-15c1-4c86-bfb9-e4ca880ef8b8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:23.147497 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791cca8-15c1-4c86-bfb9-e4ca880ef8b8 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:23.154660 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 392/787] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:23.154660 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791cca8-15c1-4c86-bfb9-e4ca880ef8b8 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:23.211019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:23.222076 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b7bb1-5ae0-4f15-bc45-907329e62eeb None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:23.265150 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20be25-86c0-47f7-9438-85d8702a9a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:23.265913 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20be25-86c0-47f7-9438-85d8702a9a46 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:23.266195 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20be25-86c0-47f7-9438-85d8702a9a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:23.266507 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20be25-86c0-47f7-9438-85d8702a9a46 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:23.276594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20be25-86c0-47f7-9438-85d8702a9a46 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:23.278072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20be25-86c0-47f7-9438-85d8702a9a46 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:23.291631 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-9a20be25-86c0-47f7-9438-85d8702a9a46 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 08:51:23.291631 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:23.291631 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:23.291631 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:23.291631 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:23.291631 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:23.291631 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:23.291631 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:23.291631 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:23.291631 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:23.291631 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:23.291631 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:23.291631 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:51:23.291631 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:51:23.291631 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:51:23.291631 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:51:23.292800 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:23.292800 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:23.292800 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:51:23.292800 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:23.292800 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:51:23.292800 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:23.292800 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:23.292800 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:23.292800 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:23.292800 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:23.292800 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:23.292800 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:23.292800 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:23.292800 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:23.292800 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:23.292800 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:23.292800 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:23.292800 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:23.293974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:23.293974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:23.293974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:51:23.293974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:51:23.293974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:51:23.293974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:51:23.293974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:51:23.293974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:51:23.293974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 08:51:23.293974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:23.296766 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791cca8-15c1-4c86-bfb9-e4ca880ef8b8 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:23.297604 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 396/788] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Jul 27 08:51:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:23.298547 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20be25-86c0-47f7-9438-85d8702a9a46 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:23.355733 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:23.363749 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cc5a3-05ec-405b-b73a-8a44a3e26515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:23.364516 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cc5a3-05ec-405b-b73a-8a44a3e26515 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:23.364803 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cc5a3-05ec-405b-b73a-8a44a3e26515 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:23.365081 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cc5a3-05ec-405b-b73a-8a44a3e26515 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:23.380205 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882cc5a3-05ec-405b-b73a-8a44a3e26515 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:51:23.386184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-882cc5a3-05ec-405b-b73a-8a44a3e26515 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:51:23.386184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:23.386184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:23.386184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:23.386184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:23.386184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:23.386184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:23.386184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:23.386184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:23.386184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:23.386184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:23.386184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:23.386184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:51:23.386184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:51:23.386184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:51:23.386184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:51:23.388111 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:51:23.388111 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:51:23.388111 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:51:23.388111 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:51:23.388111 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:23.388111 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:23.388111 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:23.388111 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:23.388111 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:23.388111 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:23.388111 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:23.388111 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:23.388111 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:23.388111 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:23.388111 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:23.388111 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:23.389809 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:23.389809 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:23.389809 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:23.389809 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:23.389809 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:51:23.389809 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:51:23.389809 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:51:23.389809 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:51:23.389809 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:51:23.389809 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:51:23.389809 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:51:23.389809 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:23.389809 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 393/789] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:51:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:23.389809 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9129f-76fc-4527-85c7-bb09af777ef7 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:23.394390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9129f-76fc-4527-85c7-bb09af777ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:23.394390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9129f-76fc-4527-85c7-bb09af777ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:23.412088 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-afb9129f-76fc-4527-85c7-bb09af777ef7 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:23.414025 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-afb9129f-76fc-4527-85c7-bb09af777ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:23.450007 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20be25-86c0-47f7-9438-85d8702a9a46 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:23.496507 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c783e6-5536-45ba-be4e-e05a46538eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:23.502371 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 394/790] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:51:23.502566 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c783e6-5536-45ba-be4e-e05a46538eee None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:23.502566 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c783e6-5536-45ba-be4e-e05a46538eee None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:23.502730 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9129f-76fc-4527-85c7-bb09af777ef7 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:23.502847 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c783e6-5536-45ba-be4e-e05a46538eee None admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:23.502847 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c783e6-5536-45ba-be4e-e05a46538eee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:23.502847 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c783e6-5536-45ba-be4e-e05a46538eee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:23.510394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c783e6-5536-45ba-be4e-e05a46538eee None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:23.530409 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 397/791] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:51:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:23.531460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c783e6-5536-45ba-be4e-e05a46538eee None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:23.537248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:23.635577 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9129f-76fc-4527-85c7-bb09af777ef7 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:23.662723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:23.668452 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c783e6-5536-45ba-be4e-e05a46538eee None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:23.683732 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76482e37-35e3-4f0f-8365-5a090db84e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:23.684367 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76482e37-35e3-4f0f-8365-5a090db84e22 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:23.684674 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76482e37-35e3-4f0f-8365-5a090db84e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:23.684926 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76482e37-35e3-4f0f-8365-5a090db84e22 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:23.685746 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76482e37-35e3-4f0f-8365-5a090db84e22 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:23.686123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76482e37-35e3-4f0f-8365-5a090db84e22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:23.687698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76482e37-35e3-4f0f-8365-5a090db84e22 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:23.710991 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 395/792] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Jul 27 08:51:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:23.711887 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76482e37-35e3-4f0f-8365-5a090db84e22 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:23.719331 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17994b67-62da-4d00-b5eb-c259931d3c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:23.719967 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17994b67-62da-4d00-b5eb-c259931d3c9d None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:23.720253 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17994b67-62da-4d00-b5eb-c259931d3c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:23.720516 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17994b67-62da-4d00-b5eb-c259931d3c9d None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:23.721258 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17994b67-62da-4d00-b5eb-c259931d3c9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:23.721561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17994b67-62da-4d00-b5eb-c259931d3c9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:23.723009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17994b67-62da-4d00-b5eb-c259931d3c9d None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:23.738779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 398/793] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:51:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:23.738779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17994b67-62da-4d00-b5eb-c259931d3c9d None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:23.827692 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:23.858001 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17994b67-62da-4d00-b5eb-c259931d3c9d None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:23.859530 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76482e37-35e3-4f0f-8365-5a090db84e22 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:23.895709 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0021869-2374-4587-b7c2-f69fb768f289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:23.896307 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0021869-2374-4587-b7c2-f69fb768f289 None admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:23.896591 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0021869-2374-4587-b7c2-f69fb768f289 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:23.896874 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0021869-2374-4587-b7c2-f69fb768f289 None admin] PATH_INFO: `/v3/projects/3f77fdd017ea4a9b9b49f6e87ba7f267/users/c30bc55c6a1348bb961f0d010422da87/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:23.899031 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0021869-2374-4587-b7c2-f69fb768f289 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f77fdd017ea4a9b9b49f6e87ba7f267, user_id=c30bc55c6a1348bb961f0d010422da87, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:23.901153 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0021869-2374-4587-b7c2-f69fb768f289 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:23.926358 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 399/794] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 08:51:23 2022] PUT /identity/v3/projects/3f77fdd017ea4a9b9b49f6e87ba7f267/users/c30bc55c6a1348bb961f0d010422da87/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:51:23.926358 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0021869-2374-4587-b7c2-f69fb768f289 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:23.933080 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a987c-54b9-463d-9496-892ba9b9a105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:23.934063 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a987c-54b9-463d-9496-892ba9b9a105 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:23.934567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a987c-54b9-463d-9496-892ba9b9a105 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:23.935097 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a987c-54b9-463d-9496-892ba9b9a105 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:23.936388 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a987c-54b9-463d-9496-892ba9b9a105 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:23.939100 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a987c-54b9-463d-9496-892ba9b9a105 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:23.956652 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-541a987c-54b9-463d-9496-892ba9b9a105 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 08:51:23.956652 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:23.956652 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:51:23.956652 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:51:23.956652 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:51:23.956652 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:51:23.956652 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:51:23.956652 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:23.956652 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 08:51:23.956652 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:23.956652 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:51:23.956652 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:23.956652 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:23.956652 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:23.956652 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:23.956652 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:23.958577 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:23.958577 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:23.958577 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:23.958577 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:23.958577 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:23.958577 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:23.958577 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:23.958577 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:51:23.958577 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:51:23.958577 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:51:23.958577 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:51:23.958577 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:23.958577 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:23.958577 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:23.958577 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:23.958577 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:23.960240 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:23.960240 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:23.960240 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:23.960240 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:23.960240 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:23.960240 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:23.960240 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:23.960240 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:23.960240 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:23.960240 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:23.960240 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:23.960240 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:51:23.960240 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:23.960240 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 08:51:23.960240 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:23.967133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 396/795] 10.222.0.65 () {56 vars in 1129 bytes} [Wed Jul 27 08:51:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:23.968658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a987c-54b9-463d-9496-892ba9b9a105 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:23.985845 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:24.130728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0021869-2374-4587-b7c2-f69fb768f289 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:24.160803 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a987c-54b9-463d-9496-892ba9b9a105 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:24.198205 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ef4b1-eafc-4882-9f6d-3e6f1487ff80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:24.198903 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ef4b1-eafc-4882-9f6d-3e6f1487ff80 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:24.199172 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ef4b1-eafc-4882-9f6d-3e6f1487ff80 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:24.199445 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ef4b1-eafc-4882-9f6d-3e6f1487ff80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:24.211822 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ef4b1-eafc-4882-9f6d-3e6f1487ff80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:24.213588 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ef4b1-eafc-4882-9f6d-3e6f1487ff80 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:24.218956 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27555849-5f55-46f3-94f9-dea705541277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:24.220078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27555849-5f55-46f3-94f9-dea705541277 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:24.220470 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27555849-5f55-46f3-94f9-dea705541277 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:24.220944 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27555849-5f55-46f3-94f9-dea705541277 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:24.231864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-723ef4b1-eafc-4882-9f6d-3e6f1487ff80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:24.231864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:24.231864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:24.231864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:24.231864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:24.231864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:24.231864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:24.231864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:24.231864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:24.231864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:24.231864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:24.231864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:24.231864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:24.231864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:24.231864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:24.233592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:24.233592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:24.233592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:24.233592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:24.233592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:24.233592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:24.233592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:24.233592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:24.233592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:24.233592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:24.233592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:24.233592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:24.233592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:24.233592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:24.233592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:24.233592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:24.233592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:24.235969 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:24.235969 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:24.235969 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:24.235969 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:24.235969 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 400/796] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:24.235969 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ef4b1-eafc-4882-9f6d-3e6f1487ff80 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:24.246139 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27555849-5f55-46f3-94f9-dea705541277 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:24.247572 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27555849-5f55-46f3-94f9-dea705541277 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:24.256568 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:24.268437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-27555849-5f55-46f3-94f9-dea705541277 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:24.268437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:24.268437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:24.268437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:24.268437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:24.268437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:24.268437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:24.268437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:24.268437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:24.268437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:24.268437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:24.268437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:24.268437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:24.268437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:24.268437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:24.270512 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:24.270512 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:24.270512 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:24.270512 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:24.270512 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:24.270512 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:24.270512 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:24.270512 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:24.270512 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:24.270512 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:24.270512 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:24.270512 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:24.270512 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:24.270512 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:24.270512 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:24.270512 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:24.270512 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:24.272343 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:24.272343 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:24.272343 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:24.272343 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:24.275893 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 397/797] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:24.276401 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27555849-5f55-46f3-94f9-dea705541277 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:24.338579 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:24.377175 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ef4b1-eafc-4882-9f6d-3e6f1487ff80 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:24.427186 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67e1b6-cd9a-4ae7-9679-b32e80140f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:24.427704 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67e1b6-cd9a-4ae7-9679-b32e80140f13 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:24.427987 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67e1b6-cd9a-4ae7-9679-b32e80140f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:24.428260 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67e1b6-cd9a-4ae7-9679-b32e80140f13 None admin] PATH_INFO: `/v3/services` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:24.428931 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67e1b6-cd9a-4ae7-9679-b32e80140f13 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:24.429232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67e1b6-cd9a-4ae7-9679-b32e80140f13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:24.430647 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67e1b6-cd9a-4ae7-9679-b32e80140f13 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:24.436871 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 401/798] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Jul 27 08:51:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:24.437739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67e1b6-cd9a-4ae7-9679-b32e80140f13 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:24.498840 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27555849-5f55-46f3-94f9-dea705541277 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:24.545284 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5922ab-4d85-476f-8b51-a745af190350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:24.546371 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5922ab-4d85-476f-8b51-a745af190350 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:24.546939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5922ab-4d85-476f-8b51-a745af190350 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:24.547430 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5922ab-4d85-476f-8b51-a745af190350 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:24.548637 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5922ab-4d85-476f-8b51-a745af190350 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:24.549182 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5922ab-4d85-476f-8b51-a745af190350 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:24.552118 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5922ab-4d85-476f-8b51-a745af190350 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:24.574848 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 398/799] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:24.576335 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5922ab-4d85-476f-8b51-a745af190350 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:24.584419 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67e1b6-cd9a-4ae7-9679-b32e80140f13 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:24.631267 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f1394-873c-45c7-93ee-d167c94d9946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:24.632020 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f1394-873c-45c7-93ee-d167c94d9946 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:24.632422 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f1394-873c-45c7-93ee-d167c94d9946 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:24.632700 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f1394-873c-45c7-93ee-d167c94d9946 None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:24.633426 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f1394-873c-45c7-93ee-d167c94d9946 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:24.633731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f1394-873c-45c7-93ee-d167c94d9946 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:24.635766 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f1394-873c-45c7-93ee-d167c94d9946 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:24.640226 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:24.663410 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 402/800] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:24.665360 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f1394-873c-45c7-93ee-d167c94d9946 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:24.678431 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:24.759189 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5922ab-4d85-476f-8b51-a745af190350 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:24.813156 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982a68c-e2a9-4e54-9081-c6092153a6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:24.814220 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982a68c-e2a9-4e54-9081-c6092153a6bc None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:24.814776 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982a68c-e2a9-4e54-9081-c6092153a6bc None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:24.815218 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982a68c-e2a9-4e54-9081-c6092153a6bc None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:24.816053 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982a68c-e2a9-4e54-9081-c6092153a6bc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:24.816505 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982a68c-e2a9-4e54-9081-c6092153a6bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:24.818042 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982a68c-e2a9-4e54-9081-c6092153a6bc None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:24.824534 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 399/801] 10.222.0.65 () {56 vars in 1124 bytes} [Wed Jul 27 08:51:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:24.825641 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982a68c-e2a9-4e54-9081-c6092153a6bc None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:24.855598 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f1394-873c-45c7-93ee-d167c94d9946 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:24.922371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540e6f9-421d-4671-b064-dd67a431faff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:24.923449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540e6f9-421d-4671-b064-dd67a431faff None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:24.923925 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540e6f9-421d-4671-b064-dd67a431faff None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:24.924434 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540e6f9-421d-4671-b064-dd67a431faff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:24.937511 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540e6f9-421d-4671-b064-dd67a431faff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:24.940265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540e6f9-421d-4671-b064-dd67a431faff None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:24.950487 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982a68c-e2a9-4e54-9081-c6092153a6bc None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:24.960878 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-a540e6f9-421d-4671-b064-dd67a431faff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:24.960878 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:24.960878 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:24.960878 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:24.960878 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:24.960878 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:24.960878 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:24.960878 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:24.960878 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:24.960878 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:24.960878 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:24.960878 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:24.960878 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:51:24.960878 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:51:24.960878 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:51:24.963099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:51:24.963099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:24.963099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:24.963099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:24.963099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:24.963099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:24.963099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:24.963099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:24.963099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:24.963099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:24.963099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:24.963099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:24.963099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:24.963099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:24.963099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:24.963099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:24.963099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:24.964725 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:51:24.964725 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:51:24.964725 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:51:24.964725 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:51:24.964725 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:51:24.964725 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:51:24.964725 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:24.964725 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:24.964725 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 403/802] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:51:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:24.967964 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f596efa-c3bb-432f-a6bf-f32e62884dda None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:24.967964 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f596efa-c3bb-432f-a6bf-f32e62884dda None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:24.967964 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f596efa-c3bb-432f-a6bf-f32e62884dda None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:24.970907 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 404/803] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:24.972705 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f596efa-c3bb-432f-a6bf-f32e62884dda None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:24.987484 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:25.004486 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321571a-fcf4-40e6-bb17-9b5f812de936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:25.005170 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321571a-fcf4-40e6-bb17-9b5f812de936 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:25.005453 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321571a-fcf4-40e6-bb17-9b5f812de936 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:25.005726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321571a-fcf4-40e6-bb17-9b5f812de936 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:25.015452 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2321571a-fcf4-40e6-bb17-9b5f812de936 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:25.016978 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2321571a-fcf4-40e6-bb17-9b5f812de936 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:25.031246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-2321571a-fcf4-40e6-bb17-9b5f812de936 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 08:51:25.031246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:25.031246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:25.031246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:25.031246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:25.031246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:25.031246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:25.031246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:25.031246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:25.031246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:25.031246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:25.031246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:25.031246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:51:25.031246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:51:25.031246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:51:25.031246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:51:25.033000 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:25.033000 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:25.033000 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:51:25.033000 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:25.033000 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:51:25.033000 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:25.033000 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:25.033000 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:25.033000 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:25.033000 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:25.033000 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:25.033000 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:25.033000 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:25.033000 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:25.033000 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:25.033000 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:25.033000 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:25.033000 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:25.034877 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:25.034877 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:25.034877 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:51:25.034877 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:51:25.034877 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:51:25.034877 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:51:25.034877 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:51:25.034877 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:51:25.034877 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 08:51:25.034877 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:25.034877 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 400/804] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:51:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:25.034877 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321571a-fcf4-40e6-bb17-9b5f812de936 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:25.089858 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:25.177759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f596efa-c3bb-432f-a6bf-f32e62884dda None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:25.201682 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321571a-fcf4-40e6-bb17-9b5f812de936 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:25.244103 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffbe4bb-ca8f-49cc-b84d-483084659bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:25.244895 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbe4bb-ca8f-49cc-b84d-483084659bff None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:25.245166 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0bc70-3438-493e-8a99-b7bf9afea2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:25.245356 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbe4bb-ca8f-49cc-b84d-483084659bff None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:25.245732 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbe4bb-ca8f-49cc-b84d-483084659bff None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:25.246214 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0bc70-3438-493e-8a99-b7bf9afea2a3 None admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:25.246710 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0bc70-3438-493e-8a99-b7bf9afea2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:25.246872 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffbe4bb-ca8f-49cc-b84d-483084659bff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:25.247195 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0bc70-3438-493e-8a99-b7bf9afea2a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:25.247367 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffbe4bb-ca8f-49cc-b84d-483084659bff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:25.248479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea0bc70-3438-493e-8a99-b7bf9afea2a3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:25.248934 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffbe4bb-ca8f-49cc-b84d-483084659bff None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:25.251128 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea0bc70-3438-493e-8a99-b7bf9afea2a3 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:25.264486 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 401/805] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:51:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:25.267582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bba76d-1aef-4b7a-943b-c2aaebd0d9b2 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:25.267582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bba76d-1aef-4b7a-943b-c2aaebd0d9b2 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:25.267582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bba76d-1aef-4b7a-943b-c2aaebd0d9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:25.298362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f4bba76d-1aef-4b7a-943b-c2aaebd0d9b2 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:25.299557 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f4bba76d-1aef-4b7a-943b-c2aaebd0d9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:25.310459 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 405/806] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 08:51:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:51:25.310459 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0bc70-3438-493e-8a99-b7bf9afea2a3 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:25.356356 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:25.442163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 402/807] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:51:25.443837 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bba76d-1aef-4b7a-943b-c2aaebd0d9b2 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:25.520560 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0bc70-3438-493e-8a99-b7bf9afea2a3 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:25.537195 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:25.566364 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d0d80-d3f8-4564-ad07-db964eae5ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:25.567149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d0d80-d3f8-4564-ad07-db964eae5ebd None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:25.567505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d0d80-d3f8-4564-ad07-db964eae5ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:25.567851 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d0d80-d3f8-4564-ad07-db964eae5ebd None admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:25.568745 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d0d80-d3f8-4564-ad07-db964eae5ebd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:25.569128 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d0d80-d3f8-4564-ad07-db964eae5ebd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:25.571785 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d0d80-d3f8-4564-ad07-db964eae5ebd None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:25.597889 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 406/808] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Jul 27 08:51:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:25.599038 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d0d80-d3f8-4564-ad07-db964eae5ebd None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:25.674107 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bba76d-1aef-4b7a-943b-c2aaebd0d9b2 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:25.746303 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d0d80-d3f8-4564-ad07-db964eae5ebd None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:25.750676 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e271c-5b44-4cb5-9d82-cc97794949d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:25.751544 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e271c-5b44-4cb5-9d82-cc97794949d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:25.751827 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e271c-5b44-4cb5-9d82-cc97794949d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:25.752229 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e271c-5b44-4cb5-9d82-cc97794949d4 None admin] PATH_INFO: `/v3/projects/3f77fdd017ea4a9b9b49f6e87ba7f267/users/c607472800fc49d5a75c5e6acb33f2a2/roles/e476894ef72943f9b83d98d0704edfea` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:25.773049 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e271c-5b44-4cb5-9d82-cc97794949d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f77fdd017ea4a9b9b49f6e87ba7f267, user_id=c607472800fc49d5a75c5e6acb33f2a2, role_id=e476894ef72943f9b83d98d0704edfea)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:25.776113 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e271c-5b44-4cb5-9d82-cc97794949d4 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:25.785472 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc0068-4326-47d7-a66c-209e3c1bbe60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:25.786147 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc0068-4326-47d7-a66c-209e3c1bbe60 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:25.786524 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc0068-4326-47d7-a66c-209e3c1bbe60 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:25.786859 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc0068-4326-47d7-a66c-209e3c1bbe60 None admin] PATH_INFO: `/v3/services/network` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:25.787561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc0068-4326-47d7-a66c-209e3c1bbe60 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:25.789040 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc0068-4326-47d7-a66c-209e3c1bbe60 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:25.800450 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-95dc0068-4326-47d7-a66c-209e3c1bbe60 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 08:51:25.800450 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:25.800450 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:51:25.800450 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:51:25.800450 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:51:25.800450 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:51:25.800450 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:51:25.800450 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:25.800450 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 08:51:25.800450 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:25.800450 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:51:25.800450 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:25.800450 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:25.800450 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:25.800450 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:25.800450 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:25.800450 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:25.801890 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:25.801890 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:25.801890 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:25.801890 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:25.801890 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:25.801890 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:25.801890 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:51:25.801890 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:51:25.801890 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:51:25.801890 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:51:25.801890 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:25.801890 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:25.801890 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:25.801890 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:25.801890 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:25.801890 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:25.804030 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:25.804030 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:25.804030 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:25.804030 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:25.804030 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:25.804030 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:25.804030 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:25.804030 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:25.804030 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:25.804030 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:25.804030 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:51:25.804030 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:25.804030 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 08:51:25.804030 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:25.807144 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 407/809] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:51:25 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:25.808107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc0068-4326-47d7-a66c-209e3c1bbe60 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:25.808978 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 403/810] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 08:51:25 2022] PUT /identity/v3/projects/3f77fdd017ea4a9b9b49f6e87ba7f267/users/c607472800fc49d5a75c5e6acb33f2a2/roles/e476894ef72943f9b83d98d0704edfea => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:51:25.811144 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e271c-5b44-4cb5-9d82-cc97794949d4 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:25.848570 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:25.854091 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:25.955739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc0068-4326-47d7-a66c-209e3c1bbe60 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:26.018032 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e271c-5b44-4cb5-9d82-cc97794949d4 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:26.038650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb0459-85a4-4953-ac8a-11cc9442c811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:26.039565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb0459-85a4-4953-ac8a-11cc9442c811 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:26.040020 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb0459-85a4-4953-ac8a-11cc9442c811 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:26.041011 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb0459-85a4-4953-ac8a-11cc9442c811 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:26.060234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb0459-85a4-4953-ac8a-11cc9442c811 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:26.062852 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb0459-85a4-4953-ac8a-11cc9442c811 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:26.090519 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede615f-fcbc-46ad-8989-a54ee784b488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:26.091204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-3abb0459-85a4-4953-ac8a-11cc9442c811 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:26.091204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:26.091204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:26.091204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:26.091204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:26.091204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:26.091204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:26.091204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:26.091204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:26.091204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:26.091204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:26.091204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:26.091204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:26.091204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:26.091204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:26.093057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:26.093057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:26.093057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:26.093057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:26.093057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:26.093057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:26.093057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:26.093057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:26.093057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:26.093057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:26.093057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:26.093057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:26.093057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:26.093057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:26.093057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:26.093057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:26.093057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:26.096017 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:26.096017 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:26.096017 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:26.096017 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:26.096017 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 408/811] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:26.097778 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede615f-fcbc-46ad-8989-a54ee784b488 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:26.098624 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede615f-fcbc-46ad-8989-a54ee784b488 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:26.099345 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede615f-fcbc-46ad-8989-a54ee784b488 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:26.100894 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede615f-fcbc-46ad-8989-a54ee784b488 None admin] RBAC: Adding query filter params (name=network) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:26.101746 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede615f-fcbc-46ad-8989-a54ee784b488 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:26.103559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb0459-85a4-4953-ac8a-11cc9442c811 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:26.105157 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede615f-fcbc-46ad-8989-a54ee784b488 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:26.118519 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 404/812] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 08:51:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:26.125229 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede615f-fcbc-46ad-8989-a54ee784b488 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:26.286028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:26.298908 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:26.323831 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede615f-fcbc-46ad-8989-a54ee784b488 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:26.327075 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb0459-85a4-4953-ac8a-11cc9442c811 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:26.388242 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c0010-c21d-4666-9882-334dfe9ae9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:26.389853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c0010-c21d-4666-9882-334dfe9ae9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:26.390665 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c0010-c21d-4666-9882-334dfe9ae9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:26.391408 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c0010-c21d-4666-9882-334dfe9ae9a7 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:26.392982 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c0010-c21d-4666-9882-334dfe9ae9a7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:26.393824 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c0010-c21d-4666-9882-334dfe9ae9a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:26.396516 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c0010-c21d-4666-9882-334dfe9ae9a7 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:26.396708 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36f778-acb6-468f-b6cf-a1f3e3cd34a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:26.397521 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36f778-acb6-468f-b6cf-a1f3e3cd34a0 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:26.397977 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36f778-acb6-468f-b6cf-a1f3e3cd34a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:26.398452 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36f778-acb6-468f-b6cf-a1f3e3cd34a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:26.400291 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36f778-acb6-468f-b6cf-a1f3e3cd34a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:26.401050 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36f778-acb6-468f-b6cf-a1f3e3cd34a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:26.403567 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36f778-acb6-468f-b6cf-a1f3e3cd34a0 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:26.414531 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 405/813] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 08:51:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:26.419435 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c0010-c21d-4666-9882-334dfe9ae9a7 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:26.448832 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 409/814] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:26.457053 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36f778-acb6-468f-b6cf-a1f3e3cd34a0 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:26.580437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c0010-c21d-4666-9882-334dfe9ae9a7 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:26.626062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93e3c6-43a2-49d2-b045-0173b6398d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:26.626731 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93e3c6-43a2-49d2-b045-0173b6398d43 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:26.627015 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93e3c6-43a2-49d2-b045-0173b6398d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:26.627293 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93e3c6-43a2-49d2-b045-0173b6398d43 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:26.628021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e93e3c6-43a2-49d2-b045-0173b6398d43 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:26.629433 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e93e3c6-43a2-49d2-b045-0173b6398d43 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:26.657533 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 406/815] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 08:51:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:51:26.657786 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f80ecb-e39a-459c-b8fd-9b5d40ce2969 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:26.657917 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f80ecb-e39a-459c-b8fd-9b5d40ce2969 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:26.658226 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f80ecb-e39a-459c-b8fd-9b5d40ce2969 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:26.660143 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 407/816] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:26.665899 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b7f57-c8d0-4603-838e-861dfc10f216 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:26.666349 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b7f57-c8d0-4603-838e-861dfc10f216 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:26.666810 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b7f57-c8d0-4603-838e-861dfc10f216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:26.682349 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:26.688932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-199b7f57-c8d0-4603-838e-861dfc10f216 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:26.690458 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-199b7f57-c8d0-4603-838e-861dfc10f216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:26.724652 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36f778-acb6-468f-b6cf-a1f3e3cd34a0 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:26.833188 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553d7c9-5f9f-4560-847b-ee95a917d852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:26.833772 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553d7c9-5f9f-4560-847b-ee95a917d852 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:26.834055 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553d7c9-5f9f-4560-847b-ee95a917d852 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:26.834345 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553d7c9-5f9f-4560-847b-ee95a917d852 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:26.850623 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 408/817] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:51:26.851499 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553d7c9-5f9f-4560-847b-ee95a917d852 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:26.853212 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553d7c9-5f9f-4560-847b-ee95a917d852 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:26.866793 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-6553d7c9-5f9f-4560-847b-ee95a917d852 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:26.866793 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:26.866793 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:26.866793 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:26.866793 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:26.866793 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:26.866793 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:26.866793 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:26.866793 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:26.866793 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:26.866793 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:26.866793 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:26.866793 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:51:26.866793 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:51:26.866793 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:51:26.867756 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:51:26.867756 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:26.867756 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:26.867756 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:26.867756 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:26.867756 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:26.867756 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:26.867756 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:26.867756 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:26.867756 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:26.867756 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:26.867756 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:26.867756 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:26.867756 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:26.867756 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:26.867756 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:26.867756 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:26.870050 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:51:26.870050 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:51:26.870050 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:51:26.870050 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:51:26.870050 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:51:26.870050 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:51:26.870050 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:26.870050 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:26.870050 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 410/818] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:51:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 412 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:51:26.879529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b7f57-c8d0-4603-838e-861dfc10f216 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:26.910588 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553d7c9-5f9f-4560-847b-ee95a917d852 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:26.922865 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:27.110489 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b7f57-c8d0-4603-838e-861dfc10f216 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:27.166632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553d7c9-5f9f-4560-847b-ee95a917d852 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:27.188706 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:27.206368 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00bff8-97ca-416e-ba1b-193b3e92bb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:27.207401 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00bff8-97ca-416e-ba1b-193b3e92bb4e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:27.207863 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00bff8-97ca-416e-ba1b-193b3e92bb4e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:27.208326 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00bff8-97ca-416e-ba1b-193b3e92bb4e None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:27.209639 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00bff8-97ca-416e-ba1b-193b3e92bb4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:27.210157 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00bff8-97ca-416e-ba1b-193b3e92bb4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:27.213254 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00bff8-97ca-416e-ba1b-193b3e92bb4e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:27.238778 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 409/819] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:51:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:27.239505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47598467-d2be-42b8-9ff6-f67036cf0719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:27.241099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47598467-d2be-42b8-9ff6-f67036cf0719 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:27.242008 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47598467-d2be-42b8-9ff6-f67036cf0719 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:27.242807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47598467-d2be-42b8-9ff6-f67036cf0719 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:27.245590 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00bff8-97ca-416e-ba1b-193b3e92bb4e None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:27.266958 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47598467-d2be-42b8-9ff6-f67036cf0719 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:51:27.280223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-47598467-d2be-42b8-9ff6-f67036cf0719 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:51:27.280223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:27.280223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:27.280223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:27.280223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:27.280223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:27.280223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:27.280223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:27.280223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:27.280223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:27.280223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:27.280223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:27.280223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:51:27.280223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:51:27.280223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:51:27.280223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:51:27.281365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:51:27.281365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:51:27.281365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:51:27.281365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:51:27.281365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:27.281365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:27.281365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:27.281365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:27.281365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:27.281365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:27.281365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:27.281365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:27.281365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:27.281365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:27.281365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:27.281365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:27.282210 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:27.282210 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:27.282210 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:27.282210 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:27.282210 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:51:27.282210 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:51:27.282210 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:51:27.282210 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:51:27.282210 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:51:27.282210 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:51:27.282210 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:51:27.282210 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:27.290297 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 411/820] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:51:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:51:27.292736 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47598467-d2be-42b8-9ff6-f67036cf0719 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:27.422592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:27.444636 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00bff8-97ca-416e-ba1b-193b3e92bb4e None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:27.489597 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b95c1-46a8-498f-a596-d1659251b0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:27.491351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b95c1-46a8-498f-a596-d1659251b0e7 None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:27.491875 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b95c1-46a8-498f-a596-d1659251b0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:27.492354 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b95c1-46a8-498f-a596-d1659251b0e7 None admin] PATH_INFO: `/v3/projects/3f77fdd017ea4a9b9b49f6e87ba7f267/users/158ea5c9dd5142eebd903d5f732997ad/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:27.496054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b95c1-46a8-498f-a596-d1659251b0e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f77fdd017ea4a9b9b49f6e87ba7f267, user_id=158ea5c9dd5142eebd903d5f732997ad, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:27.498166 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b95c1-46a8-498f-a596-d1659251b0e7 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:27.501484 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47598467-d2be-42b8-9ff6-f67036cf0719 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:27.523133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 410/821] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 08:51:27 2022] PUT /identity/v3/projects/3f77fdd017ea4a9b9b49f6e87ba7f267/users/158ea5c9dd5142eebd903d5f732997ad/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:51:27.618784 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791d648-fc36-474a-ab74-9d7bc0e07cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:27.618784 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791d648-fc36-474a-ab74-9d7bc0e07cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:27.618784 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791d648-fc36-474a-ab74-9d7bc0e07cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:27.618784 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791d648-fc36-474a-ab74-9d7bc0e07cb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:27.619248 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791d648-fc36-474a-ab74-9d7bc0e07cb7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:27.619248 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791d648-fc36-474a-ab74-9d7bc0e07cb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:27.620547 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791d648-fc36-474a-ab74-9d7bc0e07cb7 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:27.647288 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 412/822] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:51:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:51:27.651779 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b95c1-46a8-498f-a596-d1659251b0e7 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:27.737475 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:27.867981 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b95c1-46a8-498f-a596-d1659251b0e7 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:27.944267 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98a01f-a94a-4acc-8c7f-04ccdc869e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:27.945983 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98a01f-a94a-4acc-8c7f-04ccdc869e61 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:27.947408 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98a01f-a94a-4acc-8c7f-04ccdc869e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:27.948327 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98a01f-a94a-4acc-8c7f-04ccdc869e61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:27.974524 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98a01f-a94a-4acc-8c7f-04ccdc869e61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:27.978602 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98a01f-a94a-4acc-8c7f-04ccdc869e61 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:28.011256 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-7f98a01f-a94a-4acc-8c7f-04ccdc869e61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:28.011256 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:28.011256 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:28.011256 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:28.011256 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:28.011256 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:28.011256 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:28.011256 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:28.011256 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:28.011256 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:28.011256 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:28.011256 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:28.011256 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:28.011256 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:28.011256 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:28.013012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:28.013012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:28.013012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:28.013012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:28.013012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:28.013012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:28.013012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:28.013012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:28.013012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:28.013012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:28.013012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:28.013012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:28.013012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:28.013012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:28.013012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:28.013012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:28.013012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:28.014918 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:28.014918 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:28.014918 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:28.014918 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:28.030443 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 411/823] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:28.035642 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791d648-fc36-474a-ab74-9d7bc0e07cb7 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:28.277311 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791d648-fc36-474a-ab74-9d7bc0e07cb7 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:28.330817 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:28.379116 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4b116-e27a-43cd-a2bd-eb37efbf8c88 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:28.380022 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4b116-e27a-43cd-a2bd-eb37efbf8c88 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:28.380756 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4b116-e27a-43cd-a2bd-eb37efbf8c88 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:28.384603 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 412/824] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:28.396514 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69294d38-3b00-47f8-bd85-650e16636aa7 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:28.397361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69294d38-3b00-47f8-bd85-650e16636aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:28.398062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69294d38-3b00-47f8-bd85-650e16636aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:28.403691 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52ed50-ea1e-4af7-9c11-913744bc8630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:28.410371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52ed50-ea1e-4af7-9c11-913744bc8630 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:28.410371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52ed50-ea1e-4af7-9c11-913744bc8630 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:28.410371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52ed50-ea1e-4af7-9c11-913744bc8630 None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:28.413036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52ed50-ea1e-4af7-9c11-913744bc8630 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:28.413605 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52ed50-ea1e-4af7-9c11-913744bc8630 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:28.416860 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52ed50-ea1e-4af7-9c11-913744bc8630 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:28.460681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 413/825] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:28.460945 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-69294d38-3b00-47f8-bd85-650e16636aa7 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:28.460945 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-69294d38-3b00-47f8-bd85-650e16636aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:28.464144 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52ed50-ea1e-4af7-9c11-913744bc8630 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:28.629466 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 413/826] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:51:28.648910 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69294d38-3b00-47f8-bd85-650e16636aa7 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:28.713215 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:28.728724 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52ed50-ea1e-4af7-9c11-913744bc8630 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:28.785547 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89628ed-febd-4ca9-9b5e-a88f50bd9bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:28.787500 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89628ed-febd-4ca9-9b5e-a88f50bd9bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:28.788541 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89628ed-febd-4ca9-9b5e-a88f50bd9bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:28.789987 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89628ed-febd-4ca9-9b5e-a88f50bd9bb5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:28.802869 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89628ed-febd-4ca9-9b5e-a88f50bd9bb5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:28.804945 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89628ed-febd-4ca9-9b5e-a88f50bd9bb5 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:28.825123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-c89628ed-febd-4ca9-9b5e-a88f50bd9bb5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:51:28.825123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:28.825123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:28.825123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:28.825123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:28.825123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:28.825123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:28.825123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:28.825123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:28.825123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:28.825123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:28.825123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:28.825123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:51:28.825123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:51:28.825123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:51:28.825123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:51:28.827037 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:28.827037 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:28.827037 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:51:28.827037 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:28.827037 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:51:28.827037 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:28.827037 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:28.827037 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:28.827037 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:28.827037 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:28.827037 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:28.827037 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:28.827037 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:28.827037 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:28.827037 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:28.827037 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:28.827037 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:28.827037 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:28.830012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:28.830012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:28.830012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:51:28.830012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:51:28.830012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:51:28.830012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:51:28.830012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:51:28.830012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:51:28.830012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:51:28.830012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:28.832127 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 414/827] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Jul 27 08:51:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:28.835767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89628ed-febd-4ca9-9b5e-a88f50bd9bb5 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:28.893497 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69294d38-3b00-47f8-bd85-650e16636aa7 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:28.910010 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:28.959022 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9c74c-9fa1-48c9-91ec-58a3edddb7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:28.960440 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9c74c-9fa1-48c9-91ec-58a3edddb7df None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:28.960857 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9c74c-9fa1-48c9-91ec-58a3edddb7df None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:28.961261 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9c74c-9fa1-48c9-91ec-58a3edddb7df None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:28.963389 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9c74c-9fa1-48c9-91ec-58a3edddb7df None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:28.965571 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9c74c-9fa1-48c9-91ec-58a3edddb7df None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:28.976605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-eec9c74c-9fa1-48c9-91ec-58a3edddb7df None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 08:51:28.976605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:28.976605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:51:28.976605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:51:28.976605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:51:28.976605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:51:28.976605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:51:28.976605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:28.976605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 08:51:28.976605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:28.976605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:51:28.976605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:28.976605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:28.976605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:28.976605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:28.976605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:28.976605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:28.979202 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:28.979202 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:28.979202 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:28.979202 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:28.979202 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:28.979202 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:28.979202 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:51:28.979202 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:51:28.979202 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:51:28.979202 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:51:28.979202 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:28.979202 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:28.979202 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:28.979202 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:28.979202 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:28.979202 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:28.980853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:28.980853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:28.980853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:28.980853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:28.980853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:28.980853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:28.980853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:28.980853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:28.980853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:28.980853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:28.980853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:51:28.980853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:28.980853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 08:51:28.980853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:28.980853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 414/828] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 08:51:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:28.983476 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f9fa8-9200-49b1-9518-e3e99b605a4c None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:28.983476 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f9fa8-9200-49b1-9518-e3e99b605a4c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:28.983476 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f9fa8-9200-49b1-9518-e3e99b605a4c None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:28.986378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 415/829] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:28.991721 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824f154-734e-4f04-a983-e5c3fa1a7e84 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:28.992319 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824f154-734e-4f04-a983-e5c3fa1a7e84 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:28.992592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824f154-734e-4f04-a983-e5c3fa1a7e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:29.003092 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89628ed-febd-4ca9-9b5e-a88f50bd9bb5 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:29.026874 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f824f154-734e-4f04-a983-e5c3fa1a7e84 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:29.029026 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f824f154-734e-4f04-a983-e5c3fa1a7e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:29.049581 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a4f7c-df20-4d96-99c0-1df0aecc726d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:29.050254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a4f7c-df20-4d96-99c0-1df0aecc726d None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:29.050879 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a4f7c-df20-4d96-99c0-1df0aecc726d None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:29.051159 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a4f7c-df20-4d96-99c0-1df0aecc726d None admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:29.051976 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a4f7c-df20-4d96-99c0-1df0aecc726d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:29.052281 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a4f7c-df20-4d96-99c0-1df0aecc726d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:29.053737 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a4f7c-df20-4d96-99c0-1df0aecc726d None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:29.079335 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 415/830] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Jul 27 08:51:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:29.079335 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a4f7c-df20-4d96-99c0-1df0aecc726d None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:29.159567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 416/831] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:51:29.162523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824f154-734e-4f04-a983-e5c3fa1a7e84 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:29.200194 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:29.247226 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a4f7c-df20-4d96-99c0-1df0aecc726d None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:29.249671 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:29.297197 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8fa4b9-57d8-4ebe-8f1e-ae386b153b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:29.298109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fa4b9-57d8-4ebe-8f1e-ae386b153b1d None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:29.298561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fa4b9-57d8-4ebe-8f1e-ae386b153b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:29.299026 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fa4b9-57d8-4ebe-8f1e-ae386b153b1d None admin] PATH_INFO: `/v3/services` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:29.299904 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8fa4b9-57d8-4ebe-8f1e-ae386b153b1d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:29.300372 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8fa4b9-57d8-4ebe-8f1e-ae386b153b1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:29.301995 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8fa4b9-57d8-4ebe-8f1e-ae386b153b1d None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:29.303272 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824f154-734e-4f04-a983-e5c3fa1a7e84 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:29.308380 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 416/832] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 08:51:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:29.309329 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8fa4b9-57d8-4ebe-8f1e-ae386b153b1d None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:29.366179 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc260326-87a1-45ec-a23f-7aec7b06313b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:29.367331 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc260326-87a1-45ec-a23f-7aec7b06313b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:29.367763 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc260326-87a1-45ec-a23f-7aec7b06313b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:29.368287 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc260326-87a1-45ec-a23f-7aec7b06313b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:29.467388 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc260326-87a1-45ec-a23f-7aec7b06313b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:29.469954 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc260326-87a1-45ec-a23f-7aec7b06313b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:29.484760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8fa4b9-57d8-4ebe-8f1e-ae386b153b1d None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:29.522944 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:29.545572 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51ad5e-90b1-4833-83ee-79490a9523bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:29.546561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51ad5e-90b1-4833-83ee-79490a9523bc None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:29.546967 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51ad5e-90b1-4833-83ee-79490a9523bc None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:29.547365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51ad5e-90b1-4833-83ee-79490a9523bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:29.566026 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51ad5e-90b1-4833-83ee-79490a9523bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:51:29.574929 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-de51ad5e-90b1-4833-83ee-79490a9523bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:51:29.574929 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:29.574929 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:29.574929 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:29.574929 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:29.574929 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:29.574929 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:29.574929 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:29.574929 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:29.574929 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:29.574929 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:29.574929 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:29.574929 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:51:29.574929 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:51:29.574929 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:51:29.574929 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:51:29.575959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:51:29.575959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:51:29.575959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:51:29.575959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:51:29.575959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:29.575959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:29.575959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:29.575959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:29.575959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:29.575959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:29.575959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:29.575959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:29.575959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:29.575959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:29.575959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:29.575959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:29.576789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:29.576789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:29.576789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:29.576789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:29.576789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:51:29.576789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:51:29.576789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:51:29.576789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:51:29.576789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:51:29.576789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:51:29.576789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:51:29.576789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:29.576789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 417/833] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 08:51:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:29.578173 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51ad5e-90b1-4833-83ee-79490a9523bc None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:29.627647 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:29.667467 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 417/834] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:51:29 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:51:29.667467 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc260326-87a1-45ec-a23f-7aec7b06313b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:29.738661 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51ad5e-90b1-4833-83ee-79490a9523bc None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:29.799188 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672a14d-4d13-46f9-a83c-c45a25eb2e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:29.800724 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672a14d-4d13-46f9-a83c-c45a25eb2e2f None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:29.801190 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672a14d-4d13-46f9-a83c-c45a25eb2e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:29.801662 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672a14d-4d13-46f9-a83c-c45a25eb2e2f None admin] PATH_INFO: `/v3/services` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:29.803050 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672a14d-4d13-46f9-a83c-c45a25eb2e2f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:29.803594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672a14d-4d13-46f9-a83c-c45a25eb2e2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:29.806981 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672a14d-4d13-46f9-a83c-c45a25eb2e2f None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:29.814407 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 418/835] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 08:51:29 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:29.815830 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672a14d-4d13-46f9-a83c-c45a25eb2e2f None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:29.848039 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc260326-87a1-45ec-a23f-7aec7b06313b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:29.890971 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:29.909327 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3903e2d-5952-4aac-9a8e-f52fa31b3683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:29.913024 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3903e2d-5952-4aac-9a8e-f52fa31b3683 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:29.914882 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3903e2d-5952-4aac-9a8e-f52fa31b3683 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:29.916377 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3903e2d-5952-4aac-9a8e-f52fa31b3683 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:29.919430 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3903e2d-5952-4aac-9a8e-f52fa31b3683 None admin] RBAC: Adding query filter params (name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:29.920315 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3903e2d-5952-4aac-9a8e-f52fa31b3683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:29.925061 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3903e2d-5952-4aac-9a8e-f52fa31b3683 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:29.952061 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 418/836] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 08:51:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:29.958779 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3903e2d-5952-4aac-9a8e-f52fa31b3683 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:30.009866 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:30.034778 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672a14d-4d13-46f9-a83c-c45a25eb2e2f None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:30.081086 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82846c64-226e-499c-9797-56dee3ebb3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:30.082050 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82846c64-226e-499c-9797-56dee3ebb3af None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:30.082050 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82846c64-226e-499c-9797-56dee3ebb3af None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:30.082292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82846c64-226e-499c-9797-56dee3ebb3af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:30.098985 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82846c64-226e-499c-9797-56dee3ebb3af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:30.101798 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82846c64-226e-499c-9797-56dee3ebb3af None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:30.130446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-82846c64-226e-499c-9797-56dee3ebb3af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:30.130446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:30.130446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:30.130446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:30.130446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:30.130446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:30.130446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:30.130446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:30.130446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:30.130446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:30.130446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:30.130446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:30.130446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:30.130446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:30.130446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:30.131407 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:30.131407 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:30.131407 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:30.131407 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:30.131407 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:30.131407 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:30.131407 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:30.131407 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:30.131407 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:30.131407 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:30.131407 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:30.131407 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:30.131407 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:30.131407 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:30.131407 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:30.131407 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:30.131407 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:30.132274 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:30.132274 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:30.132274 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:30.132274 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:30.132641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 419/837] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:30.135447 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c3a60-9693-4886-9353-3a9521e8e32d None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:30.136027 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c3a60-9693-4886-9353-3a9521e8e32d None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:30.136704 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c3a60-9693-4886-9353-3a9521e8e32d None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:30.139495 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 420/838] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:30.143133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c3a60-9693-4886-9353-3a9521e8e32d None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:30.152856 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3903e2d-5952-4aac-9a8e-f52fa31b3683 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:30.211828 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7c738-b2f5-414e-a9fd-92f6584d1332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:30.213872 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7c738-b2f5-414e-a9fd-92f6584d1332 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:30.214382 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7c738-b2f5-414e-a9fd-92f6584d1332 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:30.214860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7c738-b2f5-414e-a9fd-92f6584d1332 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:30.235336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7c738-b2f5-414e-a9fd-92f6584d1332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:30.237965 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7c738-b2f5-414e-a9fd-92f6584d1332 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:30.265870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-c9b7c738-b2f5-414e-a9fd-92f6584d1332 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:30.265870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:30.265870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:30.265870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:30.265870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:30.265870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:30.265870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:30.265870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:30.265870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:30.265870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:30.265870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:30.265870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:30.265870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:30.265870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:30.265870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:30.267028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:30.267028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:30.267028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:30.267028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:30.267028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:30.267028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:30.267028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:30.267028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:30.267028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:30.267028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:30.267028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:30.267028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:30.267028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:30.267028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:30.267028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:30.267028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:30.267028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:30.267897 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:30.267897 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:30.267897 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:30.267897 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:30.268128 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 419/839] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:30.270147 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1c61e-71c1-46a8-8642-4ff7adf2c663 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:30.270660 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1c61e-71c1-46a8-8642-4ff7adf2c663 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:30.271133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1c61e-71c1-46a8-8642-4ff7adf2c663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:30.304171 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-1de1c61e-71c1-46a8-8642-4ff7adf2c663 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:30.307575 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1de1c61e-71c1-46a8-8642-4ff7adf2c663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:30.357568 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:30.358106 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c3a60-9693-4886-9353-3a9521e8e32d None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:30.402881 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 420/840] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:51:30.405590 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1c61e-71c1-46a8-8642-4ff7adf2c663 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:30.434687 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b6e1f-a6d1-4509-8431-3c5509105fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:30.435764 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b6e1f-a6d1-4509-8431-3c5509105fba None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:30.436271 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b6e1f-a6d1-4509-8431-3c5509105fba None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:30.436600 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b6e1f-a6d1-4509-8431-3c5509105fba None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:30.437923 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b6e1f-a6d1-4509-8431-3c5509105fba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:30.438481 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b6e1f-a6d1-4509-8431-3c5509105fba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:30.441171 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b6e1f-a6d1-4509-8431-3c5509105fba None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:30.464522 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 421/841] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:30.465886 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b6e1f-a6d1-4509-8431-3c5509105fba None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:30.472864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:30.610791 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1c61e-71c1-46a8-8642-4ff7adf2c663 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:30.660039 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd3a66-5f01-41cc-b3d0-77e59f5564d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:30.661035 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd3a66-5f01-41cc-b3d0-77e59f5564d2 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:30.661468 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd3a66-5f01-41cc-b3d0-77e59f5564d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:30.661899 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd3a66-5f01-41cc-b3d0-77e59f5564d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:30.663170 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd3a66-5f01-41cc-b3d0-77e59f5564d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:30.663637 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd3a66-5f01-41cc-b3d0-77e59f5564d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:30.665921 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd3a66-5f01-41cc-b3d0-77e59f5564d2 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:30.667881 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b6e1f-a6d1-4509-8431-3c5509105fba None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:30.685744 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 421/842] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:30.685744 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd3a66-5f01-41cc-b3d0-77e59f5564d2 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:30.725760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:30.735216 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e09285-b5bc-4486-baa4-cd87220dcb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:30.736252 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e09285-b5bc-4486-baa4-cd87220dcb4f None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:30.736747 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e09285-b5bc-4486-baa4-cd87220dcb4f None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:30.737282 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e09285-b5bc-4486-baa4-cd87220dcb4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:30.751205 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e09285-b5bc-4486-baa4-cd87220dcb4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:51:30.757234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-22e09285-b5bc-4486-baa4-cd87220dcb4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:51:30.757234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:30.757234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:30.757234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:30.757234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:30.757234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:30.757234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:30.757234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:30.757234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:30.757234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:30.757234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:30.757234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:30.757234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:51:30.757234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:51:30.757234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:51:30.757234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:51:30.759999 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:51:30.759999 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:51:30.759999 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:51:30.759999 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:51:30.759999 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:30.759999 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:30.759999 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:30.759999 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:30.759999 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:30.759999 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:30.759999 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:30.759999 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:30.759999 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:30.759999 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:30.759999 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:30.759999 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:30.762874 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:30.762874 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:30.762874 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:30.762874 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:30.762874 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:51:30.762874 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:51:30.762874 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:51:30.762874 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:51:30.762874 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:51:30.762874 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:51:30.762874 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:51:30.762874 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:30.764323 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 422/843] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:51:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:30.765330 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e09285-b5bc-4486-baa4-cd87220dcb4f None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:30.841574 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:30.850999 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd3a66-5f01-41cc-b3d0-77e59f5564d2 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:30.892961 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e09285-b5bc-4486-baa4-cd87220dcb4f None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:30.893335 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ada22-07aa-475a-984a-b0db46aa4c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:30.894168 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ada22-07aa-475a-984a-b0db46aa4c16 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:30.894782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ada22-07aa-475a-984a-b0db46aa4c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:30.896016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ada22-07aa-475a-984a-b0db46aa4c16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:30.907311 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ada22-07aa-475a-984a-b0db46aa4c16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:30.909308 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ada22-07aa-475a-984a-b0db46aa4c16 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:30.925511 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-326ada22-07aa-475a-984a-b0db46aa4c16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:30.925511 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:30.925511 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:30.925511 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:30.925511 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:30.925511 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:30.925511 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:30.925511 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:30.925511 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:30.925511 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:30.925511 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:30.925511 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:30.925511 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:51:30.925511 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:51:30.925511 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:51:30.936336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:51:30.936336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:30.936336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:30.936336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:30.936336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:30.936336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:30.936336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:30.936336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:30.936336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:30.936336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:30.936336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:30.936336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:30.936336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:30.936336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:30.936336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:30.936336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:30.936336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:30.938143 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:51:30.938143 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:51:30.938143 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:51:30.938143 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:51:30.938143 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:51:30.938143 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:51:30.938143 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:30.938143 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:30.938143 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 422/844] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:51:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:30.938143 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ada22-07aa-475a-984a-b0db46aa4c16 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:30.941323 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59596c7b-c61d-4d55-b428-c170c1b645e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:30.941323 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59596c7b-c61d-4d55-b428-c170c1b645e9 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:30.941323 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59596c7b-c61d-4d55-b428-c170c1b645e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:30.941323 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59596c7b-c61d-4d55-b428-c170c1b645e9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:30.949355 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59596c7b-c61d-4d55-b428-c170c1b645e9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:30.952437 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59596c7b-c61d-4d55-b428-c170c1b645e9 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:30.967693 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-59596c7b-c61d-4d55-b428-c170c1b645e9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 08:51:30.967693 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:30.967693 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:30.967693 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:30.967693 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:30.967693 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:30.967693 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:30.967693 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:30.967693 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:30.967693 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:30.967693 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:30.967693 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:30.967693 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:51:30.967693 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:51:30.967693 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:51:30.967693 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:51:30.969618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:30.969618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:30.969618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:51:30.969618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:30.969618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:51:30.969618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:30.969618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:30.969618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:30.969618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:30.969618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:30.969618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:30.969618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:30.969618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:30.969618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:30.969618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:30.969618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:30.969618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:30.969618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:30.971852 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:30.971852 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:30.971852 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:51:30.971852 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:51:30.971852 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:51:30.971852 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:51:30.971852 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:51:30.971852 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:51:30.971852 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 08:51:30.971852 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:30.971852 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 423/845] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Jul 27 08:51:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:30.974041 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59596c7b-c61d-4d55-b428-c170c1b645e9 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:31.064663 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:31.075906 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ada22-07aa-475a-984a-b0db46aa4c16 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:31.105036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59596c7b-c61d-4d55-b428-c170c1b645e9 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:31.121747 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ff123-accf-4c78-8497-4002aad78f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:31.122509 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ff123-accf-4c78-8497-4002aad78f79 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:31.122797 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ff123-accf-4c78-8497-4002aad78f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:31.123073 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ff123-accf-4c78-8497-4002aad78f79 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:31.123807 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ff123-accf-4c78-8497-4002aad78f79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:31.124121 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ff123-accf-4c78-8497-4002aad78f79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:31.125514 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ff123-accf-4c78-8497-4002aad78f79 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:31.135552 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:31.145193 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 423/846] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:51:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:31.145193 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ff123-accf-4c78-8497-4002aad78f79 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:31.157256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663da823-c9ef-4754-807b-3d6e7ac70ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:31.157912 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663da823-c9ef-4754-807b-3d6e7ac70ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:31.158243 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663da823-c9ef-4754-807b-3d6e7ac70ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:31.158548 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663da823-c9ef-4754-807b-3d6e7ac70ad9 None admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:31.159317 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663da823-c9ef-4754-807b-3d6e7ac70ad9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:31.159622 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663da823-c9ef-4754-807b-3d6e7ac70ad9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:31.161088 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663da823-c9ef-4754-807b-3d6e7ac70ad9 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:31.176980 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 424/847] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:51:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:31.177568 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663da823-c9ef-4754-807b-3d6e7ac70ad9 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:31.288187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ff123-accf-4c78-8497-4002aad78f79 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:31.317072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663da823-c9ef-4754-807b-3d6e7ac70ad9 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:31.341766 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c5ab8-1eaa-47ea-960b-fc0057bf68e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:31.342878 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c5ab8-1eaa-47ea-960b-fc0057bf68e9 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:31.343397 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c5ab8-1eaa-47ea-960b-fc0057bf68e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:31.343910 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c5ab8-1eaa-47ea-960b-fc0057bf68e9 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:31.345410 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c5ab8-1eaa-47ea-960b-fc0057bf68e9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:31.346100 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c5ab8-1eaa-47ea-960b-fc0057bf68e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:31.348843 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c5ab8-1eaa-47ea-960b-fc0057bf68e9 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:31.374691 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 424/848] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Jul 27 08:51:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:31.375868 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c5ab8-1eaa-47ea-960b-fc0057bf68e9 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:31.391975 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3870a8-8918-41b6-baed-0496bbaa9049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:31.393012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3870a8-8918-41b6-baed-0496bbaa9049 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:31.393459 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3870a8-8918-41b6-baed-0496bbaa9049 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:31.393904 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3870a8-8918-41b6-baed-0496bbaa9049 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:31.408412 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:31.411898 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3870a8-8918-41b6-baed-0496bbaa9049 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:31.413957 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3870a8-8918-41b6-baed-0496bbaa9049 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:31.435827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-9f3870a8-8918-41b6-baed-0496bbaa9049 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:31.435827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:31.435827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:31.435827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:31.435827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:31.435827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:31.435827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:31.435827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:31.435827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:31.435827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:31.435827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:31.435827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:31.435827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:31.435827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:31.435827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:31.437638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:31.437638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:31.437638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:31.437638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:31.437638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:31.437638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:31.437638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:31.437638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:31.437638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:31.437638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:31.437638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:31.437638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:31.437638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:31.437638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:31.437638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:31.437638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:31.437638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:31.439597 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:31.439597 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:31.439597 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:31.439597 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:31.445468 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 425/849] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:31.447881 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3870a8-8918-41b6-baed-0496bbaa9049 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:31.507690 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:31.552840 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c5ab8-1eaa-47ea-960b-fc0057bf68e9 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:31.595128 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b007261-4c15-4891-a4cc-13d9133c1c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:31.595758 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b007261-4c15-4891-a4cc-13d9133c1c96 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:31.596033 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b007261-4c15-4891-a4cc-13d9133c1c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:31.596304 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b007261-4c15-4891-a4cc-13d9133c1c96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:31.597108 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b007261-4c15-4891-a4cc-13d9133c1c96 None admin] RBAC: Adding query filter params (role.id=20bc872844094480b9dca67a25b69e84, scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267, user.id=c30bc55c6a1348bb961f0d010422da87) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:31.597416 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b007261-4c15-4891-a4cc-13d9133c1c96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:31.599454 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b007261-4c15-4891-a4cc-13d9133c1c96 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:31.614357 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 425/850] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:51:31 2022] GET /identity/v3/role_assignments?user.id=c30bc55c6a1348bb961f0d010422da87&scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267&role.id=20bc872844094480b9dca67a25b69e84 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:31.614357 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b007261-4c15-4891-a4cc-13d9133c1c96 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:31.619191 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3870a8-8918-41b6-baed-0496bbaa9049 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:31.685763 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5d1fc-3166-4e0f-a7d6-278120c40350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:31.687194 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5d1fc-3166-4e0f-a7d6-278120c40350 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:31.688026 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5d1fc-3166-4e0f-a7d6-278120c40350 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:31.688677 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5d1fc-3166-4e0f-a7d6-278120c40350 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:31.733295 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:31.772043 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b007261-4c15-4891-a4cc-13d9133c1c96 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:31.824686 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b2aea-8037-41ce-961c-22063d1b16a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:31.825317 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b2aea-8037-41ce-961c-22063d1b16a6 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:31.825599 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b2aea-8037-41ce-961c-22063d1b16a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:31.825910 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b2aea-8037-41ce-961c-22063d1b16a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:31.826881 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b2aea-8037-41ce-961c-22063d1b16a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:31.827058 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b2aea-8037-41ce-961c-22063d1b16a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:31.828415 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b2aea-8037-41ce-961c-22063d1b16a6 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:31.832103 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5d1fc-3166-4e0f-a7d6-278120c40350 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:31.834887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5d1fc-3166-4e0f-a7d6-278120c40350 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:31.847647 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 426/851] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:31.848777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b2aea-8037-41ce-961c-22063d1b16a6 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:31.912701 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:32.065374 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b2aea-8037-41ce-961c-22063d1b16a6 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:32.066206 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 426/852] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:51:31 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:51:32.074374 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5d1fc-3166-4e0f-a7d6-278120c40350 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:32.133579 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32670dfd-ffc9-40de-87a0-6fc971dd1d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:32.135745 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32670dfd-ffc9-40de-87a0-6fc971dd1d2e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:32.136416 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32670dfd-ffc9-40de-87a0-6fc971dd1d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:32.137357 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32670dfd-ffc9-40de-87a0-6fc971dd1d2e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:32.142909 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:32.155915 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32670dfd-ffc9-40de-87a0-6fc971dd1d2e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:32.159231 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32670dfd-ffc9-40de-87a0-6fc971dd1d2e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:32.185611 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-32670dfd-ffc9-40de-87a0-6fc971dd1d2e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 08:51:32.185611 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:32.185611 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:32.185611 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:32.185611 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:32.185611 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:32.185611 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:32.185611 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:32.185611 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:32.185611 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:32.185611 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:32.185611 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:32.185611 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:51:32.185611 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:51:32.185611 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:51:32.185611 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:51:32.187501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:32.187501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:32.187501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:51:32.187501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:32.187501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:51:32.187501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:32.187501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:32.187501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:32.187501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:32.187501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:32.187501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:32.187501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:32.187501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:32.187501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:32.187501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:32.187501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:32.187501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:32.187501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:32.189129 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:32.189129 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:32.189129 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:51:32.189129 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:51:32.189129 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:51:32.189129 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:51:32.189129 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:51:32.189129 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:51:32.189129 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 08:51:32.189129 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:32.189129 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 427/853] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:51:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:51:32.194795 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32670dfd-ffc9-40de-87a0-6fc971dd1d2e None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:32.278225 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5d1fc-3166-4e0f-a7d6-278120c40350 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:32.315287 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc7091-ecb2-44b9-9f73-a5e2a943dad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:32.316035 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc7091-ecb2-44b9-9f73-a5e2a943dad0 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:32.316239 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc7091-ecb2-44b9-9f73-a5e2a943dad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:32.316518 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc7091-ecb2-44b9-9f73-a5e2a943dad0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:32.319110 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:32.330565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc7091-ecb2-44b9-9f73-a5e2a943dad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:32.332083 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc7091-ecb2-44b9-9f73-a5e2a943dad0 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:32.349136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-41fc7091-ecb2-44b9-9f73-a5e2a943dad0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:32.349136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:32.349136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:32.349136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:32.349136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:32.349136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:32.349136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:32.349136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:32.349136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:32.349136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:32.349136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:32.349136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:32.349136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:32.349136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:32.349136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:32.350933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:32.350933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:32.350933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:32.350933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:32.350933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:32.350933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:32.350933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:32.350933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:32.350933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:32.350933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:32.350933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:32.350933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:32.350933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:32.350933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:32.350933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:32.350933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:32.350933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:32.353187 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:32.353187 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:32.353187 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:32.353187 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:32.355764 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 427/854] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:51:32.356881 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc7091-ecb2-44b9-9f73-a5e2a943dad0 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:32.434410 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32670dfd-ffc9-40de-87a0-6fc971dd1d2e None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:32.474292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc7091-ecb2-44b9-9f73-a5e2a943dad0 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:32.506698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84bdbf-5d4d-4554-bd64-6f399d0d5cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:32.509801 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84bdbf-5d4d-4554-bd64-6f399d0d5cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:32.510991 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84bdbf-5d4d-4554-bd64-6f399d0d5cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:32.511760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84bdbf-5d4d-4554-bd64-6f399d0d5cf5 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:32.513566 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84bdbf-5d4d-4554-bd64-6f399d0d5cf5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:32.514441 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84bdbf-5d4d-4554-bd64-6f399d0d5cf5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:32.514635 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685cc84-3999-4f24-9fd0-350d061960e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:32.515131 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685cc84-3999-4f24-9fd0-350d061960e9 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:32.515412 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685cc84-3999-4f24-9fd0-350d061960e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:32.515689 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685cc84-3999-4f24-9fd0-350d061960e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:32.516397 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685cc84-3999-4f24-9fd0-350d061960e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:32.516703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685cc84-3999-4f24-9fd0-350d061960e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:32.518165 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685cc84-3999-4f24-9fd0-350d061960e9 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:32.519442 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84bdbf-5d4d-4554-bd64-6f399d0d5cf5 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:32.533795 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 428/855] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:51:32.536702 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b518267-2fbe-4cef-8265-dfebb33327e8 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:32.537675 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b518267-2fbe-4cef-8265-dfebb33327e8 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:32.538427 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b518267-2fbe-4cef-8265-dfebb33327e8 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:32.542487 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 429/856] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:32.543833 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b518267-2fbe-4cef-8265-dfebb33327e8 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:32.554471 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 428/857] 10.222.0.65 () {56 vars in 1135 bytes} [Wed Jul 27 08:51:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:51:32.557336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1024f0-663d-4861-9f26-aeb4b54bd190 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:32.557784 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1024f0-663d-4861-9f26-aeb4b54bd190 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:32.558235 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1024f0-663d-4861-9f26-aeb4b54bd190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:32.586411 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-7d1024f0-663d-4861-9f26-aeb4b54bd190 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:32.589229 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-7d1024f0-663d-4861-9f26-aeb4b54bd190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:32.626013 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:32.680631 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:32.700538 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b518267-2fbe-4cef-8265-dfebb33327e8 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:32.718611 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 429/858] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:51:32.718611 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1024f0-663d-4861-9f26-aeb4b54bd190 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:32.766193 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d8ca7-1225-460b-b657-4d4329baa8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:32.767014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d8ca7-1225-460b-b657-4d4329baa8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:32.767379 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d8ca7-1225-460b-b657-4d4329baa8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:32.767725 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d8ca7-1225-460b-b657-4d4329baa8d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:32.776901 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d8ca7-1225-460b-b657-4d4329baa8d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:32.778528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d8ca7-1225-460b-b657-4d4329baa8d8 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:32.793573 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-f02d8ca7-1225-460b-b657-4d4329baa8d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:32.793573 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:32.793573 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:32.793573 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:32.793573 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:32.793573 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:32.793573 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:32.793573 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:32.793573 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:32.793573 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:32.793573 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:32.793573 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:32.793573 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:51:32.793573 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:51:32.793573 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:51:32.794571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:51:32.794571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:32.794571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:32.794571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:32.794571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:32.794571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:32.794571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:32.794571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:32.794571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:32.794571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:32.794571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:32.794571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:32.794571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:32.794571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:32.794571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:32.794571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:32.794571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:32.795464 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:51:32.795464 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:51:32.795464 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:51:32.795464 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:51:32.795464 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:51:32.795464 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:51:32.795464 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:32.795464 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:32.795464 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 430/859] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:51:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:32.795946 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d8ca7-1225-460b-b657-4d4329baa8d8 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:32.869307 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1024f0-663d-4861-9f26-aeb4b54bd190 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:32.912243 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d8ca7-1225-460b-b657-4d4329baa8d8 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:32.923549 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:32.924554 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16689c6c-734c-4413-aa81-fe03af45174d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:32.925189 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16689c6c-734c-4413-aa81-fe03af45174d None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:32.925480 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16689c6c-734c-4413-aa81-fe03af45174d None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:32.926354 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16689c6c-734c-4413-aa81-fe03af45174d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:32.960548 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c4158-ccbd-44d8-83e9-8a61bc6ff57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:32.962137 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c4158-ccbd-44d8-83e9-8a61bc6ff57e None admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:32.963159 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c4158-ccbd-44d8-83e9-8a61bc6ff57e None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:32.963636 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c4158-ccbd-44d8-83e9-8a61bc6ff57e None admin] PATH_INFO: `/v3/services` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:32.964935 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c4158-ccbd-44d8-83e9-8a61bc6ff57e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:32.967635 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c4158-ccbd-44d8-83e9-8a61bc6ff57e None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:32.995109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 431/860] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 08:51:32 2022] POST /identity/v3/services => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:51:32.995109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c4158-ccbd-44d8-83e9-8a61bc6ff57e None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:32.995488 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:33.057900 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16689c6c-734c-4413-aa81-fe03af45174d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:33.062101 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16689c6c-734c-4413-aa81-fe03af45174d None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:33.152496 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c4158-ccbd-44d8-83e9-8a61bc6ff57e None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:33.200789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6ed22-2043-4045-a171-54a7f5633c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:33.201617 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6ed22-2043-4045-a171-54a7f5633c83 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:33.202383 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6ed22-2043-4045-a171-54a7f5633c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:33.202383 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6ed22-2043-4045-a171-54a7f5633c83 None admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:33.203309 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad6ed22-2043-4045-a171-54a7f5633c83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:33.203716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad6ed22-2043-4045-a171-54a7f5633c83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:33.205304 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad6ed22-2043-4045-a171-54a7f5633c83 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:33.222486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 432/861] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:51:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:33.231883 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6ed22-2043-4045-a171-54a7f5633c83 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:33.284290 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:33.297414 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 430/862] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:51:32 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:51:33.302278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16689c6c-734c-4413-aa81-fe03af45174d None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:33.388550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6ed22-2043-4045-a171-54a7f5633c83 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:33.426940 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ac8f1-a2af-4d33-9381-7ab6c8aa4183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:33.427569 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ac8f1-a2af-4d33-9381-7ab6c8aa4183 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:33.427848 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ac8f1-a2af-4d33-9381-7ab6c8aa4183 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:33.428120 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ac8f1-a2af-4d33-9381-7ab6c8aa4183 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:33.428931 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ac8f1-a2af-4d33-9381-7ab6c8aa4183 None admin] RBAC: Adding query filter params (role.id=e476894ef72943f9b83d98d0704edfea, scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267, user.id=c607472800fc49d5a75c5e6acb33f2a2) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:33.429239 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ac8f1-a2af-4d33-9381-7ab6c8aa4183 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:33.430735 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ac8f1-a2af-4d33-9381-7ab6c8aa4183 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:33.438371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 433/863] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:51:33 2022] GET /identity/v3/role_assignments?user.id=c607472800fc49d5a75c5e6acb33f2a2&scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267&role.id=e476894ef72943f9b83d98d0704edfea => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:33.481473 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:33.502763 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16689c6c-734c-4413-aa81-fe03af45174d None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:33.548546 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5862d6-df79-4a8c-a42f-2879b8f4967c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:33.549215 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5862d6-df79-4a8c-a42f-2879b8f4967c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:33.549490 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5862d6-df79-4a8c-a42f-2879b8f4967c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:33.549765 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5862d6-df79-4a8c-a42f-2879b8f4967c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:33.562420 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5862d6-df79-4a8c-a42f-2879b8f4967c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:33.563906 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5862d6-df79-4a8c-a42f-2879b8f4967c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:33.581837 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-7c5862d6-df79-4a8c-a42f-2879b8f4967c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:33.581837 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:33.581837 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:33.581837 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:33.581837 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:33.581837 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:33.581837 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:33.581837 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:33.581837 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:33.581837 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:33.581837 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:33.581837 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:33.581837 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:33.581837 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:33.581837 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:33.583567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:33.583567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:33.583567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:33.583567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:33.583567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:33.583567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:33.583567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:33.583567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:33.583567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:33.583567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:33.583567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:33.583567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:33.583567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:33.583567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:33.583567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:33.583567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:33.583567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:33.585323 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:33.585323 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:33.585323 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:33.585323 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:33.585323 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 431/864] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:51:33.589876 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ac8f1-a2af-4d33-9381-7ab6c8aa4183 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:33.708974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ac8f1-a2af-4d33-9381-7ab6c8aa4183 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:33.710760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:33.748892 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caea042-69ca-46a5-a156-08ef2d8a0b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:33.749534 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caea042-69ca-46a5-a156-08ef2d8a0b60 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:33.749811 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caea042-69ca-46a5-a156-08ef2d8a0b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:33.750069 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caea042-69ca-46a5-a156-08ef2d8a0b60 None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:33.751132 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caea042-69ca-46a5-a156-08ef2d8a0b60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:33.752244 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caea042-69ca-46a5-a156-08ef2d8a0b60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:33.754299 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caea042-69ca-46a5-a156-08ef2d8a0b60 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:33.769446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 434/865] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:33.775661 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5862d6-df79-4a8c-a42f-2879b8f4967c None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:33.894798 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5862d6-df79-4a8c-a42f-2879b8f4967c None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:33.944176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8daec-014c-4c0a-82fe-20584741ef15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:33.945245 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8daec-014c-4c0a-82fe-20584741ef15 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:33.945737 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8daec-014c-4c0a-82fe-20584741ef15 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:33.946225 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8daec-014c-4c0a-82fe-20584741ef15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:33.951887 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:33.960958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8daec-014c-4c0a-82fe-20584741ef15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:33.963737 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8daec-014c-4c0a-82fe-20584741ef15 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:33.987075 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-f0c8daec-014c-4c0a-82fe-20584741ef15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:33.987075 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:33.987075 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:33.987075 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:33.987075 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:33.987075 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:33.987075 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:33.987075 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:33.987075 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:33.987075 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:33.987075 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:33.987075 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:33.987075 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:51:33.987075 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:51:33.987075 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:51:33.988836 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:51:33.988836 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:33.988836 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:33.988836 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:33.988836 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:33.988836 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:33.988836 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:33.988836 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:33.988836 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:33.988836 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:33.988836 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:33.988836 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:33.988836 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:33.988836 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:33.988836 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:33.988836 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:33.988836 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:33.990120 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:51:33.990120 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:51:33.990120 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:51:33.990120 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:51:33.990120 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:51:33.990120 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:51:33.990120 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:33.990120 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:33.990120 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 432/866] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:51:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:33.995010 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caea042-69ca-46a5-a156-08ef2d8a0b60 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:34.109956 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caea042-69ca-46a5-a156-08ef2d8a0b60 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:34.179394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e8be2-b0c4-43c1-a73c-4c30fce72edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:34.180422 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e8be2-b0c4-43c1-a73c-4c30fce72edb None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:34.181491 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e8be2-b0c4-43c1-a73c-4c30fce72edb None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:34.182738 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e8be2-b0c4-43c1-a73c-4c30fce72edb None admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:34.183371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e8be2-b0c4-43c1-a73c-4c30fce72edb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:34.183908 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e8be2-b0c4-43c1-a73c-4c30fce72edb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:34.186676 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e8be2-b0c4-43c1-a73c-4c30fce72edb None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:34.210913 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 435/867] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:51:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:34.218450 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8daec-014c-4c0a-82fe-20584741ef15 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:34.344936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8daec-014c-4c0a-82fe-20584741ef15 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:34.393619 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a7ec3-9d06-40f1-bf32-5e6dc8e4d5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:34.394247 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a7ec3-9d06-40f1-bf32-5e6dc8e4d5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:34.394571 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a7ec3-9d06-40f1-bf32-5e6dc8e4d5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:34.394845 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a7ec3-9d06-40f1-bf32-5e6dc8e4d5d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:34.395681 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a7ec3-9d06-40f1-bf32-5e6dc8e4d5d9 None admin] RBAC: Adding query filter params (role.id=20bc872844094480b9dca67a25b69e84, scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267, user.id=158ea5c9dd5142eebd903d5f732997ad) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:34.395993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a7ec3-9d06-40f1-bf32-5e6dc8e4d5d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:34.397605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a7ec3-9d06-40f1-bf32-5e6dc8e4d5d9 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:34.406366 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 433/868] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:51:34 2022] GET /identity/v3/role_assignments?user.id=158ea5c9dd5142eebd903d5f732997ad&scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267&role.id=20bc872844094480b9dca67a25b69e84 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:34.776240 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d820c3-78fe-4810-90da-a0c13b54e5cc None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:34.776789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d820c3-78fe-4810-90da-a0c13b54e5cc None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:34.777073 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d820c3-78fe-4810-90da-a0c13b54e5cc None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:34.778937 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 436/869] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:51:34.784908 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1b558-d84e-4d89-9e4e-2da034099587 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:34.785326 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1b558-d84e-4d89-9e4e-2da034099587 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:34.785708 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1b558-d84e-4d89-9e4e-2da034099587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:34.805119 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-c1b1b558-d84e-4d89-9e4e-2da034099587 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:34.807423 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c1b1b558-d84e-4d89-9e4e-2da034099587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:34.869715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:34.882451 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 434/870] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:34 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:51:34.905364 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d820c3-78fe-4810-90da-a0c13b54e5cc None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:34.916311 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:35.044521 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d820c3-78fe-4810-90da-a0c13b54e5cc None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:35.095991 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02399fe8-00bb-4450-b850-bd6aafeaafd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:35.096947 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02399fe8-00bb-4450-b850-bd6aafeaafd0 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:35.097300 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02399fe8-00bb-4450-b850-bd6aafeaafd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:35.097609 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02399fe8-00bb-4450-b850-bd6aafeaafd0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:35.098473 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02399fe8-00bb-4450-b850-bd6aafeaafd0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:35.099975 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02399fe8-00bb-4450-b850-bd6aafeaafd0 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:35.111676 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-02399fe8-00bb-4450-b850-bd6aafeaafd0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 08:51:35.111676 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:35.111676 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:51:35.111676 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:51:35.111676 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:51:35.111676 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:51:35.111676 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:51:35.111676 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:35.111676 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 08:51:35.111676 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:35.111676 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:51:35.111676 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:35.111676 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:35.111676 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:35.111676 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:35.111676 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:35.112683 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:35.112683 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:35.112683 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:35.112683 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:35.112683 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:35.112683 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:35.112683 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:35.112683 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:51:35.112683 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:51:35.112683 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:51:35.112683 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:51:35.112683 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:35.112683 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:35.112683 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:35.112683 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:35.112683 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:35.113529 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:35.113529 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:35.113529 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:35.113529 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:35.113529 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:35.113529 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:35.113529 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:35.113529 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:35.113529 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:35.113529 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:35.113529 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:35.113529 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:51:35.113529 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:35.113529 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 08:51:35.113529 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:35.124321 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 437/871] 10.222.0.65 () {56 vars in 1132 bytes} [Wed Jul 27 08:51:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:35.130011 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b1b558-d84e-4d89-9e4e-2da034099587 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:35.242931 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b1b558-d84e-4d89-9e4e-2da034099587 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:35.281045 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da85f5-bfe7-46f3-8624-3a7648232ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:35.281674 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da85f5-bfe7-46f3-8624-3a7648232ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:35.281951 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da85f5-bfe7-46f3-8624-3a7648232ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:35.282222 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da85f5-bfe7-46f3-8624-3a7648232ca3 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:35.282962 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da85f5-bfe7-46f3-8624-3a7648232ca3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:35.283268 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da85f5-bfe7-46f3-8624-3a7648232ca3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:35.284654 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da85f5-bfe7-46f3-8624-3a7648232ca3 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:35.290070 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 435/872] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Jul 27 08:51:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:51:35.296488 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02399fe8-00bb-4450-b850-bd6aafeaafd0 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:35.383485 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:35.420755 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02399fe8-00bb-4450-b850-bd6aafeaafd0 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:35.467378 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61767a9-e386-4f8d-aee6-8c30799668e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:35.468294 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61767a9-e386-4f8d-aee6-8c30799668e1 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:35.468707 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61767a9-e386-4f8d-aee6-8c30799668e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:35.469092 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61767a9-e386-4f8d-aee6-8c30799668e1 None admin] PATH_INFO: `/v3/services` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:35.469733 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61767a9-e386-4f8d-aee6-8c30799668e1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:35.470249 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61767a9-e386-4f8d-aee6-8c30799668e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:35.472274 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61767a9-e386-4f8d-aee6-8c30799668e1 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:35.479538 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 438/873] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Jul 27 08:51:35 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:35.804749 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17642b21-78e9-4760-990a-0091fe7e82aa None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:35.805281 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17642b21-78e9-4760-990a-0091fe7e82aa None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:35.805729 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17642b21-78e9-4760-990a-0091fe7e82aa None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:35.809404 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 436/874] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:35.815413 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43372a-8cb5-4436-934d-c20743b9d491 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:35.816370 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43372a-8cb5-4436-934d-c20743b9d491 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:35.816872 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43372a-8cb5-4436-934d-c20743b9d491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:35.837715 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-2c43372a-8cb5-4436-934d-c20743b9d491 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:35.839420 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-2c43372a-8cb5-4436-934d-c20743b9d491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:35.913517 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 439/875] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:35 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:51:35.936735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17642b21-78e9-4760-990a-0091fe7e82aa None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:36.031767 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:36.081803 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295433d-7edf-4b52-83cc-5f052aded10c None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:36.082480 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295433d-7edf-4b52-83cc-5f052aded10c None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:36.082966 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295433d-7edf-4b52-83cc-5f052aded10c None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:36.085205 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 440/876] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:36.089045 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17642b21-78e9-4760-990a-0091fe7e82aa None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:36.091958 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f67098-3cac-40aa-8efe-ad5fb40baefd None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:36.092531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f67098-3cac-40aa-8efe-ad5fb40baefd None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:36.093013 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f67098-3cac-40aa-8efe-ad5fb40baefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:36.120071 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-98f67098-3cac-40aa-8efe-ad5fb40baefd None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:36.121819 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-98f67098-3cac-40aa-8efe-ad5fb40baefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:36.133053 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86eb44-cd0f-4209-ac00-e9e9b66201eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:36.133786 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86eb44-cd0f-4209-ac00-e9e9b66201eb None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:36.134642 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86eb44-cd0f-4209-ac00-e9e9b66201eb None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:36.134924 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86eb44-cd0f-4209-ac00-e9e9b66201eb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:36.135580 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86eb44-cd0f-4209-ac00-e9e9b66201eb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:36.137159 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86eb44-cd0f-4209-ac00-e9e9b66201eb None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:36.147716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-2f86eb44-cd0f-4209-ac00-e9e9b66201eb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 08:51:36.147716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:36.147716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:51:36.147716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:51:36.147716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:51:36.147716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:51:36.147716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:51:36.147716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:36.147716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 08:51:36.147716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:36.147716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:51:36.147716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:36.147716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:36.147716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:36.147716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:36.147716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:36.147716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:36.148823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:36.148823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:36.148823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:36.148823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:36.148823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:36.148823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:36.148823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:51:36.148823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:51:36.148823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:51:36.148823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:51:36.148823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:36.148823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:36.148823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:36.148823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:36.148823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:36.148823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:36.149730 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:36.149730 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:36.149730 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:36.149730 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:36.149730 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:36.149730 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:36.149730 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:36.149730 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:36.149730 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:36.149730 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:36.149730 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:51:36.149730 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:36.149730 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 08:51:36.149730 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:36.149730 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 437/877] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 08:51:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:36.155908 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86eb44-cd0f-4209-ac00-e9e9b66201eb None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:36.212215 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:36.225610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 441/878] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:36 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:51:36.250667 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f67098-3cac-40aa-8efe-ad5fb40baefd None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:36.291620 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86eb44-cd0f-4209-ac00-e9e9b66201eb None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:36.312155 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:36.331602 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430085b-3d11-49c7-b68f-acbeef0d29c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:36.332565 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430085b-3d11-49c7-b68f-acbeef0d29c3 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:36.332998 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430085b-3d11-49c7-b68f-acbeef0d29c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:36.333446 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430085b-3d11-49c7-b68f-acbeef0d29c3 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:36.334297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430085b-3d11-49c7-b68f-acbeef0d29c3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:36.334790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430085b-3d11-49c7-b68f-acbeef0d29c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:36.336331 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430085b-3d11-49c7-b68f-acbeef0d29c3 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:36.342692 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 438/879] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 08:51:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:51:36.348228 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430085b-3d11-49c7-b68f-acbeef0d29c3 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:36.378263 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f67098-3cac-40aa-8efe-ad5fb40baefd None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:36.421934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1a97d-0df7-44d2-b3fb-38f5b0a41a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:36.422945 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1a97d-0df7-44d2-b3fb-38f5b0a41a0d None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:36.423333 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1a97d-0df7-44d2-b3fb-38f5b0a41a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:36.423743 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1a97d-0df7-44d2-b3fb-38f5b0a41a0d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:36.437599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1a97d-0df7-44d2-b3fb-38f5b0a41a0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:51:36.443292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-4de1a97d-0df7-44d2-b3fb-38f5b0a41a0d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 08:51:36.443292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:36.443292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:36.443292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:36.443292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:36.443292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:36.443292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:36.443292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:36.443292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:36.443292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:36.443292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:36.443292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:36.443292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:51:36.443292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:51:36.443292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:51:36.443292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:51:36.444326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:51:36.444326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:51:36.444326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:51:36.444326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:51:36.444326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:36.444326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:36.444326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:36.444326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:36.444326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:36.444326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:36.444326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:36.444326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:36.444326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:36.444326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:36.444326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:36.444326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:36.445175 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:36.445175 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:36.445175 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:36.445175 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:36.445175 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:51:36.445175 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:51:36.445175 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:51:36.445175 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:51:36.445175 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:51:36.445175 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:51:36.445175 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 08:51:36.445175 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:36.452846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 442/880] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Jul 27 08:51:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:51:36.454274 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1a97d-0df7-44d2-b3fb-38f5b0a41a0d None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:36.462974 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430085b-3d11-49c7-b68f-acbeef0d29c3 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:36.500587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68358ef-2be6-4152-958e-f4d57fb86684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:36.501220 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68358ef-2be6-4152-958e-f4d57fb86684 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:36.501502 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68358ef-2be6-4152-958e-f4d57fb86684 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:36.501782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68358ef-2be6-4152-958e-f4d57fb86684 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:36.502528 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68358ef-2be6-4152-958e-f4d57fb86684 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:36.502841 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68358ef-2be6-4152-958e-f4d57fb86684 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:36.504249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68358ef-2be6-4152-958e-f4d57fb86684 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:36.510521 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 439/881] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 08:51:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:51:36.519829 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68358ef-2be6-4152-958e-f4d57fb86684 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:36.527092 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:36.580048 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1a97d-0df7-44d2-b3fb-38f5b0a41a0d None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:36.595409 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:36.635918 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8baec8a-7c22-4b11-8d62-12993cb41c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:36.636564 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8baec8a-7c22-4b11-8d62-12993cb41c3d None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:36.636846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8baec8a-7c22-4b11-8d62-12993cb41c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:36.637120 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8baec8a-7c22-4b11-8d62-12993cb41c3d None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:36.637857 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8baec8a-7c22-4b11-8d62-12993cb41c3d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:36.638161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8baec8a-7c22-4b11-8d62-12993cb41c3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:36.640993 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8baec8a-7c22-4b11-8d62-12993cb41c3d None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:36.652565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 443/882] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Jul 27 08:51:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:36.659262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8baec8a-7c22-4b11-8d62-12993cb41c3d None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:36.682165 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68358ef-2be6-4152-958e-f4d57fb86684 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:36.729359 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69695a5c-6d34-4c3b-bf4f-754c99cc7207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:36.730003 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69695a5c-6d34-4c3b-bf4f-754c99cc7207 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:36.730274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69695a5c-6d34-4c3b-bf4f-754c99cc7207 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:36.730580 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69695a5c-6d34-4c3b-bf4f-754c99cc7207 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:36.731356 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69695a5c-6d34-4c3b-bf4f-754c99cc7207 None admin] RBAC: Adding query filter params (interface=public, service_id=04daeb3faf6741ef8cdf9c93bafc1e76, region_id=RegionOne) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:36.731669 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69695a5c-6d34-4c3b-bf4f-754c99cc7207 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:36.733068 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69695a5c-6d34-4c3b-bf4f-754c99cc7207 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:36.746434 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 440/883] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Jul 27 08:51:36 2022] GET /identity/v3/endpoints?service_id=04daeb3faf6741ef8cdf9c93bafc1e76&interface=public®ion_id=RegionOne => generated 194 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:36.750975 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69695a5c-6d34-4c3b-bf4f-754c99cc7207 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:36.826447 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8baec8a-7c22-4b11-8d62-12993cb41c3d None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:36.848608 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:36.878231 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4e578-571b-4408-ad17-65897698b597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:36.879293 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4e578-571b-4408-ad17-65897698b597 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:36.880173 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4e578-571b-4408-ad17-65897698b597 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:36.880522 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4e578-571b-4408-ad17-65897698b597 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:36.890780 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69695a5c-6d34-4c3b-bf4f-754c99cc7207 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:36.897551 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4e578-571b-4408-ad17-65897698b597 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:36.899912 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4e578-571b-4408-ad17-65897698b597 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:36.903778 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:36.924502 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-e5a4e578-571b-4408-ad17-65897698b597 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:36.924502 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:36.924502 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:36.924502 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:36.924502 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:36.924502 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:36.924502 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:36.924502 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:36.924502 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:36.924502 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:36.924502 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:36.924502 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:36.924502 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:36.924502 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:36.924502 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:36.927864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:36.927864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:36.927864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:36.927864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:36.927864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:36.927864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:36.927864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:36.927864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:36.927864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:36.927864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:36.927864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:36.927864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:36.927864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:36.927864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:36.927864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:36.927864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:36.927864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:36.931483 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:36.931483 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:36.931483 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:36.931483 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:36.934694 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 444/884] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:36.934694 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4e578-571b-4408-ad17-65897698b597 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:36.938052 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c35581-2d20-41a9-8809-0a12593fc708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:36.939008 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c35581-2d20-41a9-8809-0a12593fc708 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:36.939434 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c35581-2d20-41a9-8809-0a12593fc708 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:36.939918 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c35581-2d20-41a9-8809-0a12593fc708 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:36.940784 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c35581-2d20-41a9-8809-0a12593fc708 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:36.942382 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c35581-2d20-41a9-8809-0a12593fc708 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:36.950202 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 441/885] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Jul 27 08:51:36 2022] GET /identity/v3/services => generated 1011 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:51:37.123331 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4e578-571b-4408-ad17-65897698b597 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:37.191893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34df12e-33f9-4e7d-ae6f-85e3ff3537a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:37.192885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34df12e-33f9-4e7d-ae6f-85e3ff3537a3 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:37.193336 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34df12e-33f9-4e7d-ae6f-85e3ff3537a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:37.193774 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34df12e-33f9-4e7d-ae6f-85e3ff3537a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:37.195196 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34df12e-33f9-4e7d-ae6f-85e3ff3537a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:37.195699 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34df12e-33f9-4e7d-ae6f-85e3ff3537a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:37.198283 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34df12e-33f9-4e7d-ae6f-85e3ff3537a3 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:37.226503 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 445/886] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:37.230757 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c35581-2d20-41a9-8809-0a12593fc708 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:37.423215 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c35581-2d20-41a9-8809-0a12593fc708 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:37.461224 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075d1ea-2a75-42ca-93a4-5eb66c997beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:37.461878 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075d1ea-2a75-42ca-93a4-5eb66c997beb None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:37.462523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075d1ea-2a75-42ca-93a4-5eb66c997beb None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:37.462523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075d1ea-2a75-42ca-93a4-5eb66c997beb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:37.471303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075d1ea-2a75-42ca-93a4-5eb66c997beb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:37.472777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075d1ea-2a75-42ca-93a4-5eb66c997beb None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:37.485885 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-c075d1ea-2a75-42ca-93a4-5eb66c997beb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 08:51:37.485885 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:37.485885 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:37.485885 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:37.485885 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:37.485885 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:37.485885 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:37.485885 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:37.485885 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:37.485885 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:37.485885 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:37.485885 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:37.485885 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:51:37.485885 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:51:37.485885 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:51:37.485885 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:51:37.486939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:37.486939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:37.486939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:51:37.486939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:37.486939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:51:37.486939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:37.486939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:37.486939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:37.486939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:37.486939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:37.486939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:37.486939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:37.486939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:37.486939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:37.486939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:37.486939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:37.486939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:37.486939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:37.488078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:37.488078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:37.488078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:51:37.488078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:51:37.488078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:51:37.488078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:51:37.488078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:51:37.488078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:51:37.488078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 08:51:37.488078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:37.488078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 442/887] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Jul 27 08:51:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:37.495221 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34df12e-33f9-4e7d-ae6f-85e3ff3537a3 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:37.528131 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:37.599348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f45440-4472-4649-bc4b-1eaa7c0908ad None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:37.599992 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f45440-4472-4649-bc4b-1eaa7c0908ad None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:37.600472 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f45440-4472-4649-bc4b-1eaa7c0908ad None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:37.606775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 443/888] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:51:37.608876 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99cdad-78a6-4514-8821-32e46342d4f6 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:37.609391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99cdad-78a6-4514-8821-32e46342d4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:37.609869 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99cdad-78a6-4514-8821-32e46342d4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:37.613301 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34df12e-33f9-4e7d-ae6f-85e3ff3537a3 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:37.629977 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-8e99cdad-78a6-4514-8821-32e46342d4f6 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:37.631595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-8e99cdad-78a6-4514-8821-32e46342d4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:37.657920 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89baae14-ca32-46e7-b16f-7fe97bb0eedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:37.658595 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baae14-ca32-46e7-b16f-7fe97bb0eedc None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:37.658874 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baae14-ca32-46e7-b16f-7fe97bb0eedc None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:37.659150 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baae14-ca32-46e7-b16f-7fe97bb0eedc None admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:37.659989 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89baae14-ca32-46e7-b16f-7fe97bb0eedc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:37.660296 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89baae14-ca32-46e7-b16f-7fe97bb0eedc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:37.661794 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89baae14-ca32-46e7-b16f-7fe97bb0eedc None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:37.672780 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:37.686602 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 446/889] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Jul 27 08:51:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:37.691655 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89baae14-ca32-46e7-b16f-7fe97bb0eedc None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:37.738889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 444/890] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:37 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:51:37.755407 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99cdad-78a6-4514-8821-32e46342d4f6 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:37.802800 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:37.829141 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89baae14-ca32-46e7-b16f-7fe97bb0eedc None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:37.877969 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee832442-facb-4a6c-ae10-5d9e7448deba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:37.878634 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee832442-facb-4a6c-ae10-5d9e7448deba None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:37.879521 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee832442-facb-4a6c-ae10-5d9e7448deba None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:37.879809 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee832442-facb-4a6c-ae10-5d9e7448deba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:37.930412 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99cdad-78a6-4514-8821-32e46342d4f6 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:37.972758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee832442-facb-4a6c-ae10-5d9e7448deba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:37.974663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee832442-facb-4a6c-ae10-5d9e7448deba None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:37.993469 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545124b-5de1-4016-8bc8-bed0fd823863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:37.994585 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545124b-5de1-4016-8bc8-bed0fd823863 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:37.995037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545124b-5de1-4016-8bc8-bed0fd823863 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:37.995479 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545124b-5de1-4016-8bc8-bed0fd823863 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:37.996615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5545124b-5de1-4016-8bc8-bed0fd823863 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:37.999292 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5545124b-5de1-4016-8bc8-bed0fd823863 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:38.016359 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-5545124b-5de1-4016-8bc8-bed0fd823863 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 08:51:38.016359 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:38.016359 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:51:38.016359 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:51:38.016359 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:51:38.016359 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:51:38.016359 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:51:38.016359 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:38.016359 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 08:51:38.016359 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:38.016359 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:51:38.016359 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:38.016359 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:38.016359 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:38.016359 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:38.016359 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:38.016359 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:38.017457 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:38.017457 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:38.017457 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:38.017457 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:38.017457 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:38.017457 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:38.017457 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:51:38.017457 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:51:38.017457 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:51:38.017457 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:51:38.017457 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:38.017457 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:38.017457 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:38.017457 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:38.017457 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:38.017457 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:38.018302 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:38.018302 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:38.018302 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:38.018302 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:38.018302 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:38.018302 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:38.018302 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:38.018302 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:38.018302 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:38.018302 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:38.018302 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:51:38.018302 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:38.018302 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 08:51:38.018302 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:38.022703 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 445/891] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Jul 27 08:51:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:51:38.025361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2cbd4-d8ce-45c6-b4b2-03a3a54dc675 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:38.025880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2cbd4-d8ce-45c6-b4b2-03a3a54dc675 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:38.026398 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2cbd4-d8ce-45c6-b4b2-03a3a54dc675 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:38.029069 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 446/892] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:38.030741 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2cbd4-d8ce-45c6-b4b2-03a3a54dc675 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:38.068567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:38.135608 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:38.169296 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 447/893] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:51:37 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 08:51:38.171587 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab479300-4c27-4ffb-97df-72b4a73184c5 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:38.172138 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab479300-4c27-4ffb-97df-72b4a73184c5 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:38.172632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab479300-4c27-4ffb-97df-72b4a73184c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:38.180349 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2cbd4-d8ce-45c6-b4b2-03a3a54dc675 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:38.203330 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-ab479300-4c27-4ffb-97df-72b4a73184c5 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:38.205404 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-ab479300-4c27-4ffb-97df-72b4a73184c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:38.231673 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336cc408-d4b8-4663-9c4e-4840f5eacae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:38.232230 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cc408-d4b8-4663-9c4e-4840f5eacae5 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:38.232511 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cc408-d4b8-4663-9c4e-4840f5eacae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:38.232786 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cc408-d4b8-4663-9c4e-4840f5eacae5 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:38.233503 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336cc408-d4b8-4663-9c4e-4840f5eacae5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:38.233811 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336cc408-d4b8-4663-9c4e-4840f5eacae5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:38.235272 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336cc408-d4b8-4663-9c4e-4840f5eacae5 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:38.240931 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 447/894] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Jul 27 08:51:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:38.241757 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336cc408-d4b8-4663-9c4e-4840f5eacae5 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:38.352697 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 448/895] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:38 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:51:38.354892 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab479300-4c27-4ffb-97df-72b4a73184c5 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:38.388361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:38.403073 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336cc408-d4b8-4663-9c4e-4840f5eacae5 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:38.457446 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8e8d4-e548-4b35-a160-121193c977ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:38.458614 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8e8d4-e548-4b35-a160-121193c977ff None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:38.459112 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8e8d4-e548-4b35-a160-121193c977ff None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:38.459602 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8e8d4-e548-4b35-a160-121193c977ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:38.480961 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8e8d4-e548-4b35-a160-121193c977ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:38.483888 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8e8d4-e548-4b35-a160-121193c977ff None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:38.503953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-2df8e8d4-e548-4b35-a160-121193c977ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:38.503953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:38.503953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:38.503953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:38.503953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:38.503953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:38.503953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:38.503953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:38.503953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:38.503953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:38.503953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:38.503953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:38.503953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:38.503953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:38.503953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:38.504948 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:38.504948 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:38.504948 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:38.504948 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:38.504948 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:38.504948 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:38.504948 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:38.504948 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:38.504948 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:38.504948 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:38.504948 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:38.504948 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:38.504948 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:38.504948 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:38.504948 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:38.504948 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:38.504948 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:38.506303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:38.506303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:38.506303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:38.506303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:38.506303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 448/896] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:38.506303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8e8d4-e548-4b35-a160-121193c977ff None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:38.549688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab479300-4c27-4ffb-97df-72b4a73184c5 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:38.579469 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:38.610468 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec358dbf-3a36-4698-87e8-63d13e6edff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:38.611374 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec358dbf-3a36-4698-87e8-63d13e6edff6 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:38.611861 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec358dbf-3a36-4698-87e8-63d13e6edff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:38.612344 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec358dbf-3a36-4698-87e8-63d13e6edff6 None admin] PATH_INFO: `/v3/services` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:38.613607 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec358dbf-3a36-4698-87e8-63d13e6edff6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:38.614153 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec358dbf-3a36-4698-87e8-63d13e6edff6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:38.616777 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec358dbf-3a36-4698-87e8-63d13e6edff6 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:38.625451 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 449/897] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Jul 27 08:51:38 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:38.626831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec358dbf-3a36-4698-87e8-63d13e6edff6 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:38.668049 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8e8d4-e548-4b35-a160-121193c977ff None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:38.729092 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd86c59-fa99-45aa-9b35-3b1d91468a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:38.730238 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd86c59-fa99-45aa-9b35-3b1d91468a98 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:38.730811 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd86c59-fa99-45aa-9b35-3b1d91468a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:38.731699 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd86c59-fa99-45aa-9b35-3b1d91468a98 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:38.732847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd86c59-fa99-45aa-9b35-3b1d91468a98 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:38.735854 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd86c59-fa99-45aa-9b35-3b1d91468a98 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:38.771500 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 449/898] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 08:51:38 2022] POST /identity/v3/services => generated 269 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:51:38.845455 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec358dbf-3a36-4698-87e8-63d13e6edff6 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:38.927017 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28730f-32a6-410d-abcc-cb837d20522c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:38.928166 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28730f-32a6-410d-abcc-cb837d20522c None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:38.928648 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28730f-32a6-410d-abcc-cb837d20522c None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:38.929105 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28730f-32a6-410d-abcc-cb837d20522c None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:38.930431 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28730f-32a6-410d-abcc-cb837d20522c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:38.931107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28730f-32a6-410d-abcc-cb837d20522c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:38.934241 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28730f-32a6-410d-abcc-cb837d20522c None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:38.957886 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 450/899] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:38.965331 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd86c59-fa99-45aa-9b35-3b1d91468a98 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:38.970296 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:39.092927 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd86c59-fa99-45aa-9b35-3b1d91468a98 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:39.138652 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006dc991-b467-42b0-b220-3abe996a4d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:39.139328 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006dc991-b467-42b0-b220-3abe996a4d7f None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:39.139606 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006dc991-b467-42b0-b220-3abe996a4d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:39.139879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006dc991-b467-42b0-b220-3abe996a4d7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:39.147955 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006dc991-b467-42b0-b220-3abe996a4d7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:39.149450 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006dc991-b467-42b0-b220-3abe996a4d7f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:39.163054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-006dc991-b467-42b0-b220-3abe996a4d7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:39.163054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:39.163054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:39.163054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:39.163054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:39.163054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:39.163054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:39.163054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:39.163054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:39.163054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:39.163054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:39.163054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:39.163054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:51:39.163054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:51:39.163054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:51:39.164002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:51:39.164002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:39.164002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:39.164002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:39.164002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:39.164002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:39.164002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:39.164002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:39.164002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:39.164002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:39.164002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:39.164002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:39.164002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:39.164002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:39.164002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:39.164002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:39.164002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:39.165131 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:51:39.165131 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:51:39.165131 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:51:39.165131 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:51:39.165131 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:51:39.165131 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:51:39.165131 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:39.165131 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:39.165131 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 450/900] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:51:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:39.172669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28730f-32a6-410d-abcc-cb837d20522c None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:39.213717 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:39.335638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28730f-32a6-410d-abcc-cb837d20522c None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:39.341561 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d11849-9a5b-47f0-aa7e-2c00867a9188 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:39.341906 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d11849-9a5b-47f0-aa7e-2c00867a9188 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:39.342126 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d11849-9a5b-47f0-aa7e-2c00867a9188 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:39.343894 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 451/901] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:51:39.349270 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf021c-32bb-477d-8b8d-37ebbe86287a None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:39.349553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf021c-32bb-477d-8b8d-37ebbe86287a None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:39.349827 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf021c-32bb-477d-8b8d-37ebbe86287a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:39.370876 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-89bf021c-32bb-477d-8b8d-37ebbe86287a None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:39.372116 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-89bf021c-32bb-477d-8b8d-37ebbe86287a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:39.398757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93316110-2b8e-476d-a852-6bf2e8e9e6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:39.400762 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93316110-2b8e-476d-a852-6bf2e8e9e6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:39.401266 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93316110-2b8e-476d-a852-6bf2e8e9e6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:39.401741 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93316110-2b8e-476d-a852-6bf2e8e9e6b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:39.403216 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93316110-2b8e-476d-a852-6bf2e8e9e6b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:39.403849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93316110-2b8e-476d-a852-6bf2e8e9e6b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:39.406908 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93316110-2b8e-476d-a852-6bf2e8e9e6b0 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:39.435533 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 451/902] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:51:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:39.437653 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93316110-2b8e-476d-a852-6bf2e8e9e6b0 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:39.460944 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:39.482348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 452/903] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:51:39.505846 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf021c-32bb-477d-8b8d-37ebbe86287a None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:39.580090 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:39.587036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93316110-2b8e-476d-a852-6bf2e8e9e6b0 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:39.629527 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158205c1-2be0-4cf8-89db-b8267ae3a909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:39.630675 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158205c1-2be0-4cf8-89db-b8267ae3a909 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:39.631258 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158205c1-2be0-4cf8-89db-b8267ae3a909 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:39.631739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158205c1-2be0-4cf8-89db-b8267ae3a909 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:39.632904 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158205c1-2be0-4cf8-89db-b8267ae3a909 None admin] RBAC: Adding query filter params (role.id=1e9124c6b23746fe97007d59fe6af878, scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267, user.id=c607472800fc49d5a75c5e6acb33f2a2) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:39.633555 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158205c1-2be0-4cf8-89db-b8267ae3a909 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:39.635826 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158205c1-2be0-4cf8-89db-b8267ae3a909 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:39.651163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 452/904] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:51:39 2022] GET /identity/v3/role_assignments?user.id=c607472800fc49d5a75c5e6acb33f2a2&scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267&role.id=1e9124c6b23746fe97007d59fe6af878 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:39.715813 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf021c-32bb-477d-8b8d-37ebbe86287a None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:39.791233 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac41e7-054d-4578-a3d3-9c8f174cd523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:39.792393 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac41e7-054d-4578-a3d3-9c8f174cd523 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:39.792870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac41e7-054d-4578-a3d3-9c8f174cd523 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:39.793361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac41e7-054d-4578-a3d3-9c8f174cd523 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:39.794609 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac41e7-054d-4578-a3d3-9c8f174cd523 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:39.797283 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac41e7-054d-4578-a3d3-9c8f174cd523 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:39.815858 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-57ac41e7-054d-4578-a3d3-9c8f174cd523 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 08:51:39.815858 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:39.815858 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:51:39.815858 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:51:39.815858 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:51:39.815858 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:51:39.815858 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:51:39.815858 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:39.815858 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 08:51:39.815858 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:39.815858 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:51:39.815858 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:39.815858 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:39.815858 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:39.815858 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:39.815858 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:39.815858 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:39.816922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:39.816922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:39.816922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:39.816922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:39.816922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:39.816922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:39.816922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:51:39.816922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:51:39.816922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:51:39.816922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:51:39.816922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:39.816922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:39.816922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:39.816922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:39.816922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:39.816922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:39.817793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:39.817793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:39.817793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:39.817793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:39.817793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:39.817793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:39.817793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:39.817793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:39.817793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:39.817793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:39.817793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:51:39.817793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:39.817793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 08:51:39.817793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:39.818590 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 453/905] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 08:51:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:51:39.826206 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158205c1-2be0-4cf8-89db-b8267ae3a909 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:39.940160 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158205c1-2be0-4cf8-89db-b8267ae3a909 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:39.982164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88e7e6-abf7-45b9-bd9d-f285ecb8ce17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:39.983195 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88e7e6-abf7-45b9-bd9d-f285ecb8ce17 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:39.983717 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88e7e6-abf7-45b9-bd9d-f285ecb8ce17 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:39.984198 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88e7e6-abf7-45b9-bd9d-f285ecb8ce17 None admin] PATH_INFO: `/v3/services` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:39.985109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88e7e6-abf7-45b9-bd9d-f285ecb8ce17 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:39.985638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88e7e6-abf7-45b9-bd9d-f285ecb8ce17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:39.987273 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88e7e6-abf7-45b9-bd9d-f285ecb8ce17 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:39.993475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 453/906] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 08:51:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:40.003608 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac41e7-054d-4578-a3d3-9c8f174cd523 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:40.150763 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:40.218409 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac41e7-054d-4578-a3d3-9c8f174cd523 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:40.287381 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd6c24-6b36-4d39-90d0-cf96bbbb76ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:40.288460 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd6c24-6b36-4d39-90d0-cf96bbbb76ab None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:40.288948 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd6c24-6b36-4d39-90d0-cf96bbbb76ab None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:40.289428 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd6c24-6b36-4d39-90d0-cf96bbbb76ab None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:40.290793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd6c24-6b36-4d39-90d0-cf96bbbb76ab None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:40.291333 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd6c24-6b36-4d39-90d0-cf96bbbb76ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:40.293921 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd6c24-6b36-4d39-90d0-cf96bbbb76ab None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:40.304244 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 454/907] 10.222.0.65 () {56 vars in 1114 bytes} [Wed Jul 27 08:51:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:40.313574 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88e7e6-abf7-45b9-bd9d-f285ecb8ce17 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:40.342528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:40.429909 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88e7e6-abf7-45b9-bd9d-f285ecb8ce17 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:40.469108 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa47e8-20c7-40de-9a68-0c4da0f1599c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:40.469642 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa47e8-20c7-40de-9a68-0c4da0f1599c None admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:40.469924 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa47e8-20c7-40de-9a68-0c4da0f1599c None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:40.470200 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa47e8-20c7-40de-9a68-0c4da0f1599c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:40.470956 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa47e8-20c7-40de-9a68-0c4da0f1599c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:40.472360 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa47e8-20c7-40de-9a68-0c4da0f1599c None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:40.503750 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 454/908] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 08:51:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:51:40.888026 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdf62a-4d7d-4d92-81ee-43c55eef2a56 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:40.888390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdf62a-4d7d-4d92-81ee-43c55eef2a56 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:40.888627 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdf62a-4d7d-4d92-81ee-43c55eef2a56 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:40.890368 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 455/909] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:40.895992 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efadab-a4ba-4cae-ae1d-2627ef43b3be None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:40.896277 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efadab-a4ba-4cae-ae1d-2627ef43b3be None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:40.896549 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efadab-a4ba-4cae-ae1d-2627ef43b3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:40.916624 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-63efadab-a4ba-4cae-ae1d-2627ef43b3be None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:40.917848 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-63efadab-a4ba-4cae-ae1d-2627ef43b3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:40.988576 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f083004-8696-4fb3-bcf3-691c5679f288 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:40.988856 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f083004-8696-4fb3-bcf3-691c5679f288 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:40.989374 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f083004-8696-4fb3-bcf3-691c5679f288 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:40.991290 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 456/910] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:40.997539 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71ad21-5162-47e8-bb97-555845b2a7e9 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:40.998140 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71ad21-5162-47e8-bb97-555845b2a7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:40.998643 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71ad21-5162-47e8-bb97-555845b2a7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:41.005001 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 455/911] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:40 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:51:41.019852 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-4c71ad21-5162-47e8-bb97-555845b2a7e9 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:41.021876 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4c71ad21-5162-47e8-bb97-555845b2a7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:41.034365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63efadab-a4ba-4cae-ae1d-2627ef43b3be None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:41.042942 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:41.113992 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 457/912] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:40 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:51:41.140369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71ad21-5162-47e8-bb97-555845b2a7e9 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:41.168006 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63efadab-a4ba-4cae-ae1d-2627ef43b3be None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:41.205247 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:41.224233 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f3597-2ba5-421e-8a86-f87659534d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:41.225298 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f3597-2ba5-421e-8a86-f87659534d2f None admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:41.226031 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f3597-2ba5-421e-8a86-f87659534d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:41.227460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f3597-2ba5-421e-8a86-f87659534d2f None admin] PATH_INFO: `/v3/services` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:41.228993 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f3597-2ba5-421e-8a86-f87659534d2f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:41.230757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f3597-2ba5-421e-8a86-f87659534d2f None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:41.251902 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 456/913] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 08:51:41 2022] POST /identity/v3/services => generated 241 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:51:41.267444 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71ad21-5162-47e8-bb97-555845b2a7e9 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:41.320166 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e303d3-1daa-49f4-9f0e-28f39c6dd93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:41.320835 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e303d3-1daa-49f4-9f0e-28f39c6dd93c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:41.321115 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e303d3-1daa-49f4-9f0e-28f39c6dd93c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:41.321430 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e303d3-1daa-49f4-9f0e-28f39c6dd93c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:41.323036 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e303d3-1daa-49f4-9f0e-28f39c6dd93c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:41.324677 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e303d3-1daa-49f4-9f0e-28f39c6dd93c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:41.335211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-69e303d3-1daa-49f4-9f0e-28f39c6dd93c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 08:51:41.335211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:41.335211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:51:41.335211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:51:41.335211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:51:41.335211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:51:41.335211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:51:41.335211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:41.335211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 08:51:41.335211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:41.335211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:51:41.335211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:41.335211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:41.335211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:41.335211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:41.335211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:41.336223 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:41.336223 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:41.336223 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:41.336223 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:41.336223 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:41.336223 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:41.336223 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:41.336223 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:51:41.336223 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:51:41.336223 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:51:41.336223 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:51:41.336223 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:41.336223 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:41.336223 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:41.336223 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:41.336223 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:41.337081 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:41.337081 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:41.337081 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:41.337081 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:41.337081 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:41.337081 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:41.337081 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:41.337081 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:41.337081 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:41.337081 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:41.337081 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:41.337081 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:51:41.337081 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:41.337081 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 08:51:41.337081 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:41.337081 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 458/914] 10.222.0.65 () {56 vars in 1132 bytes} [Wed Jul 27 08:51:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:41.345508 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f3597-2ba5-421e-8a86-f87659534d2f None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:41.428337 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:41.474643 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f3597-2ba5-421e-8a86-f87659534d2f None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:41.520218 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e19a1f-7be0-4d9b-a3c0-7a44c2fff505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:41.520860 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e19a1f-7be0-4d9b-a3c0-7a44c2fff505 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:41.521135 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e19a1f-7be0-4d9b-a3c0-7a44c2fff505 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:41.521416 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e19a1f-7be0-4d9b-a3c0-7a44c2fff505 None admin] PATH_INFO: `/v3/services` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:41.522111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e19a1f-7be0-4d9b-a3c0-7a44c2fff505 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:41.522439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e19a1f-7be0-4d9b-a3c0-7a44c2fff505 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:41.523929 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e19a1f-7be0-4d9b-a3c0-7a44c2fff505 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:41.531475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 457/915] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Jul 27 08:51:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:41.541119 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e303d3-1daa-49f4-9f0e-28f39c6dd93c None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:41.738639 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e303d3-1daa-49f4-9f0e-28f39c6dd93c None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:41.765021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:41.809163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4eeb2-2f8f-4893-a04b-f77030538c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:41.810274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4eeb2-2f8f-4893-a04b-f77030538c9e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:41.810805 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4eeb2-2f8f-4893-a04b-f77030538c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:41.811293 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4eeb2-2f8f-4893-a04b-f77030538c9e None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:41.812556 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4eeb2-2f8f-4893-a04b-f77030538c9e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:41.813103 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4eeb2-2f8f-4893-a04b-f77030538c9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:41.815744 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4eeb2-2f8f-4893-a04b-f77030538c9e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:41.830450 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 459/916] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Jul 27 08:51:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:41.840117 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e19a1f-7be0-4d9b-a3c0-7a44c2fff505 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:42.017863 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e19a1f-7be0-4d9b-a3c0-7a44c2fff505 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:42.049358 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:42.056298 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc99ad1-fffb-433a-a92e-6b4b868d54d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:42.057311 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc99ad1-fffb-433a-a92e-6b4b868d54d7 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:42.057579 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc99ad1-fffb-433a-a92e-6b4b868d54d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:42.057855 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc99ad1-fffb-433a-a92e-6b4b868d54d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:42.058359 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad618ab-cd74-4f7a-9342-257bbede06f3 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:42.058798 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc99ad1-fffb-433a-a92e-6b4b868d54d7 None admin] RBAC: Adding query filter params (interface=public, service_id=50b4a32f4a1d4550b22c9f665aa7a6e6, region_id=RegionOne) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:42.059002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc99ad1-fffb-433a-a92e-6b4b868d54d7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:42.059481 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad618ab-cd74-4f7a-9342-257bbede06f3 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:42.059955 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad618ab-cd74-4f7a-9342-257bbede06f3 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:42.060329 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc99ad1-fffb-433a-a92e-6b4b868d54d7 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:42.062059 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 460/917] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:42.066584 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 458/918] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Jul 27 08:51:41 2022] GET /identity/v3/endpoints?service_id=50b4a32f4a1d4550b22c9f665aa7a6e6&interface=public®ion_id=RegionOne => generated 194 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:42.068184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c97c3-1ef1-4164-b7f2-366337f31d3f None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:42.068552 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c97c3-1ef1-4164-b7f2-366337f31d3f None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:42.068899 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c97c3-1ef1-4164-b7f2-366337f31d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:42.077809 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc99ad1-fffb-433a-a92e-6b4b868d54d7 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:42.093994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f02c97c3-1ef1-4164-b7f2-366337f31d3f None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:42.096234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f02c97c3-1ef1-4164-b7f2-366337f31d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:42.190216 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 461/919] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:51:42.208401 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc99ad1-fffb-433a-a92e-6b4b868d54d7 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:42.219631 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c97c3-1ef1-4164-b7f2-366337f31d3f None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:42.267469 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed183f-4bcc-46eb-b8f8-758848cc3a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:42.268277 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed183f-4bcc-46eb-b8f8-758848cc3a2d None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:42.268442 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed183f-4bcc-46eb-b8f8-758848cc3a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:42.268684 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed183f-4bcc-46eb-b8f8-758848cc3a2d None admin] PATH_INFO: `/v3/services` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:42.269280 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed183f-4bcc-46eb-b8f8-758848cc3a2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:42.270706 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed183f-4bcc-46eb-b8f8-758848cc3a2d None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:42.286983 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 459/920] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Jul 27 08:51:42 2022] GET /identity/v3/services => generated 1497 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:51:42.423638 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c97c3-1ef1-4164-b7f2-366337f31d3f None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:42.447207 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:42.490755 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6f283-5383-4b96-a6d4-f6c832e12a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:42.492362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6f283-5383-4b96-a6d4-f6c832e12a70 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:42.492890 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6f283-5383-4b96-a6d4-f6c832e12a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:42.493342 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6f283-5383-4b96-a6d4-f6c832e12a70 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:42.513164 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6f283-5383-4b96-a6d4-f6c832e12a70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:51:42.522979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-50a6f283-5383-4b96-a6d4-f6c832e12a70 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 08:51:42.522979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:42.522979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:42.522979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:42.522979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:42.522979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:42.522979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:42.522979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:42.522979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:42.522979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:42.522979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:42.522979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:42.522979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:51:42.522979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:51:42.522979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:51:42.522979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:51:42.524180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:51:42.524180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:51:42.524180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:51:42.524180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:51:42.524180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:42.524180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:42.524180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:42.524180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:42.524180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:42.524180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:42.524180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:42.524180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:42.524180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:42.524180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:42.524180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:42.524180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:42.525953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:42.525953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:42.525953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:42.525953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:42.525953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:51:42.525953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:51:42.525953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:51:42.525953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:51:42.525953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:51:42.525953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:51:42.525953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 08:51:42.525953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:42.525953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 462/921] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Jul 27 08:51:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:51:42.535300 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed183f-4bcc-46eb-b8f8-758848cc3a2d None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:42.637683 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:42.700105 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed183f-4bcc-46eb-b8f8-758848cc3a2d None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:42.737933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ac65b-c9e8-4ba4-86af-bb49c3cd6c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:42.738587 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ac65b-c9e8-4ba4-86af-bb49c3cd6c03 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:42.738865 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ac65b-c9e8-4ba4-86af-bb49c3cd6c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:42.739152 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ac65b-c9e8-4ba4-86af-bb49c3cd6c03 None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:42.739870 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ac65b-c9e8-4ba4-86af-bb49c3cd6c03 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:42.740174 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ac65b-c9e8-4ba4-86af-bb49c3cd6c03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:42.741562 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ac65b-c9e8-4ba4-86af-bb49c3cd6c03 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:42.755016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 460/922] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Jul 27 08:51:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:42.763953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6f283-5383-4b96-a6d4-f6c832e12a70 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:42.859601 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1baec-b724-4b4c-88a7-a7af5acb9920 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:42.859791 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1baec-b724-4b4c-88a7-a7af5acb9920 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:42.860067 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1baec-b724-4b4c-88a7-a7af5acb9920 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:42.861599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 461/923] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:51:42.867239 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa9699-fee0-4d7e-bbed-a0b506677b2d None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:42.867870 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa9699-fee0-4d7e-bbed-a0b506677b2d None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:42.868367 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa9699-fee0-4d7e-bbed-a0b506677b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:42.890162 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-80aa9699-fee0-4d7e-bbed-a0b506677b2d None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:42.891796 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-80aa9699-fee0-4d7e-bbed-a0b506677b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:42.908861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6f283-5383-4b96-a6d4-f6c832e12a70 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:42.978422 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 462/924] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:51:42.980165 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1103c-6ad5-45a7-b9b5-9f92fbd7faf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:42.981539 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1103c-6ad5-45a7-b9b5-9f92fbd7faf2 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:42.982112 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1103c-6ad5-45a7-b9b5-9f92fbd7faf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:42.982659 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1103c-6ad5-45a7-b9b5-9f92fbd7faf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:42.995909 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa9699-fee0-4d7e-bbed-a0b506677b2d None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:43.003080 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1103c-6ad5-45a7-b9b5-9f92fbd7faf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:43.005210 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1103c-6ad5-45a7-b9b5-9f92fbd7faf2 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:43.025709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-2dc1103c-6ad5-45a7-b9b5-9f92fbd7faf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:43.025709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:43.025709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:43.025709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:43.025709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:43.025709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:43.025709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:43.025709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:43.025709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:43.025709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:43.025709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:43.025709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:43.025709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:43.025709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:43.025709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:43.026726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:43.026726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:43.026726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:43.026726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:43.026726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:43.026726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:43.026726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:43.026726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:43.026726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:43.026726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:43.026726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:43.026726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:43.026726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:43.026726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:43.026726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:43.026726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:43.026726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:43.027655 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:43.027655 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:43.027655 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:43.027655 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:43.030183 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 463/925] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:43.038702 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1103c-6ad5-45a7-b9b5-9f92fbd7faf2 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:43.066156 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:43.076521 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:43.145839 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa9699-fee0-4d7e-bbed-a0b506677b2d None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:43.200344 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef7f62-bdd0-43f5-a749-a5e6f30ed55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:43.201352 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef7f62-bdd0-43f5-a749-a5e6f30ed55a None admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:43.201918 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef7f62-bdd0-43f5-a749-a5e6f30ed55a None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:43.203204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef7f62-bdd0-43f5-a749-a5e6f30ed55a None admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:43.204507 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef7f62-bdd0-43f5-a749-a5e6f30ed55a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:43.208384 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef7f62-bdd0-43f5-a749-a5e6f30ed55a None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:43.214827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: WARNING keystone.server.flask.common [None req-91ef7f62-bdd0-43f5-a749-a5e6f30ed55a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 27 08:51:43.247483 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.sql.core [None req-91ef7f62-bdd0-43f5-a749-a5e6f30ed55a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 08:51:43.247483 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 08:51:43.247483 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [parameters: {'id': 'fb1ad6a0b45746c0b5411b99c4783d9c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 08:51:43.247483 dv-cinder-797608-64-smb devstack@keystone.service[80153]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80153) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 08:51:43.251314 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1103c-6ad5-45a7-b9b5-9f92fbd7faf2 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:43.268505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-91ef7f62-bdd0-43f5-a749-a5e6f30ed55a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fb1ad6a0b45746c0b5411b99c4783d9c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fb1ad6a0b45746c0b5411b99c4783d9c. Jul 27 08:51:43.268505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:43.268505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 08:51:43.268505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 08:51:43.268505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 08:51:43.268505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 08:51:43.268505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 08:51:43.268505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 08:51:43.268505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 08:51:43.268505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application conn.query(q) Jul 27 08:51:43.268505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 08:51:43.268505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 08:51:43.268505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 08:51:43.269936 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application result.read() Jul 27 08:51:43.269936 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 08:51:43.269936 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 08:51:43.269936 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 08:51:43.269936 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 08:51:43.269936 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 08:51:43.269936 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 08:51:43.269936 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 08:51:43.269936 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 08:51:43.269936 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 08:51:43.269936 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:43.269936 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 08:51:43.269936 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:43.269936 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:43.269936 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 08:51:43.269936 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 08:51:43.269936 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 27 08:51:43.269936 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 27 08:51:43.271854 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 08:51:43.271854 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application next(self.gen) Jul 27 08:51:43.271854 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 08:51:43.271854 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application yield resource Jul 27 08:51:43.271854 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 08:51:43.271854 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application next(self.gen) Jul 27 08:51:43.271854 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 08:51:43.271854 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 08:51:43.271854 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 08:51:43.271854 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 08:51:43.271854 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 08:51:43.271854 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise self.value Jul 27 08:51:43.271854 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 08:51:43.271854 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 08:51:43.271854 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 08:51:43.271854 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application session.commit() Jul 27 08:51:43.271854 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 08:51:43.273669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 08:51:43.273669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 08:51:43.273669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 08:51:43.273669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 08:51:43.273669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self.session.flush() Jul 27 08:51:43.273669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 08:51:43.273669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 08:51:43.273669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 08:51:43.273669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 08:51:43.273669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 08:51:43.273669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application compat.raise_( Jul 27 08:51:43.273669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 08:51:43.273669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception Jul 27 08:51:43.273669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 08:51:43.273669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 08:51:43.273669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 08:51:43.273669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 08:51:43.278029 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 08:51:43.278029 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 08:51:43.278029 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 08:51:43.278029 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 08:51:43.278029 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 27 08:51:43.278029 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 27 08:51:43.278029 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 08:51:43.278029 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 08:51:43.278029 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 08:51:43.278029 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 08:51:43.278029 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 08:51:43.278029 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 08:51:43.278029 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 08:51:43.278029 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 08:51:43.278029 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 08:51:43.279885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 08:51:43.279885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 08:51:43.279885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception Jul 27 08:51:43.279885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 08:51:43.279885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 08:51:43.279885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 08:51:43.279885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 08:51:43.279885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 08:51:43.279885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 08:51:43.279885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 08:51:43.279885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application conn.query(q) Jul 27 08:51:43.279885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 08:51:43.279885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 08:51:43.279885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 08:51:43.279885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application result.read() Jul 27 08:51:43.279885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 08:51:43.279885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 08:51:43.292227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 08:51:43.292227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 08:51:43.292227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 08:51:43.292227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 08:51:43.292227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 08:51:43.292227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 08:51:43.292227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 08:51:43.292227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 08:51:43.292227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [parameters: {'id': 'fb1ad6a0b45746c0b5411b99c4783d9c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 08:51:43.292227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 08:51:43.292227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:43.292227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:51:43.292227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:43.292227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:43.292227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 27 08:51:43.293994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 27 08:51:43.293994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 08:51:43.293994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 08:51:43.293994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 27 08:51:43.293994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:43.293994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:51:43.293994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:43.293994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:43.293994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:43.293994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:43.293994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:43.293994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:43.293994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:43.293994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:43.293994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:43.293994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:43.293994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:43.303380 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:43.303380 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 27 08:51:43.303380 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 27 08:51:43.303380 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:43.303380 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:43.303380 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 27 08:51:43.303380 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 27 08:51:43.303380 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fb1ad6a0b45746c0b5411b99c4783d9c. Jul 27 08:51:43.303380 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:43.303380 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 463/926] 10.222.0.65 () {60 vars in 1140 bytes} [Wed Jul 27 08:51:42 2022] POST /identity/v3/projects => generated 262 bytes in 278 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:51:43.303380 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef7f62-bdd0-43f5-a749-a5e6f30ed55a None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:43.305042 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d052cc-e697-47ee-819f-2924d776c358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:43.305928 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d052cc-e697-47ee-819f-2924d776c358 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:43.307427 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d052cc-e697-47ee-819f-2924d776c358 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:43.308379 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d052cc-e697-47ee-819f-2924d776c358 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:43.309229 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d052cc-e697-47ee-819f-2924d776c358 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:43.309929 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d052cc-e697-47ee-819f-2924d776c358 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:43.311705 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d052cc-e697-47ee-819f-2924d776c358 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:43.328936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 464/927] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:43.334649 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d052cc-e697-47ee-819f-2924d776c358 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:43.501626 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:43.509814 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef7f62-bdd0-43f5-a749-a5e6f30ed55a None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:43.527563 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:43.552168 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d052cc-e697-47ee-819f-2924d776c358 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:43.569221 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b3804-ca63-4573-932c-060e9f8e3c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:43.570552 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b3804-ca63-4573-932c-060e9f8e3c6b None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:43.571291 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b3804-ca63-4573-932c-060e9f8e3c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:43.572276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b3804-ca63-4573-932c-060e9f8e3c6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:43.581923 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b3804-ca63-4573-932c-060e9f8e3c6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:43.583949 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b3804-ca63-4573-932c-060e9f8e3c6b None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:43.600842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-1d4b3804-ca63-4573-932c-060e9f8e3c6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:43.600842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:43.600842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:43.600842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:43.600842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:43.600842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:43.600842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:43.600842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:43.600842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:43.600842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:43.600842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:43.600842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:43.600842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:51:43.600842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:51:43.600842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:51:43.602720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:51:43.602720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:43.602720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:43.602720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:43.602720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:43.602720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:43.602720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:43.602720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:43.602720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:43.602720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:43.602720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:43.602720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:43.602720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:43.602720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:43.602720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:43.602720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:43.602720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:43.605809 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:51:43.605809 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:51:43.605809 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:51:43.605809 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:51:43.605809 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:51:43.605809 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:51:43.605809 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:43.605809 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:43.605809 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 464/928] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:51:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:43.605809 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a5f38-5709-4cd7-a503-8fb9e5c91c2f None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:43.605809 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a5f38-5709-4cd7-a503-8fb9e5c91c2f None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:43.607228 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a5f38-5709-4cd7-a503-8fb9e5c91c2f None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:43.614371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 465/929] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:43.614371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a5f38-5709-4cd7-a503-8fb9e5c91c2f None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:43.614658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193178f-a991-4c2b-bbaf-0961c0e81d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:43.614658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193178f-a991-4c2b-bbaf-0961c0e81d72 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:43.615265 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193178f-a991-4c2b-bbaf-0961c0e81d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:43.615543 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193178f-a991-4c2b-bbaf-0961c0e81d72 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:43.624975 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193178f-a991-4c2b-bbaf-0961c0e81d72 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:43.626940 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193178f-a991-4c2b-bbaf-0961c0e81d72 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:43.641437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-2193178f-a991-4c2b-bbaf-0961c0e81d72 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 08:51:43.641437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:43.641437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:43.641437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:43.641437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:43.641437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:43.641437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:43.641437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:43.641437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:43.641437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:43.641437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:43.641437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:43.641437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:51:43.641437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:51:43.641437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:51:43.641437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:51:43.644203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:43.644203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:43.644203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:51:43.644203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:43.644203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:51:43.644203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:43.644203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:43.644203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:43.644203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:43.644203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:43.644203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:43.644203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:43.644203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:43.644203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:43.644203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:43.644203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:43.644203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:43.644203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:43.649092 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:43.649092 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:43.649092 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:51:43.649092 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:51:43.649092 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:51:43.649092 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:51:43.649092 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:51:43.649092 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:51:43.649092 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 08:51:43.649092 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:43.649092 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 465/930] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Jul 27 08:51:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:43.651509 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5550c63-bed4-4cbb-a523-dfd027855f56 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:43.651509 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5550c63-bed4-4cbb-a523-dfd027855f56 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:43.651509 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5550c63-bed4-4cbb-a523-dfd027855f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:43.672718 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-a5550c63-bed4-4cbb-a523-dfd027855f56 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:43.673972 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a5550c63-bed4-4cbb-a523-dfd027855f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:43.798422 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 466/931] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:51:43.798725 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a5f38-5709-4cd7-a503-8fb9e5c91c2f None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:43.798874 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5550c63-bed4-4cbb-a523-dfd027855f56 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:43.860927 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94184a2f-3df1-4d76-91a0-4d53d4962b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:43.861939 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94184a2f-3df1-4d76-91a0-4d53d4962b87 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:43.862466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94184a2f-3df1-4d76-91a0-4d53d4962b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:43.862939 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94184a2f-3df1-4d76-91a0-4d53d4962b87 None admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:43.864203 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94184a2f-3df1-4d76-91a0-4d53d4962b87 None admin] RBAC: Adding query filter params (name=service) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:43.864671 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94184a2f-3df1-4d76-91a0-4d53d4962b87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:43.867171 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94184a2f-3df1-4d76-91a0-4d53d4962b87 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:43.906351 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 466/932] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 08:51:43 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:43.906351 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94184a2f-3df1-4d76-91a0-4d53d4962b87 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:43.937541 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:43.969715 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:44.025474 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5550c63-bed4-4cbb-a523-dfd027855f56 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:44.100615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039781a-8c4f-4983-87bd-e671fdfc1ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:44.101599 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039781a-8c4f-4983-87bd-e671fdfc1ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:44.102087 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039781a-8c4f-4983-87bd-e671fdfc1ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:44.102619 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039781a-8c4f-4983-87bd-e671fdfc1ba7 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:44.104263 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039781a-8c4f-4983-87bd-e671fdfc1ba7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:44.104798 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039781a-8c4f-4983-87bd-e671fdfc1ba7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:44.108846 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039781a-8c4f-4983-87bd-e671fdfc1ba7 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:44.123331 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94184a2f-3df1-4d76-91a0-4d53d4962b87 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:44.150388 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 467/933] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Jul 27 08:51:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:44.158651 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039781a-8c4f-4983-87bd-e671fdfc1ba7 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:44.203742 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cb93b-f339-4fae-99be-e8ce8a6b117a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:44.206082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cb93b-f339-4fae-99be-e8ce8a6b117a None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:44.206616 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cb93b-f339-4fae-99be-e8ce8a6b117a None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:44.207470 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cb93b-f339-4fae-99be-e8ce8a6b117a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:44.208670 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cb93b-f339-4fae-99be-e8ce8a6b117a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:44.212017 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cb93b-f339-4fae-99be-e8ce8a6b117a None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:44.229659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-b04cb93b-f339-4fae-99be-e8ce8a6b117a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 08:51:44.229659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:44.229659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:51:44.229659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:51:44.229659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:51:44.229659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:51:44.229659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:51:44.229659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:44.229659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 08:51:44.229659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:44.229659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:51:44.229659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:44.229659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:44.229659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:44.229659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:44.229659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:44.229659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:44.230825 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:44.230825 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:44.230825 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:44.230825 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:44.230825 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:44.230825 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:44.230825 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:51:44.230825 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:51:44.230825 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:51:44.230825 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:51:44.230825 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:44.230825 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:44.230825 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:44.230825 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:44.230825 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:44.230825 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:44.232321 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:44.232321 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:44.232321 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:44.232321 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:44.232321 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:44.232321 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:44.232321 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:44.232321 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:44.232321 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:44.232321 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:44.232321 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:51:44.232321 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:44.232321 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 08:51:44.232321 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:44.232321 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 467/934] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Jul 27 08:51:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:44.237478 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cb93b-f339-4fae-99be-e8ce8a6b117a None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:44.327010 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039781a-8c4f-4983-87bd-e671fdfc1ba7 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:44.361879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:44.372059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:44.376721 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b89ef-74c9-4817-8ce4-3ccfccb0939e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:44.377765 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b89ef-74c9-4817-8ce4-3ccfccb0939e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:44.378734 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b89ef-74c9-4817-8ce4-3ccfccb0939e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:44.379369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b89ef-74c9-4817-8ce4-3ccfccb0939e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:44.393849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cb93b-f339-4fae-99be-e8ce8a6b117a None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:44.396581 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b89ef-74c9-4817-8ce4-3ccfccb0939e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:44.399894 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b89ef-74c9-4817-8ce4-3ccfccb0939e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:44.427346 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-ee8b89ef-74c9-4817-8ce4-3ccfccb0939e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:44.427346 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:44.427346 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:44.427346 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:44.427346 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:44.427346 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:44.427346 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:44.427346 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:44.427346 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:44.427346 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:44.427346 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:44.427346 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:44.427346 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:44.427346 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:44.427346 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:44.428312 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:44.428312 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:44.428312 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:44.428312 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:44.428312 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:44.428312 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:44.428312 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:44.428312 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:44.428312 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:44.428312 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:44.428312 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:44.428312 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:44.428312 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:44.428312 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:44.428312 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:44.428312 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:44.428312 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:44.429224 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:44.429224 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:44.429224 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:44.429224 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:44.434705 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 468/935] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:51:44.439965 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b89ef-74c9-4817-8ce4-3ccfccb0939e None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:44.449830 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea14ee-04f2-4418-a030-b9f3424e9b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:44.451313 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea14ee-04f2-4418-a030-b9f3424e9b0e None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:44.451803 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea14ee-04f2-4418-a030-b9f3424e9b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:44.452299 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea14ee-04f2-4418-a030-b9f3424e9b0e None admin] PATH_INFO: `/v3/services` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:44.453194 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea14ee-04f2-4418-a030-b9f3424e9b0e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:44.453790 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea14ee-04f2-4418-a030-b9f3424e9b0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:44.455506 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea14ee-04f2-4418-a030-b9f3424e9b0e None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:44.468661 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 468/936] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Jul 27 08:51:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:51:44.471161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea14ee-04f2-4418-a030-b9f3424e9b0e None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:44.607846 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b89ef-74c9-4817-8ce4-3ccfccb0939e None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:44.669881 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea14ee-04f2-4418-a030-b9f3424e9b0e None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:44.677105 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828b90a-25ba-4256-a249-c5d4a8fa6b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:44.677983 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828b90a-25ba-4256-a249-c5d4a8fa6b16 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:44.678417 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828b90a-25ba-4256-a249-c5d4a8fa6b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:44.678809 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828b90a-25ba-4256-a249-c5d4a8fa6b16 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:44.679802 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828b90a-25ba-4256-a249-c5d4a8fa6b16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:44.680240 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828b90a-25ba-4256-a249-c5d4a8fa6b16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:44.682867 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828b90a-25ba-4256-a249-c5d4a8fa6b16 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:44.703681 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 469/937] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:44.706009 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad6cb8-860d-4ecd-98de-ebbbc5124995 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:44.706539 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad6cb8-860d-4ecd-98de-ebbbc5124995 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:44.707000 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad6cb8-860d-4ecd-98de-ebbbc5124995 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:44.710407 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 470/938] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:44.715791 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad6cb8-860d-4ecd-98de-ebbbc5124995 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:44.736157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d206c7-c556-4513-ba2c-c4aee9dd3462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:44.736794 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d206c7-c556-4513-ba2c-c4aee9dd3462 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:44.737074 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d206c7-c556-4513-ba2c-c4aee9dd3462 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:44.737731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d206c7-c556-4513-ba2c-c4aee9dd3462 None admin] PATH_INFO: `/v3/services` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:44.738473 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d206c7-c556-4513-ba2c-c4aee9dd3462 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:44.738775 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d206c7-c556-4513-ba2c-c4aee9dd3462 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:44.740481 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d206c7-c556-4513-ba2c-c4aee9dd3462 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:44.755933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 469/939] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Jul 27 08:51:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:44.755933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e0009-a841-4e70-83ae-a65f5042ce27 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:44.755933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e0009-a841-4e70-83ae-a65f5042ce27 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:44.755933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e0009-a841-4e70-83ae-a65f5042ce27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:44.786401 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-ee9e0009-a841-4e70-83ae-a65f5042ce27 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:44.787212 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:44.790100 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-ee9e0009-a841-4e70-83ae-a65f5042ce27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:44.814920 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:44.898592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad6cb8-860d-4ecd-98de-ebbbc5124995 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:44.918367 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 470/940] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:51:44.919409 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e0009-a841-4e70-83ae-a65f5042ce27 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:44.943731 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabaf233-f0c3-4cf1-9f2e-65d532f26a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:44.944621 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabaf233-f0c3-4cf1-9f2e-65d532f26a1d None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:44.945050 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabaf233-f0c3-4cf1-9f2e-65d532f26a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:44.945492 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabaf233-f0c3-4cf1-9f2e-65d532f26a1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:44.954532 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabaf233-f0c3-4cf1-9f2e-65d532f26a1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:44.956300 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabaf233-f0c3-4cf1-9f2e-65d532f26a1d None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:44.969994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-eabaf233-f0c3-4cf1-9f2e-65d532f26a1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:44.969994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:44.969994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:44.969994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:44.969994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:44.969994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:44.969994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:44.969994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:44.969994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:44.969994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:44.969994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:44.969994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:44.969994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:51:44.969994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:51:44.969994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:51:44.972028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:51:44.972028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:44.972028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:44.972028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:44.972028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:44.972028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:44.972028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:44.972028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:44.972028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:44.972028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:44.972028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:44.972028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:44.972028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:44.972028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:44.972028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:44.972028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:44.972028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:44.973772 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:51:44.973772 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:51:44.973772 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:51:44.973772 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:51:44.973772 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:51:44.973772 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:51:44.973772 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:44.973772 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:44.973772 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 471/941] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:51:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:44.973772 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabaf233-f0c3-4cf1-9f2e-65d532f26a1d None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:45.099857 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:45.106231 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabaf233-f0c3-4cf1-9f2e-65d532f26a1d None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:45.132390 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e0009-a841-4e70-83ae-a65f5042ce27 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:45.158898 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde741c0-335c-49e2-8e46-d57c2e90dcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:45.159921 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde741c0-335c-49e2-8e46-d57c2e90dcae None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:45.160275 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde741c0-335c-49e2-8e46-d57c2e90dcae None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:45.160633 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde741c0-335c-49e2-8e46-d57c2e90dcae None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:45.161694 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde741c0-335c-49e2-8e46-d57c2e90dcae None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:45.164081 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde741c0-335c-49e2-8e46-d57c2e90dcae None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:45.180425 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-cde741c0-335c-49e2-8e46-d57c2e90dcae None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 08:51:45.180425 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:45.180425 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:51:45.180425 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:51:45.180425 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:51:45.180425 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:51:45.180425 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:51:45.180425 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:45.180425 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 08:51:45.180425 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:45.180425 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:51:45.180425 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:45.180425 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:45.180425 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:45.180425 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:45.180425 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:45.183099 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:45.183099 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:45.183099 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:45.183099 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:45.183099 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:45.183099 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:45.183099 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:45.183099 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:51:45.183099 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:51:45.183099 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:51:45.183099 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:51:45.183099 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:45.183099 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:45.183099 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:45.183099 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:45.183099 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:45.184754 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:45.184754 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:45.184754 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:45.184754 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:45.184754 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:45.184754 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:45.184754 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:45.184754 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:45.184754 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:45.184754 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:45.184754 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:45.184754 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:51:45.184754 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:45.184754 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 08:51:45.184754 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:45.184754 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 472/942] 10.222.0.65 () {56 vars in 1132 bytes} [Wed Jul 27 08:51:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:45.187161 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde741c0-335c-49e2-8e46-d57c2e90dcae None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:45.206162 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626665a8-dded-4660-9afa-4cb1f86dfded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:45.206639 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626665a8-dded-4660-9afa-4cb1f86dfded None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:45.206915 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626665a8-dded-4660-9afa-4cb1f86dfded None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:45.207170 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626665a8-dded-4660-9afa-4cb1f86dfded None admin] PATH_INFO: `/v3/endpoints` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:45.208237 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626665a8-dded-4660-9afa-4cb1f86dfded None admin] RBAC: Adding query filter params (interface=public, service_id=5b4e215f194b49e8a1f19174df5faf87, region_id=RegionOne) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:45.208745 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626665a8-dded-4660-9afa-4cb1f86dfded None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:45.210984 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626665a8-dded-4660-9afa-4cb1f86dfded None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:45.229469 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 471/943] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Jul 27 08:51:44 2022] GET /identity/v3/endpoints?service_id=5b4e215f194b49e8a1f19174df5faf87&interface=public®ion_id=RegionOne => generated 194 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:45.229469 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626665a8-dded-4660-9afa-4cb1f86dfded None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:45.254229 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:45.346076 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde741c0-335c-49e2-8e46-d57c2e90dcae None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:45.406685 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07f1c8-2afb-46b3-882c-53816ba29aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:45.407580 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07f1c8-2afb-46b3-882c-53816ba29aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:45.407972 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07f1c8-2afb-46b3-882c-53816ba29aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:45.408359 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07f1c8-2afb-46b3-882c-53816ba29aa2 None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:45.409274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07f1c8-2afb-46b3-882c-53816ba29aa2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:45.409708 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07f1c8-2afb-46b3-882c-53816ba29aa2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:45.412209 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07f1c8-2afb-46b3-882c-53816ba29aa2 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:45.432164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626665a8-dded-4660-9afa-4cb1f86dfded None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:45.433676 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 473/944] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:51:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:45.435102 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07f1c8-2afb-46b3-882c-53816ba29aa2 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:45.482269 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:45.507279 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f6eaa-195a-43a8-acd4-aaef35e69ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:45.508776 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f6eaa-195a-43a8-acd4-aaef35e69ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:45.509559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f6eaa-195a-43a8-acd4-aaef35e69ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:45.510230 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f6eaa-195a-43a8-acd4-aaef35e69ab2 None admin] PATH_INFO: `/v3/services` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:45.511682 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f6eaa-195a-43a8-acd4-aaef35e69ab2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:45.512449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f6eaa-195a-43a8-acd4-aaef35e69ab2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:45.514932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f6eaa-195a-43a8-acd4-aaef35e69ab2 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:45.528439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 472/945] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Jul 27 08:51:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:45.528439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f6eaa-195a-43a8-acd4-aaef35e69ab2 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:45.624345 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07f1c8-2afb-46b3-882c-53816ba29aa2 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:45.646377 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:45.666011 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645ed83-d8bb-44ac-ac9e-ef1a0f1e29da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:45.666604 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645ed83-d8bb-44ac-ac9e-ef1a0f1e29da None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:45.666879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645ed83-d8bb-44ac-ac9e-ef1a0f1e29da None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:45.667248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645ed83-d8bb-44ac-ac9e-ef1a0f1e29da None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:45.667937 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645ed83-d8bb-44ac-ac9e-ef1a0f1e29da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:45.669347 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645ed83-d8bb-44ac-ac9e-ef1a0f1e29da None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:45.675919 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 474/946] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Jul 27 08:51:45 2022] GET /identity/v3/services => generated 1497 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:51:45.676777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645ed83-d8bb-44ac-ac9e-ef1a0f1e29da None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:45.706166 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f6eaa-195a-43a8-acd4-aaef35e69ab2 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:45.756545 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209fce4-653d-4283-b478-c6b8a41e11dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:45.757628 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209fce4-653d-4283-b478-c6b8a41e11dd None admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:45.757628 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209fce4-653d-4283-b478-c6b8a41e11dd None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:45.757955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209fce4-653d-4283-b478-c6b8a41e11dd None admin] PATH_INFO: `/v3/projects/3f77fdd017ea4a9b9b49f6e87ba7f267/users/c607472800fc49d5a75c5e6acb33f2a2/roles/1e9124c6b23746fe97007d59fe6af878` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:45.761205 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209fce4-653d-4283-b478-c6b8a41e11dd None admin] RBAC: Authorizing `identity:create_grant(project_id=3f77fdd017ea4a9b9b49f6e87ba7f267, user_id=c607472800fc49d5a75c5e6acb33f2a2, role_id=1e9124c6b23746fe97007d59fe6af878)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:45.762779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209fce4-653d-4283-b478-c6b8a41e11dd None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:45.786375 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 473/947] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 08:51:45 2022] PUT /identity/v3/projects/3f77fdd017ea4a9b9b49f6e87ba7f267/users/c607472800fc49d5a75c5e6acb33f2a2/roles/1e9124c6b23746fe97007d59fe6af878 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:51:45.830712 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:45.853905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645ed83-d8bb-44ac-ac9e-ef1a0f1e29da None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:45.910716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177d88f-cc28-4365-9f6d-ea467e6ebece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:45.911684 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177d88f-cc28-4365-9f6d-ea467e6ebece None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:45.912265 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177d88f-cc28-4365-9f6d-ea467e6ebece None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:45.912693 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177d88f-cc28-4365-9f6d-ea467e6ebece None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:45.913631 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177d88f-cc28-4365-9f6d-ea467e6ebece None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:45.914188 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177d88f-cc28-4365-9f6d-ea467e6ebece None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:45.917343 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177d88f-cc28-4365-9f6d-ea467e6ebece None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:45.926823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 475/948] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Jul 27 08:51:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:45.933237 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209fce4-653d-4283-b478-c6b8a41e11dd None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:46.068967 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209fce4-653d-4283-b478-c6b8a41e11dd None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:46.124533 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff60279-afb1-4fdf-8e71-ed8827e2d749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:46.125211 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff60279-afb1-4fdf-8e71-ed8827e2d749 None admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:46.125714 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff60279-afb1-4fdf-8e71-ed8827e2d749 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:46.126216 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff60279-afb1-4fdf-8e71-ed8827e2d749 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:46.127622 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff60279-afb1-4fdf-8e71-ed8827e2d749 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:46.130376 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff60279-afb1-4fdf-8e71-ed8827e2d749 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:46.146803 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:46.172249 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 474/949] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 08:51:45 2022] POST /identity/v3/endpoints => generated 347 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:51:46.183711 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a385bd2-1dbc-4dee-b076-1f0882033d2f None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:46.184260 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a385bd2-1dbc-4dee-b076-1f0882033d2f None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:46.184260 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a385bd2-1dbc-4dee-b076-1f0882033d2f None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:46.186084 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 476/950] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:46.192009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc884a94-8ca8-4cbe-ad9f-32af5c83b753 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:46.192349 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc884a94-8ca8-4cbe-ad9f-32af5c83b753 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:46.192559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc884a94-8ca8-4cbe-ad9f-32af5c83b753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:46.217655 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-fc884a94-8ca8-4cbe-ad9f-32af5c83b753 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:46.219720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-fc884a94-8ca8-4cbe-ad9f-32af5c83b753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:46.319063 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 475/951] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:51:46.348091 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a385bd2-1dbc-4dee-b076-1f0882033d2f None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:46.483904 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a385bd2-1dbc-4dee-b076-1f0882033d2f None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:46.522421 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f31e3-68c9-4554-8d53-11655ee1f000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:46.523055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f31e3-68c9-4554-8d53-11655ee1f000 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:46.523339 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f31e3-68c9-4554-8d53-11655ee1f000 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:46.523613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f31e3-68c9-4554-8d53-11655ee1f000 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:46.524310 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f31e3-68c9-4554-8d53-11655ee1f000 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:46.526522 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f31e3-68c9-4554-8d53-11655ee1f000 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:46.529162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: WARNING keystone.server.flask.common [None req-a64f31e3-68c9-4554-8d53-11655ee1f000 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 27 08:51:46.542679 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.sql.core [None req-a64f31e3-68c9-4554-8d53-11655ee1f000 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 08:51:46.542679 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 08:51:46.542679 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [parameters: {'user_id': '61d34e8a00844eba818868c68175f763', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 08:51:46.542679 dv-cinder-797608-64-smb devstack@keystone.service[80152]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80152) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 08:51:46.568232 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-a64f31e3-68c9-4554-8d53-11655ee1f000 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 08:51:46.568232 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:46.568232 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 08:51:46.568232 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 08:51:46.568232 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 08:51:46.568232 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 08:51:46.568232 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 08:51:46.568232 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 08:51:46.568232 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 08:51:46.568232 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application conn.query(q) Jul 27 08:51:46.568232 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 08:51:46.568232 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 08:51:46.568232 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 08:51:46.568232 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application result.read() Jul 27 08:51:46.568232 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 08:51:46.569276 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 08:51:46.569276 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 08:51:46.569276 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 08:51:46.569276 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 08:51:46.569276 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 08:51:46.569276 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 08:51:46.569276 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 08:51:46.569276 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 08:51:46.569276 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:46.569276 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 08:51:46.569276 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:46.569276 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:46.569276 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 08:51:46.569276 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 08:51:46.569276 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 27 08:51:46.569276 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 27 08:51:46.569276 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 08:51:46.569276 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application next(self.gen) Jul 27 08:51:46.570274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 08:51:46.570274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application yield resource Jul 27 08:51:46.570274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 08:51:46.570274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application next(self.gen) Jul 27 08:51:46.570274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 08:51:46.570274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 08:51:46.570274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 08:51:46.570274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 08:51:46.570274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 08:51:46.570274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise self.value Jul 27 08:51:46.570274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 08:51:46.570274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 08:51:46.570274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 08:51:46.570274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application session.commit() Jul 27 08:51:46.570274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 08:51:46.570274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 08:51:46.570274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 08:51:46.571213 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 08:51:46.571213 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 08:51:46.571213 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application self.session.flush() Jul 27 08:51:46.571213 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 08:51:46.571213 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 08:51:46.571213 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 08:51:46.571213 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 08:51:46.571213 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 08:51:46.571213 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application compat.raise_( Jul 27 08:51:46.571213 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 08:51:46.571213 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception Jul 27 08:51:46.571213 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 08:51:46.571213 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 08:51:46.571213 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 08:51:46.571213 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 08:51:46.571213 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 08:51:46.571213 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 08:51:46.572658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 08:51:46.572658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 08:51:46.572658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 27 08:51:46.572658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 27 08:51:46.572658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 08:51:46.572658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 08:51:46.572658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 08:51:46.572658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 08:51:46.572658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 08:51:46.572658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 08:51:46.572658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 08:51:46.572658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 08:51:46.572658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 08:51:46.572658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 08:51:46.572658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 08:51:46.572658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception Jul 27 08:51:46.573646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 08:51:46.573646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 08:51:46.573646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 08:51:46.573646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 08:51:46.573646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 08:51:46.573646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 08:51:46.573646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 08:51:46.573646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application conn.query(q) Jul 27 08:51:46.573646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 08:51:46.573646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 08:51:46.573646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 08:51:46.573646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application result.read() Jul 27 08:51:46.573646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 08:51:46.573646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 08:51:46.573646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 08:51:46.573646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 08:51:46.575821 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 08:51:46.575821 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 08:51:46.575821 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 08:51:46.575821 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 08:51:46.575821 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 08:51:46.575821 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 08:51:46.575821 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [parameters: {'user_id': '61d34e8a00844eba818868c68175f763', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 08:51:46.575821 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 08:51:46.575821 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:46.575821 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:51:46.575821 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:46.575821 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:46.575821 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:46.575821 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:46.575821 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:46.577744 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:46.577744 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:46.577744 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:46.577744 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:46.577744 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:46.577744 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:46.577744 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:46.577744 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 27 08:51:46.577744 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 27 08:51:46.577744 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:46.577744 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:46.577744 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:51:46.577744 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:46.577744 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:51:46.577744 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:46.577744 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 27 08:51:46.577744 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 27 08:51:46.584963 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 27 08:51:46.584963 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 27 08:51:46.584963 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 08:51:46.584963 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 08:51:46.584963 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 08:51:46.584963 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:46.584963 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 477/952] 10.222.0.65 () {60 vars in 1131 bytes} [Wed Jul 27 08:51:46 2022] POST /identity/v3/users => generated 160 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:46.585954 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc884a94-8ca8-4cbe-ad9f-32af5c83b753 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:46.713351 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc884a94-8ca8-4cbe-ad9f-32af5c83b753 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:46.735182 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:46.756688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f7daf-92c6-4f25-9d86-8fd14293f8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:46.757357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f7daf-92c6-4f25-9d86-8fd14293f8f4 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:46.757635 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f7daf-92c6-4f25-9d86-8fd14293f8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:46.757912 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f7daf-92c6-4f25-9d86-8fd14293f8f4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:46.767233 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f7daf-92c6-4f25-9d86-8fd14293f8f4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:46.768729 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f7daf-92c6-4f25-9d86-8fd14293f8f4 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:46.783366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-642f7daf-92c6-4f25-9d86-8fd14293f8f4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 08:51:46.783366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:46.783366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:46.783366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:46.783366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:46.783366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:46.783366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:46.783366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:46.783366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:46.783366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:46.783366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:46.783366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:46.783366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:51:46.783366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:51:46.783366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:51:46.783366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:51:46.785616 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:46.785616 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:46.785616 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:51:46.785616 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:46.785616 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:51:46.785616 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:46.785616 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:46.785616 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:46.785616 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:46.785616 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:46.785616 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:46.785616 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:46.785616 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:46.785616 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:46.785616 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:46.785616 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:46.785616 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:46.785616 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:46.787057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:46.787057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:46.787057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:51:46.787057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:51:46.787057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:51:46.787057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:51:46.787057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:51:46.787057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:51:46.787057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 08:51:46.787057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:46.787057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 476/953] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:51:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:46.793322 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f31e3-68c9-4554-8d53-11655ee1f000 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:46.813674 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:46.912947 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f31e3-68c9-4554-8d53-11655ee1f000 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:46.950352 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5138b-36dd-44d7-80b4-d61a1b04e35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:46.951024 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5138b-36dd-44d7-80b4-d61a1b04e35b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:46.951297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5138b-36dd-44d7-80b4-d61a1b04e35b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:46.951573 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5138b-36dd-44d7-80b4-d61a1b04e35b None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:46.952432 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda5138b-36dd-44d7-80b4-d61a1b04e35b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:46.952743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda5138b-36dd-44d7-80b4-d61a1b04e35b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:46.954440 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda5138b-36dd-44d7-80b4-d61a1b04e35b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:47.001871 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 478/954] 10.222.0.65 () {56 vars in 1101 bytes} [Wed Jul 27 08:51:46 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:47.952732 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d946b2-bedd-48cc-a9b2-3b9334cf1b6d None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:47.953268 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d946b2-bedd-48cc-a9b2-3b9334cf1b6d None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:47.953268 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d946b2-bedd-48cc-a9b2-3b9334cf1b6d None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:47.954856 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 477/955] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:47.960495 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342994ea-3dba-4baa-9760-1af265875abb None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:47.961023 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342994ea-3dba-4baa-9760-1af265875abb None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:47.961023 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342994ea-3dba-4baa-9760-1af265875abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:47.980910 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-342994ea-3dba-4baa-9760-1af265875abb None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:47.982460 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-342994ea-3dba-4baa-9760-1af265875abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:48.093810 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:48.103426 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 479/956] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:51:48.145298 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d946b2-bedd-48cc-a9b2-3b9334cf1b6d None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:48.360525 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d946b2-bedd-48cc-a9b2-3b9334cf1b6d None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:48.428842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928f58e-5b16-495b-a4a1-a947f694d96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:48.429957 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928f58e-5b16-495b-a4a1-a947f694d96c None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:48.430473 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928f58e-5b16-495b-a4a1-a947f694d96c None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:48.430962 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928f58e-5b16-495b-a4a1-a947f694d96c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:48.432668 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928f58e-5b16-495b-a4a1-a947f694d96c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:48.435281 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928f58e-5b16-495b-a4a1-a947f694d96c None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:48.453223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-b928f58e-5b16-495b-a4a1-a947f694d96c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 08:51:48.453223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:48.453223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:51:48.453223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:51:48.453223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:51:48.453223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:51:48.453223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:51:48.453223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:48.453223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 08:51:48.453223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:48.453223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:51:48.453223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:48.453223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:48.453223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:48.453223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:48.453223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:48.453223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:48.460794 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:48.460794 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:48.460794 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:48.460794 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:48.460794 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:48.460794 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:48.460794 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:51:48.460794 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:51:48.460794 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:51:48.460794 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:51:48.460794 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:48.460794 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:48.460794 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:48.460794 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:48.460794 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:48.460794 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:48.463402 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:48.463402 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:48.463402 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:48.463402 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:48.463402 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:48.463402 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:48.463402 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:48.463402 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:48.463402 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:48.463402 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:48.463402 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:51:48.463402 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:48.463402 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 08:51:48.463402 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:48.463402 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 478/957] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Jul 27 08:51:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:48.470850 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342994ea-3dba-4baa-9760-1af265875abb None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:48.524254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f68276-82b2-4d0c-bef3-5a192dee2beb None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:48.524694 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f68276-82b2-4d0c-bef3-5a192dee2beb None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:48.526228 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f68276-82b2-4d0c-bef3-5a192dee2beb None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:48.528501 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 479/958] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:51:48.535153 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffc8d8-ad29-49a7-a42d-28decc5a9ee3 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:48.535989 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffc8d8-ad29-49a7-a42d-28decc5a9ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:48.536177 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffc8d8-ad29-49a7-a42d-28decc5a9ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:48.557975 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-96ffc8d8-ad29-49a7-a42d-28decc5a9ee3 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:48.559234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-96ffc8d8-ad29-49a7-a42d-28decc5a9ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:48.601909 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:48.638447 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 480/959] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:51:48.642573 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e102d07-53dc-43a6-8fec-987862c83a3b None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:48.643129 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e102d07-53dc-43a6-8fec-987862c83a3b None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:48.643523 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e102d07-53dc-43a6-8fec-987862c83a3b None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:48.645264 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 481/960] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:48.652284 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac67d16-9c8e-438a-8b89-6765b8710026 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:48.652722 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac67d16-9c8e-438a-8b89-6765b8710026 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:48.653165 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac67d16-9c8e-438a-8b89-6765b8710026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:48.672360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342994ea-3dba-4baa-9760-1af265875abb None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:48.674414 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-fac67d16-9c8e-438a-8b89-6765b8710026 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:48.675579 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-fac67d16-9c8e-438a-8b89-6765b8710026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:48.730097 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6175e6-3874-4edc-8001-b283c9f9a099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:48.731198 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6175e6-3874-4edc-8001-b283c9f9a099 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:48.731699 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6175e6-3874-4edc-8001-b283c9f9a099 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:48.732187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6175e6-3874-4edc-8001-b283c9f9a099 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:48.733452 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6175e6-3874-4edc-8001-b283c9f9a099 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:48.733998 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6175e6-3874-4edc-8001-b283c9f9a099 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:48.736673 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6175e6-3874-4edc-8001-b283c9f9a099 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:48.746782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 480/961] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Jul 27 08:51:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:48.748468 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6175e6-3874-4edc-8001-b283c9f9a099 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:48.751262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 482/962] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:51:48.760520 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac67d16-9c8e-438a-8b89-6765b8710026 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:48.838036 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:48.896293 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6175e6-3874-4edc-8001-b283c9f9a099 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:48.917875 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac67d16-9c8e-438a-8b89-6765b8710026 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:48.919863 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:48.941266 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fde5e5-3140-42b0-89d5-f104d284ddcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:48.942335 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fde5e5-3140-42b0-89d5-f104d284ddcf None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:48.942780 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fde5e5-3140-42b0-89d5-f104d284ddcf None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:48.943156 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fde5e5-3140-42b0-89d5-f104d284ddcf None admin] PATH_INFO: `/v3/services/compute` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:48.943806 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fde5e5-3140-42b0-89d5-f104d284ddcf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:48.945311 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fde5e5-3140-42b0-89d5-f104d284ddcf None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:48.956363 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-26fde5e5-3140-42b0-89d5-f104d284ddcf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 08:51:48.956363 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:48.956363 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:51:48.956363 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:51:48.956363 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:51:48.956363 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:51:48.956363 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:51:48.956363 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:48.956363 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 08:51:48.956363 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:48.956363 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:51:48.956363 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:48.956363 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:48.956363 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:48.956363 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:48.956363 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:48.956363 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:48.958187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:48.958187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:48.958187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:48.958187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:48.958187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:48.958187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:48.958187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:51:48.958187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:51:48.958187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:51:48.958187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:51:48.958187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:48.958187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:48.958187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:48.958187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:48.958187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:48.958187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:48.959775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:48.959775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:48.959775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:48.959775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:48.959775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:48.959775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:48.959775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:48.959775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:48.959775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:48.959775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:48.959775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:51:48.959775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:48.959775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 08:51:48.959775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:48.959775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 481/963] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:51:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:48.961267 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fde5e5-3140-42b0-89d5-f104d284ddcf None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:48.970955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c410e0-0e3b-45fb-acd1-8b51cc1ceb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:48.971961 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c410e0-0e3b-45fb-acd1-8b51cc1ceb79 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:48.972390 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c410e0-0e3b-45fb-acd1-8b51cc1ceb79 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:48.972868 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c410e0-0e3b-45fb-acd1-8b51cc1ceb79 None admin] PATH_INFO: `/v3/services` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:48.973665 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c410e0-0e3b-45fb-acd1-8b51cc1ceb79 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:48.974127 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c410e0-0e3b-45fb-acd1-8b51cc1ceb79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:48.975730 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c410e0-0e3b-45fb-acd1-8b51cc1ceb79 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:48.982209 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 483/964] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Jul 27 08:51:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:48.983092 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c410e0-0e3b-45fb-acd1-8b51cc1ceb79 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:49.101497 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c410e0-0e3b-45fb-acd1-8b51cc1ceb79 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:49.107074 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fde5e5-3140-42b0-89d5-f104d284ddcf None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:49.141537 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:49.143308 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c22f8-f5d5-4665-b820-271348dda0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:49.143998 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c22f8-f5d5-4665-b820-271348dda0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:49.144195 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c22f8-f5d5-4665-b820-271348dda0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:49.144560 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c22f8-f5d5-4665-b820-271348dda0d2 None admin] PATH_INFO: `/v3/services` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:49.145149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c22f8-f5d5-4665-b820-271348dda0d2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:49.145451 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c22f8-f5d5-4665-b820-271348dda0d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:49.147014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c22f8-f5d5-4665-b820-271348dda0d2 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:49.152631 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 484/965] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 08:51:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:49.153450 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c22f8-f5d5-4665-b820-271348dda0d2 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:49.157801 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a07df5-7cab-4072-be40-1981176bc3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:49.158966 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a07df5-7cab-4072-be40-1981176bc3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:49.159458 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a07df5-7cab-4072-be40-1981176bc3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:49.159962 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a07df5-7cab-4072-be40-1981176bc3b5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:49.178875 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a07df5-7cab-4072-be40-1981176bc3b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:51:49.189288 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:49.192743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-85a07df5-7cab-4072-be40-1981176bc3b5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 08:51:49.192743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:49.192743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:49.192743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:49.192743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:49.192743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:49.192743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:49.192743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:49.192743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:49.192743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:49.192743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:49.192743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:49.192743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:51:49.192743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:51:49.192743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:51:49.192743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:51:49.194004 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:51:49.194004 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:51:49.194004 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:51:49.194004 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:51:49.194004 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:49.194004 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:49.194004 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:49.194004 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:49.194004 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:49.194004 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:49.194004 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:49.194004 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:49.194004 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:49.194004 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:49.194004 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:49.194004 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:49.195415 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:49.195415 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:49.195415 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:49.195415 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:49.195415 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:51:49.195415 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:51:49.195415 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:51:49.195415 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:51:49.195415 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:51:49.195415 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:51:49.195415 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 08:51:49.195415 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:49.195415 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 482/966] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Jul 27 08:51:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:49.197738 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a07df5-7cab-4072-be40-1981176bc3b5 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:49.293056 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c22f8-f5d5-4665-b820-271348dda0d2 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:49.340819 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f375b42-8515-449e-bca5-b374bd3a8b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:49.341626 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f375b42-8515-449e-bca5-b374bd3a8b63 None admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:49.341954 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f375b42-8515-449e-bca5-b374bd3a8b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:49.342290 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f375b42-8515-449e-bca5-b374bd3a8b63 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:49.343365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f375b42-8515-449e-bca5-b374bd3a8b63 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:49.345013 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f375b42-8515-449e-bca5-b374bd3a8b63 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:49.345887 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a07df5-7cab-4072-be40-1981176bc3b5 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:49.382427 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 485/967] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 08:51:49 2022] POST /identity/v3/endpoints => generated 349 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:51:49.382427 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f375b42-8515-449e-bca5-b374bd3a8b63 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:49.401788 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ef383-57ed-476b-95c8-59ee1d63bf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:49.402336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ef383-57ed-476b-95c8-59ee1d63bf29 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:49.402634 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ef383-57ed-476b-95c8-59ee1d63bf29 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:49.402916 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ef383-57ed-476b-95c8-59ee1d63bf29 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:49.403619 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ef383-57ed-476b-95c8-59ee1d63bf29 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:49.403926 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ef383-57ed-476b-95c8-59ee1d63bf29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:49.405370 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ef383-57ed-476b-95c8-59ee1d63bf29 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:49.411714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 483/968] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 08:51:49 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:49.519599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:49.546764 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f375b42-8515-449e-bca5-b374bd3a8b63 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:49.595981 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78871065-8d96-4cb3-b858-dec83f53ff51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:49.597126 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78871065-8d96-4cb3-b858-dec83f53ff51 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:49.597755 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78871065-8d96-4cb3-b858-dec83f53ff51 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:49.598263 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78871065-8d96-4cb3-b858-dec83f53ff51 None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:49.599441 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78871065-8d96-4cb3-b858-dec83f53ff51 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:49.599996 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78871065-8d96-4cb3-b858-dec83f53ff51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:49.601716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78871065-8d96-4cb3-b858-dec83f53ff51 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:49.618406 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 486/969] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Jul 27 08:51:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:49.619663 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ef383-57ed-476b-95c8-59ee1d63bf29 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:49.704731 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:49.770758 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ef383-57ed-476b-95c8-59ee1d63bf29 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:49.813010 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ac599-09a8-41b1-a5f3-ea6b31815200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:49.813841 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ac599-09a8-41b1-a5f3-ea6b31815200 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:49.814214 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ac599-09a8-41b1-a5f3-ea6b31815200 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:49.814637 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ac599-09a8-41b1-a5f3-ea6b31815200 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:49.828348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ac599-09a8-41b1-a5f3-ea6b31815200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:49.829971 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ac599-09a8-41b1-a5f3-ea6b31815200 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:49.846911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-511ac599-09a8-41b1-a5f3-ea6b31815200 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:49.846911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:49.846911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:49.846911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:49.846911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:49.846911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:49.846911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:49.846911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:49.846911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:49.846911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:49.846911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:49.846911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:49.846911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:49.846911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:49.846911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:49.848477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:49.848477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:49.848477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:49.848477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:49.848477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:49.848477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:49.848477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:49.848477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:49.848477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:49.848477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:49.848477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:49.848477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:49.848477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:49.848477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:49.848477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:49.848477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:49.848477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:49.850575 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:49.850575 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:49.850575 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:49.850575 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:49.850575 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 484/970] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:49.858665 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78871065-8d96-4cb3-b858-dec83f53ff51 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:50.056004 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78871065-8d96-4cb3-b858-dec83f53ff51 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:50.129352 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a457d0f-91e8-4ce8-aa16-c8feabef7db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:50.130609 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a457d0f-91e8-4ce8-aa16-c8feabef7db4 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:50.131206 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a457d0f-91e8-4ce8-aa16-c8feabef7db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:50.131823 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a457d0f-91e8-4ce8-aa16-c8feabef7db4 None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:50.133212 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a457d0f-91e8-4ce8-aa16-c8feabef7db4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:50.133874 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a457d0f-91e8-4ce8-aa16-c8feabef7db4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:50.137136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a457d0f-91e8-4ce8-aa16-c8feabef7db4 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:50.168382 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 487/971] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:50.172723 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ac599-09a8-41b1-a5f3-ea6b31815200 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:50.319225 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:50.324351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ac599-09a8-41b1-a5f3-ea6b31815200 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:50.365879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8dac2-d330-49a7-b845-8f702c8f4162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:50.366581 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8dac2-d330-49a7-b845-8f702c8f4162 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:50.366864 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8dac2-d330-49a7-b845-8f702c8f4162 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:50.367141 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8dac2-d330-49a7-b845-8f702c8f4162 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:50.376453 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8dac2-d330-49a7-b845-8f702c8f4162 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:50.377958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8dac2-d330-49a7-b845-8f702c8f4162 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:50.391358 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-faf8dac2-d330-49a7-b845-8f702c8f4162 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 08:51:50.391358 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:50.391358 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:50.391358 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:50.391358 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:50.391358 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:50.391358 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:50.391358 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:50.391358 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:50.391358 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:50.391358 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:50.391358 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:50.391358 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:51:50.391358 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:51:50.391358 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:51:50.391358 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:51:50.393303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:50.393303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:50.393303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:51:50.393303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:50.393303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:51:50.393303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:51:50.393303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:50.393303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:50.393303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:50.393303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:50.393303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:50.393303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:50.393303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:50.393303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:50.393303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:50.393303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:50.393303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:50.393303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:50.395306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:50.395306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:50.395306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:51:50.395306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:51:50.395306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:51:50.395306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:51:50.395306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:51:50.395306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:51:50.395306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 08:51:50.395306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:50.397424 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 485/972] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Jul 27 08:51:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:50.399539 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a457d0f-91e8-4ce8-aa16-c8feabef7db4 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:50.415064 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:50.519426 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a457d0f-91e8-4ce8-aa16-c8feabef7db4 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:50.559380 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36279dfe-64eb-4cc2-b3f6-4f482bebbaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:50.560004 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36279dfe-64eb-4cc2-b3f6-4f482bebbaec None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:50.560281 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36279dfe-64eb-4cc2-b3f6-4f482bebbaec None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:50.560553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36279dfe-64eb-4cc2-b3f6-4f482bebbaec None admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:50.561364 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36279dfe-64eb-4cc2-b3f6-4f482bebbaec None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:50.561667 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36279dfe-64eb-4cc2-b3f6-4f482bebbaec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:50.563158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36279dfe-64eb-4cc2-b3f6-4f482bebbaec None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:50.589401 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 488/973] 10.222.0.65 () {56 vars in 1149 bytes} [Wed Jul 27 08:51:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:50.591343 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8dac2-d330-49a7-b845-8f702c8f4162 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:50.715289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8dac2-d330-49a7-b845-8f702c8f4162 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:50.762125 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08755599-5e65-4416-a9a9-2b0b8800a15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:50.762811 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08755599-5e65-4416-a9a9-2b0b8800a15d None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:50.763099 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08755599-5e65-4416-a9a9-2b0b8800a15d None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:50.763375 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08755599-5e65-4416-a9a9-2b0b8800a15d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:50.801657 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:50.855898 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08755599-5e65-4416-a9a9-2b0b8800a15d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:50.857303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08755599-5e65-4416-a9a9-2b0b8800a15d None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:50.979429 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 486/974] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:51:50 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 08:51:50.985892 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36279dfe-64eb-4cc2-b3f6-4f482bebbaec None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:51.106769 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:51.174866 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36279dfe-64eb-4cc2-b3f6-4f482bebbaec None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:51.241950 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f855c-57be-4241-a5d0-df834374fa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:51.243085 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f855c-57be-4241-a5d0-df834374fa4b None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:51.243570 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f855c-57be-4241-a5d0-df834374fa4b None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:51.244135 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f855c-57be-4241-a5d0-df834374fa4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:51.264588 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f855c-57be-4241-a5d0-df834374fa4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:51.267388 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f855c-57be-4241-a5d0-df834374fa4b None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:51.298480 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-d92f855c-57be-4241-a5d0-df834374fa4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:51.298480 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:51.298480 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:51.298480 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:51.298480 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:51.298480 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:51.298480 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:51.298480 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:51.298480 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:51.298480 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:51.298480 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:51.298480 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:51.298480 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:51:51.298480 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:51:51.298480 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:51:51.299466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:51:51.299466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:51.299466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:51.299466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:51.299466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:51.299466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:51.299466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:51.299466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:51.299466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:51.299466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:51.299466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:51.299466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:51.299466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:51.299466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:51.299466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:51.299466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:51.299466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:51.300380 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:51:51.300380 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:51:51.300380 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:51:51.300380 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:51.303714 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 489/975] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:51:51.311807 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08755599-5e65-4416-a9a9-2b0b8800a15d None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:51.421238 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:51.472724 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08755599-5e65-4416-a9a9-2b0b8800a15d None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:51.513253 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2349a7c-30e5-4433-87f2-3ad8bbd88e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:51.513884 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2349a7c-30e5-4433-87f2-3ad8bbd88e48 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:51.514180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2349a7c-30e5-4433-87f2-3ad8bbd88e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:51.514474 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2349a7c-30e5-4433-87f2-3ad8bbd88e48 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:51.515173 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2349a7c-30e5-4433-87f2-3ad8bbd88e48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:51.515476 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2349a7c-30e5-4433-87f2-3ad8bbd88e48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:51.516875 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2349a7c-30e5-4433-87f2-3ad8bbd88e48 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:51.532895 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 487/976] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:51.539358 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f855c-57be-4241-a5d0-df834374fa4b None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:51.586227 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b2094-8771-477c-9d90-b556f8016f12 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:51.586602 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b2094-8771-477c-9d90-b556f8016f12 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:51.586851 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b2094-8771-477c-9d90-b556f8016f12 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:51.588784 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 488/977] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:51.594771 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a40c9-4459-4816-9b2b-ce56c668f729 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:51.595035 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a40c9-4459-4816-9b2b-ce56c668f729 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:51.595355 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a40c9-4459-4816-9b2b-ce56c668f729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:51.619559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-9d3a40c9-4459-4816-9b2b-ce56c668f729 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:51.620807 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9d3a40c9-4459-4816-9b2b-ce56c668f729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:51.704396 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f855c-57be-4241-a5d0-df834374fa4b None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:51.733015 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:51.740722 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 489/978] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:51:51.743107 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eeb8d5-68d9-4838-bd8c-1c1c6097e7bf None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:51.743674 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eeb8d5-68d9-4838-bd8c-1c1c6097e7bf None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:51.744189 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eeb8d5-68d9-4838-bd8c-1c1c6097e7bf None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:51.746944 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 490/979] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:51.752623 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9ea44-3df3-49dc-a1fe-838eeedb1b0b None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:51.753062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9ea44-3df3-49dc-a1fe-838eeedb1b0b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:51.753515 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9ea44-3df3-49dc-a1fe-838eeedb1b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:51.760877 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f30431-62ed-408c-b614-b019af847726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:51.761759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f30431-62ed-408c-b614-b019af847726 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:51.762036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f30431-62ed-408c-b614-b019af847726 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:51.762366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f30431-62ed-408c-b614-b019af847726 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:51.771336 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f30431-62ed-408c-b614-b019af847726 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:51.772806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f30431-62ed-408c-b614-b019af847726 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:51.775145 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-84b9ea44-3df3-49dc-a1fe-838eeedb1b0b None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:51.776571 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-84b9ea44-3df3-49dc-a1fe-838eeedb1b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:51.785774 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-69f30431-62ed-408c-b614-b019af847726 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:51.785774 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:51.785774 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:51.785774 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:51.785774 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:51.785774 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:51.785774 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:51.785774 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:51.785774 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:51.785774 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:51.785774 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:51.785774 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:51.785774 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:51:51.785774 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:51:51.785774 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:51:51.787738 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:51:51.787738 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:51.787738 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:51.787738 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:51.787738 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:51.787738 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:51.787738 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:51.787738 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:51.787738 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:51.787738 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:51.787738 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:51.787738 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:51.787738 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:51.787738 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:51.787738 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:51.787738 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:51.787738 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:51.789535 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:51:51.789535 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:51:51.789535 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:51:51.789535 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:51:51.789535 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:51:51.789535 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:51:51.789535 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:51:51.789535 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:51.789535 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 490/980] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:51:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:51:51.789535 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f30431-62ed-408c-b614-b019af847726 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:51.832074 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:51.855818 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 491/981] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:51:51.856683 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9ea44-3df3-49dc-a1fe-838eeedb1b0b None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:51.906827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f30431-62ed-408c-b614-b019af847726 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:51.944673 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f675e7-dfa9-424d-af2f-973358dc7382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:51.945307 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f675e7-dfa9-424d-af2f-973358dc7382 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:51.945580 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f675e7-dfa9-424d-af2f-973358dc7382 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:51.945849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f675e7-dfa9-424d-af2f-973358dc7382 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:51.946506 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f675e7-dfa9-424d-af2f-973358dc7382 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:51.948603 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f675e7-dfa9-424d-af2f-973358dc7382 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:51.958109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-39f675e7-dfa9-424d-af2f-973358dc7382 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 08:51:51.958109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:51.958109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:51:51.958109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:51:51.958109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:51:51.958109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:51:51.958109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:51:51.958109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:51.958109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 08:51:51.958109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:51.958109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:51:51.958109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:51.958109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:51.958109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:51.958109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:51.958109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:51.958109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:51.960353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:51.960353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:51.960353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:51.960353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:51.960353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:51.960353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:51.960353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:51:51.960353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:51:51.960353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:51:51.960353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:51:51.960353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:51.960353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:51.960353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:51.960353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:51.960353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:51.960353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:51.962414 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:51.962414 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:51.962414 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:51.962414 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:51.962414 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:51.962414 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:51.962414 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:51.962414 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:51.962414 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:51.962414 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:51.962414 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:51:51.962414 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:51.962414 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 08:51:51.962414 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:51.962414 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 491/982] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Jul 27 08:51:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:51.965333 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f675e7-dfa9-424d-af2f-973358dc7382 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:51.972540 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9ea44-3df3-49dc-a1fe-838eeedb1b0b None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:52.009844 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1d8b7-2082-4d15-b850-f8b8825e3587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:52.010483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1d8b7-2082-4d15-b850-f8b8825e3587 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:52.010483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1d8b7-2082-4d15-b850-f8b8825e3587 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:52.011335 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1d8b7-2082-4d15-b850-f8b8825e3587 None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:52.011875 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1d8b7-2082-4d15-b850-f8b8825e3587 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:52.012186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1d8b7-2082-4d15-b850-f8b8825e3587 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:52.013624 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1d8b7-2082-4d15-b850-f8b8825e3587 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:52.030594 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 492/983] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:51:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:52.031886 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1d8b7-2082-4d15-b850-f8b8825e3587 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:52.045236 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:52.080925 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:52.127554 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f675e7-dfa9-424d-af2f-973358dc7382 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:52.162058 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1d8b7-2082-4d15-b850-f8b8825e3587 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:52.179412 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b68de-800f-419c-b8b3-bd0bf3311a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:52.180469 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b68de-800f-419c-b8b3-bd0bf3311a5a None admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:52.180956 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b68de-800f-419c-b8b3-bd0bf3311a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:52.182004 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b68de-800f-419c-b8b3-bd0bf3311a5a None admin] PATH_INFO: `/v3/services` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:52.183291 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b68de-800f-419c-b8b3-bd0bf3311a5a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:52.185867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b68de-800f-419c-b8b3-bd0bf3311a5a None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:52.201775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d60381-035c-4434-9135-4ac501c89a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:52.202495 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d60381-035c-4434-9135-4ac501c89a0b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:52.202773 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d60381-035c-4434-9135-4ac501c89a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:52.203047 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d60381-035c-4434-9135-4ac501c89a0b None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:52.203733 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d60381-035c-4434-9135-4ac501c89a0b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:52.204041 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d60381-035c-4434-9135-4ac501c89a0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:52.205418 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d60381-035c-4434-9135-4ac501c89a0b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:52.205591 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 492/984] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 08:51:51 2022] POST /identity/v3/services => generated 242 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:51:52.207030 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b68de-800f-419c-b8b3-bd0bf3311a5a None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:52.217299 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 493/985] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Jul 27 08:51:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:52.226048 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d60381-035c-4434-9135-4ac501c89a0b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:52.399005 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:52.410410 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b68de-800f-419c-b8b3-bd0bf3311a5a None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:52.422552 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d60381-035c-4434-9135-4ac501c89a0b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:52.428914 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:52.464489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f98704-40dd-42ad-82ab-a601024c1893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:52.465137 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f98704-40dd-42ad-82ab-a601024c1893 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:52.465413 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f98704-40dd-42ad-82ab-a601024c1893 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:52.465685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f98704-40dd-42ad-82ab-a601024c1893 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:52.466548 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f98704-40dd-42ad-82ab-a601024c1893 None admin] RBAC: Adding query filter params (role.id=1e9124c6b23746fe97007d59fe6af878, scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267, user.id=c607472800fc49d5a75c5e6acb33f2a2) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:52.466860 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f98704-40dd-42ad-82ab-a601024c1893 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:52.468443 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f98704-40dd-42ad-82ab-a601024c1893 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:52.476759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 493/986] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:51:52 2022] GET /identity/v3/role_assignments?user.id=c607472800fc49d5a75c5e6acb33f2a2&scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267&role.id=1e9124c6b23746fe97007d59fe6af878 => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:52.499517 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee76cfc-0924-4dc0-a967-a24891b4db94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:52.500647 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee76cfc-0924-4dc0-a967-a24891b4db94 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:52.501148 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee76cfc-0924-4dc0-a967-a24891b4db94 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:52.501621 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee76cfc-0924-4dc0-a967-a24891b4db94 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:52.502989 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee76cfc-0924-4dc0-a967-a24891b4db94 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:52.503517 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee76cfc-0924-4dc0-a967-a24891b4db94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:52.506430 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee76cfc-0924-4dc0-a967-a24891b4db94 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:52.525278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 494/987] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Jul 27 08:51:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:51:52.527185 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f98704-40dd-42ad-82ab-a601024c1893 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:52.725804 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f98704-40dd-42ad-82ab-a601024c1893 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:52.794152 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34efcd-2ce4-4afd-ab86-ff38a62e2f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:52.795244 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34efcd-2ce4-4afd-ab86-ff38a62e2f86 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:52.795745 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34efcd-2ce4-4afd-ab86-ff38a62e2f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:52.796229 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34efcd-2ce4-4afd-ab86-ff38a62e2f86 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:52.797689 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34efcd-2ce4-4afd-ab86-ff38a62e2f86 None admin] RBAC: Adding query filter params (interface=admin, service_id=5b4e215f194b49e8a1f19174df5faf87, region_id=RegionOne) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:52.798249 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34efcd-2ce4-4afd-ab86-ff38a62e2f86 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:52.801356 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34efcd-2ce4-4afd-ab86-ff38a62e2f86 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:52.818373 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 494/988] 10.222.0.65 () {56 vars in 1249 bytes} [Wed Jul 27 08:51:52 2022] GET /identity/v3/endpoints?service_id=5b4e215f194b49e8a1f19174df5faf87&interface=admin®ion_id=RegionOne => generated 193 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:52.821658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee76cfc-0924-4dc0-a967-a24891b4db94 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:53.023040 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee76cfc-0924-4dc0-a967-a24891b4db94 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:53.085432 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ce7c5-a685-4d3c-9d0e-ab129b8f9244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:53.086466 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ce7c5-a685-4d3c-9d0e-ab129b8f9244 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:53.086933 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ce7c5-a685-4d3c-9d0e-ab129b8f9244 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:53.087940 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ce7c5-a685-4d3c-9d0e-ab129b8f9244 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:53.089472 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ce7c5-a685-4d3c-9d0e-ab129b8f9244 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:53.092215 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ce7c5-a685-4d3c-9d0e-ab129b8f9244 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:53.112793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 495/989] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Jul 27 08:51:52 2022] GET /identity/v3/services => generated 1727 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:51:54.377732 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8d0e9-8bed-4108-ac74-dca623269399 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:54.378574 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8d0e9-8bed-4108-ac74-dca623269399 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:54.378574 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8d0e9-8bed-4108-ac74-dca623269399 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:54.382369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 495/990] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:51:54.389679 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd08617-fd0f-4a8b-b3e0-a57eb525f393 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:54.390211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd08617-fd0f-4a8b-b3e0-a57eb525f393 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:54.390740 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd08617-fd0f-4a8b-b3e0-a57eb525f393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:54.422889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-efd08617-fd0f-4a8b-b3e0-a57eb525f393 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:54.425051 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-efd08617-fd0f-4a8b-b3e0-a57eb525f393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:54.483219 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:54.562387 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 496/991] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:54 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:51:54.583780 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8d0e9-8bed-4108-ac74-dca623269399 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:54.635587 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:54.772532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8d0e9-8bed-4108-ac74-dca623269399 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:54.836703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458397f-943d-40a3-bbcb-c47cf7aa3e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:54.837812 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458397f-943d-40a3-bbcb-c47cf7aa3e43 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:54.838296 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458397f-943d-40a3-bbcb-c47cf7aa3e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:54.838798 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458397f-943d-40a3-bbcb-c47cf7aa3e43 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:54.839896 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458397f-943d-40a3-bbcb-c47cf7aa3e43 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:54.842481 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458397f-943d-40a3-bbcb-c47cf7aa3e43 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:54.861092 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-d458397f-943d-40a3-bbcb-c47cf7aa3e43 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 08:51:54.861092 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:54.861092 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:51:54.861092 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:51:54.861092 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:51:54.861092 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:51:54.861092 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:51:54.861092 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:54.861092 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 08:51:54.861092 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:54.861092 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:51:54.861092 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:54.861092 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:54.861092 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:54.861092 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:54.861092 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:54.861092 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:54.863167 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:54.863167 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:54.863167 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:54.863167 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:54.863167 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:54.863167 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:54.863167 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:51:54.863167 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:51:54.863167 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:51:54.863167 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:51:54.863167 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:54.863167 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:54.863167 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:54.863167 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:54.863167 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:54.863167 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:54.864887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:54.864887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:54.864887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:54.864887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:54.864887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:54.864887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:54.864887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:54.864887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:54.864887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:54.864887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:54.864887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:51:54.864887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:54.864887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 08:51:54.864887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:54.864887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 496/992] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:51:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:54.870063 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd08617-fd0f-4a8b-b3e0-a57eb525f393 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:55.043952 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd08617-fd0f-4a8b-b3e0-a57eb525f393 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:55.086299 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e020d-55f1-4d44-8e9f-79c66f1dc5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:55.086944 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e020d-55f1-4d44-8e9f-79c66f1dc5f3 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:55.087309 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e020d-55f1-4d44-8e9f-79c66f1dc5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:55.088109 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e020d-55f1-4d44-8e9f-79c66f1dc5f3 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:55.089182 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e020d-55f1-4d44-8e9f-79c66f1dc5f3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:55.089550 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e020d-55f1-4d44-8e9f-79c66f1dc5f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:55.090969 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e020d-55f1-4d44-8e9f-79c66f1dc5f3 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:55.096963 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 497/993] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 08:51:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:55.103444 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458397f-943d-40a3-bbcb-c47cf7aa3e43 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:55.172756 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9695a-1ac8-4f4c-a6f1-0e7bdd335c82 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:55.173089 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9695a-1ac8-4f4c-a6f1-0e7bdd335c82 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:55.173311 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9695a-1ac8-4f4c-a6f1-0e7bdd335c82 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:55.174891 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 498/994] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:51:55.180063 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6f4a8-4768-4e4c-b386-c5bc36e845db None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:55.180357 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6f4a8-4768-4e4c-b386-c5bc36e845db None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:55.180636 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6f4a8-4768-4e4c-b386-c5bc36e845db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:55.200907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f0a6f4a8-4768-4e4c-b386-c5bc36e845db None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:55.202120 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f0a6f4a8-4768-4e4c-b386-c5bc36e845db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:55.230990 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:55.273041 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:55.288852 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458397f-943d-40a3-bbcb-c47cf7aa3e43 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:55.317677 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 499/995] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:55 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:51:55.341320 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6f4a8-4768-4e4c-b386-c5bc36e845db None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:55.343125 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392dea4-1918-4320-b22d-1ba9fbfc1b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:55.344174 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392dea4-1918-4320-b22d-1ba9fbfc1b1c None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:55.345556 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392dea4-1918-4320-b22d-1ba9fbfc1b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:55.345978 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392dea4-1918-4320-b22d-1ba9fbfc1b1c None admin] PATH_INFO: `/v3/services` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:55.346856 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392dea4-1918-4320-b22d-1ba9fbfc1b1c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:55.347291 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392dea4-1918-4320-b22d-1ba9fbfc1b1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:55.348867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392dea4-1918-4320-b22d-1ba9fbfc1b1c None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:55.366077 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 497/996] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 08:51:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:51:55.367276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392dea4-1918-4320-b22d-1ba9fbfc1b1c None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:55.488800 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6f4a8-4768-4e4c-b386-c5bc36e845db None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:55.515469 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392dea4-1918-4320-b22d-1ba9fbfc1b1c None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:55.540098 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561761b2-f575-4130-a15a-ab6a59e56977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:55.541329 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561761b2-f575-4130-a15a-ab6a59e56977 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:55.541788 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561761b2-f575-4130-a15a-ab6a59e56977 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:55.542309 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561761b2-f575-4130-a15a-ab6a59e56977 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:55.543008 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561761b2-f575-4130-a15a-ab6a59e56977 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:55.544414 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561761b2-f575-4130-a15a-ab6a59e56977 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:55.554534 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-561761b2-f575-4130-a15a-ab6a59e56977 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 08:51:55.554534 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:55.554534 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:51:55.554534 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:51:55.554534 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:51:55.554534 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:51:55.554534 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:51:55.554534 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:55.554534 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 08:51:55.554534 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:55.554534 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:51:55.554534 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:55.554534 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:55.554534 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:55.554534 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:55.554534 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:55.554534 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:55.556628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:55.556628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:55.556628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:55.556628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:55.556628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:55.556628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:55.556628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:51:55.556628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:51:55.556628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:51:55.556628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:51:55.556628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:55.556628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:55.556628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:55.556628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:55.556628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:55.556628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:55.558348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:55.558348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:55.558348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:55.558348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:55.558348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:55.558348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:55.558348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:55.558348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:55.558348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:55.558348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:55.558348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:51:55.558348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:55.558348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 08:51:55.558348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:55.558348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 500/997] 10.222.0.65 () {56 vars in 1126 bytes} [Wed Jul 27 08:51:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:51:55.566470 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561761b2-f575-4130-a15a-ab6a59e56977 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:55.573279 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c42d0-a647-4b27-b9ba-ff2b69304814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:55.573816 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c42d0-a647-4b27-b9ba-ff2b69304814 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:55.574088 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c42d0-a647-4b27-b9ba-ff2b69304814 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:55.574381 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c42d0-a647-4b27-b9ba-ff2b69304814 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:55.575152 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c42d0-a647-4b27-b9ba-ff2b69304814 None admin] RBAC: Adding query filter params (interface=public, service_id=e98d0efa57e24a5a8721a56d1f590855, region_id=RegionOne) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:55.575458 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c42d0-a647-4b27-b9ba-ff2b69304814 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:55.576852 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c42d0-a647-4b27-b9ba-ff2b69304814 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:55.583604 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 498/998] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Jul 27 08:51:55 2022] GET /identity/v3/endpoints?service_id=e98d0efa57e24a5a8721a56d1f590855&interface=public®ion_id=RegionOne => generated 194 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:55.590174 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c42d0-a647-4b27-b9ba-ff2b69304814 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:55.603875 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:55.617922 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:55.714889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561761b2-f575-4130-a15a-ab6a59e56977 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:55.743712 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c42d0-a647-4b27-b9ba-ff2b69304814 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:55.764750 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b80b9-eadc-4b86-8aff-b47673313ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:55.765675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b80b9-eadc-4b86-8aff-b47673313ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:55.766021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b80b9-eadc-4b86-8aff-b47673313ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:55.766379 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b80b9-eadc-4b86-8aff-b47673313ea5 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:55.767177 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b80b9-eadc-4b86-8aff-b47673313ea5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:55.767546 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b80b9-eadc-4b86-8aff-b47673313ea5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:55.769550 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b80b9-eadc-4b86-8aff-b47673313ea5 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:55.777026 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 501/999] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Jul 27 08:51:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:51:55.778309 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97ab64-9a16-46c9-83ec-be699d430bd2 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:55.778703 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97ab64-9a16-46c9-83ec-be699d430bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:55.779155 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97ab64-9a16-46c9-83ec-be699d430bd2 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:55.782632 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 502/1000] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:55.785764 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97ab64-9a16-46c9-83ec-be699d430bd2 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:55.799131 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6b48d-92f2-4c77-87d0-3217aee7fb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:55.800131 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6b48d-92f2-4c77-87d0-3217aee7fb72 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:55.800575 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6b48d-92f2-4c77-87d0-3217aee7fb72 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:55.801001 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6b48d-92f2-4c77-87d0-3217aee7fb72 None admin] PATH_INFO: `/v3/services` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:55.801936 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6b48d-92f2-4c77-87d0-3217aee7fb72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:55.804447 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6b48d-92f2-4c77-87d0-3217aee7fb72 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:55.816236 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 499/1001] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Jul 27 08:51:55 2022] GET /identity/v3/services => generated 1727 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 08:51:55.818288 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf17e6d-5f00-4b32-b6ce-d5e22bd0d4a3 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:55.818783 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf17e6d-5f00-4b32-b6ce-d5e22bd0d4a3 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:55.819226 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf17e6d-5f00-4b32-b6ce-d5e22bd0d4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:55.858182 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-baf17e6d-5f00-4b32-b6ce-d5e22bd0d4a3 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:55.860804 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-baf17e6d-5f00-4b32-b6ce-d5e22bd0d4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:55.919669 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:55.954160 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97ab64-9a16-46c9-83ec-be699d430bd2 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:55.994356 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 500/1002] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:55 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:51:56.009326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf17e6d-5f00-4b32-b6ce-d5e22bd0d4a3 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:56.019519 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f032ead-f562-4031-9011-a0641a4cca4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:56.020495 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f032ead-f562-4031-9011-a0641a4cca4f None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:56.020934 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f032ead-f562-4031-9011-a0641a4cca4f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:56.021352 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f032ead-f562-4031-9011-a0641a4cca4f None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:56.022499 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f032ead-f562-4031-9011-a0641a4cca4f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:56.023022 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f032ead-f562-4031-9011-a0641a4cca4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:56.025929 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f032ead-f562-4031-9011-a0641a4cca4f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:56.039898 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 503/1003] 10.222.0.65 () {56 vars in 1122 bytes} [Wed Jul 27 08:51:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:51:56.042300 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f032ead-f562-4031-9011-a0641a4cca4f None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:56.046070 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:56.186587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f032ead-f562-4031-9011-a0641a4cca4f None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:56.213663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf17e6d-5f00-4b32-b6ce-d5e22bd0d4a3 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:56.229922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ccd74-3115-4025-82f3-7ad238caf7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:56.230604 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ccd74-3115-4025-82f3-7ad238caf7b8 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:56.230875 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ccd74-3115-4025-82f3-7ad238caf7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:56.231151 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ccd74-3115-4025-82f3-7ad238caf7b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:56.231887 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ccd74-3115-4025-82f3-7ad238caf7b8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:56.233293 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ccd74-3115-4025-82f3-7ad238caf7b8 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:56.262766 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 504/1004] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 08:51:56 2022] POST /identity/v3/endpoints => generated 325 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:51:56.303557 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238990f8-6bb6-4e4f-93da-d75d3f5e3a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:56.304655 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238990f8-6bb6-4e4f-93da-d75d3f5e3a2c None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:56.305152 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238990f8-6bb6-4e4f-93da-d75d3f5e3a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:56.305652 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238990f8-6bb6-4e4f-93da-d75d3f5e3a2c None admin] PATH_INFO: `/v3/services/image` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:56.306981 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238990f8-6bb6-4e4f-93da-d75d3f5e3a2c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:56.309753 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238990f8-6bb6-4e4f-93da-d75d3f5e3a2c None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:56.329439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-238990f8-6bb6-4e4f-93da-d75d3f5e3a2c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 08:51:56.329439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:56.329439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:51:56.329439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:51:56.329439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:51:56.329439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:51:56.329439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:51:56.329439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:56.329439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 08:51:56.329439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:56.329439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:51:56.329439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:56.329439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:56.329439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:56.329439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:56.329439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:56.329439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:56.331550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:56.331550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:56.331550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:56.331550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:56.331550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:56.331550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:56.331550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:51:56.331550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:51:56.331550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:51:56.331550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:51:56.331550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:56.331550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:56.331550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:56.331550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:56.331550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:56.331550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:56.333314 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:56.333314 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:56.333314 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:56.333314 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:56.333314 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:56.333314 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:56.333314 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:56.333314 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:56.333314 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:56.333314 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:56.333314 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:51:56.333314 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:56.333314 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 08:51:56.333314 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:51:56.333314 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 501/1005] 10.222.0.65 () {56 vars in 1105 bytes} [Wed Jul 27 08:51:56 2022] GET /identity/v3/services/image => generated 86 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:56.338918 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ccd74-3115-4025-82f3-7ad238caf7b8 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:56.362265 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:56.542870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ccd74-3115-4025-82f3-7ad238caf7b8 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:56.603361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf296403-685c-47f2-b229-c69586f4b698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:56.604428 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf296403-685c-47f2-b229-c69586f4b698 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:56.604912 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf296403-685c-47f2-b229-c69586f4b698 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:56.605386 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf296403-685c-47f2-b229-c69586f4b698 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:56.606705 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf296403-685c-47f2-b229-c69586f4b698 None admin] RBAC: Adding query filter params (name=image) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:56.607241 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf296403-685c-47f2-b229-c69586f4b698 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:56.609806 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf296403-685c-47f2-b229-c69586f4b698 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:56.624542 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 505/1006] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:56.627005 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238990f8-6bb6-4e4f-93da-d75d3f5e3a2c None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:56.756315 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:56.812286 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238990f8-6bb6-4e4f-93da-d75d3f5e3a2c None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:56.879110 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02712c-49d1-47ef-9447-fd73be4cf5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:56.880378 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02712c-49d1-47ef-9447-fd73be4cf5a4 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:56.880980 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02712c-49d1-47ef-9447-fd73be4cf5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:56.881575 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02712c-49d1-47ef-9447-fd73be4cf5a4 None admin] PATH_INFO: `/v3/services` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:56.882971 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02712c-49d1-47ef-9447-fd73be4cf5a4 None admin] RBAC: Adding query filter params (type=image) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:56.883629 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02712c-49d1-47ef-9447-fd73be4cf5a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:56.886578 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02712c-49d1-47ef-9447-fd73be4cf5a4 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:56.902456 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 502/1007] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:56 2022] GET /identity/v3/services?type=image => generated 122 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:51:58.091936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10682e-e8a2-4d7a-aaa5-31d6a3b964c7 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:58.092473 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10682e-e8a2-4d7a-aaa5-31d6a3b964c7 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:58.092473 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10682e-e8a2-4d7a-aaa5-31d6a3b964c7 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:58.094058 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 506/1008] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:51:58.100380 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483c54c-f154-4b0e-a3ae-57d980b9477a None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:58.100910 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483c54c-f154-4b0e-a3ae-57d980b9477a None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:58.101365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483c54c-f154-4b0e-a3ae-57d980b9477a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:58.132804 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-f483c54c-f154-4b0e-a3ae-57d980b9477a None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:58.135276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-f483c54c-f154-4b0e-a3ae-57d980b9477a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:58.248124 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 503/1009] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:58 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:51:58.270734 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10682e-e8a2-4d7a-aaa5-31d6a3b964c7 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:58.350338 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:58.389772 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10682e-e8a2-4d7a-aaa5-31d6a3b964c7 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:58.444814 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa458ba-a111-4893-a932-329a410cbd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:58.445600 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa458ba-a111-4893-a932-329a410cbd48 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:58.446020 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa458ba-a111-4893-a932-329a410cbd48 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:58.446458 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa458ba-a111-4893-a932-329a410cbd48 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:58.448068 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa458ba-a111-4893-a932-329a410cbd48 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:58.449863 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa458ba-a111-4893-a932-329a410cbd48 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:58.464793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-ffa458ba-a111-4893-a932-329a410cbd48 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 08:51:58.464793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:58.464793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:51:58.464793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:51:58.464793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:51:58.464793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:51:58.464793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:51:58.464793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:58.464793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 08:51:58.464793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:58.464793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:51:58.464793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:58.464793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:51:58.464793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:51:58.464793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:51:58.464793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:51:58.464793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:51:58.466037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:51:58.466037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:51:58.466037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:51:58.466037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:51:58.466037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:51:58.466037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:51:58.466037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:51:58.466037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:51:58.466037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:51:58.466037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:51:58.466037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:51:58.466037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:51:58.466037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:51:58.466037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:51:58.466037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:51:58.466037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:51:58.467618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:51:58.467618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:51:58.467618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:51:58.467618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:51:58.467618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:51:58.467618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:51:58.467618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:51:58.467618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:51:58.467618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:51:58.467618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:51:58.467618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:51:58.467618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:51:58.467618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 08:51:58.467618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:51:58.470779 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 507/1010] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:51:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:51:58.476851 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483c54c-f154-4b0e-a3ae-57d980b9477a None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:58.577995 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:58.581436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f88a0-151e-4061-82e2-2417e8ec555b None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:58.582595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f88a0-151e-4061-82e2-2417e8ec555b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:58.583067 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f88a0-151e-4061-82e2-2417e8ec555b None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:58.584970 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 508/1011] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:58.591219 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcaa206-ca05-41a5-9fee-77449dbd8950 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:58.591604 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcaa206-ca05-41a5-9fee-77449dbd8950 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:58.591778 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcaa206-ca05-41a5-9fee-77449dbd8950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:58.613189 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-4dcaa206-ca05-41a5-9fee-77449dbd8950 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:58.614822 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4dcaa206-ca05-41a5-9fee-77449dbd8950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:58.630676 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483c54c-f154-4b0e-a3ae-57d980b9477a None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:58.698632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e857c-53d4-47f6-b589-79870b370416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:58.699293 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e857c-53d4-47f6-b589-79870b370416 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:58.699577 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e857c-53d4-47f6-b589-79870b370416 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:58.699854 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e857c-53d4-47f6-b589-79870b370416 None admin] PATH_INFO: `/v3/services` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:58.700576 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e857c-53d4-47f6-b589-79870b370416 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:58.700884 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e857c-53d4-47f6-b589-79870b370416 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:58.702364 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e857c-53d4-47f6-b589-79870b370416 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:58.710265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 504/1012] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 08:51:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:58.719512 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e857c-53d4-47f6-b589-79870b370416 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:58.721592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 509/1013] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:58 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:51:58.761081 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcaa206-ca05-41a5-9fee-77449dbd8950 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:58.880371 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:58.917518 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e857c-53d4-47f6-b589-79870b370416 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:58.948487 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcaa206-ca05-41a5-9fee-77449dbd8950 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:58.959650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:58.967990 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe83f6-84c6-49b0-a68c-57260eef04a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:58.968810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe83f6-84c6-49b0-a68c-57260eef04a4 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:58.969230 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe83f6-84c6-49b0-a68c-57260eef04a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:58.970054 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe83f6-84c6-49b0-a68c-57260eef04a4 None admin] PATH_INFO: `/v3/services` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:58.970817 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe83f6-84c6-49b0-a68c-57260eef04a4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:51:58.971254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe83f6-84c6-49b0-a68c-57260eef04a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:58.973074 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe83f6-84c6-49b0-a68c-57260eef04a4 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:58.979765 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 505/1014] 10.222.0.65 () {56 vars in 1112 bytes} [Wed Jul 27 08:51:58 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:58.988862 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe83f6-84c6-49b0-a68c-57260eef04a4 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:59.008516 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a458e-7238-4d17-b29b-daa171e884cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:59.009449 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a458e-7238-4d17-b29b-daa171e884cf None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:59.009868 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a458e-7238-4d17-b29b-daa171e884cf None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:59.010273 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a458e-7238-4d17-b29b-daa171e884cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:59.011802 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a458e-7238-4d17-b29b-daa171e884cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:59.013438 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a458e-7238-4d17-b29b-daa171e884cf None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:59.018381 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 510/1015] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:51:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:51:59.026528 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a458e-7238-4d17-b29b-daa171e884cf None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:59.189189 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a458e-7238-4d17-b29b-daa171e884cf None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:59.194069 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe83f6-84c6-49b0-a68c-57260eef04a4 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:59.245795 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd11fa-234f-4d14-af44-da9b7d9e4a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:59.246831 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd11fa-234f-4d14-af44-da9b7d9e4a4d None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:59.247242 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd11fa-234f-4d14-af44-da9b7d9e4a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:59.247696 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd11fa-234f-4d14-af44-da9b7d9e4a4d None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:59.248871 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd11fa-234f-4d14-af44-da9b7d9e4a4d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:59.249999 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3d8da-9334-4de1-8248-25b8c4fd80c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:59.250999 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3d8da-9334-4de1-8248-25b8c4fd80c4 None admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:59.251351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd11fa-234f-4d14-af44-da9b7d9e4a4d None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:59.251450 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3d8da-9334-4de1-8248-25b8c4fd80c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:59.251871 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3d8da-9334-4de1-8248-25b8c4fd80c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:59.253039 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3d8da-9334-4de1-8248-25b8c4fd80c4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:59.255430 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3d8da-9334-4de1-8248-25b8c4fd80c4 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:59.259933 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:59.281915 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 506/1016] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 08:51:58 2022] POST /identity/v3/endpoints => generated 334 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:51:59.284018 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da213ba4-58b1-4738-af10-b4ef77ca100d None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:59.284786 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da213ba4-58b1-4738-af10-b4ef77ca100d None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:59.284951 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da213ba4-58b1-4738-af10-b4ef77ca100d None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:59.287240 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 507/1017] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:51:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:51:59.294074 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb8f44-c7c3-4919-aaf9-e8e11621d206 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:59.294516 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb8f44-c7c3-4919-aaf9-e8e11621d206 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:59.294760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb8f44-c7c3-4919-aaf9-e8e11621d206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:59.306924 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 511/1018] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 08:51:59 2022] POST /identity/v3/projects => generated 311 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:51:59.324304 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-4edb8f44-c7c3-4919-aaf9-e8e11621d206 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:51:59.325809 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-4edb8f44-c7c3-4919-aaf9-e8e11621d206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:51:59.393927 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:51:59.435158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 508/1019] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:51:59 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:51:59.459511 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd11fa-234f-4d14-af44-da9b7d9e4a4d None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:51:59.655928 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd11fa-234f-4d14-af44-da9b7d9e4a4d None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:51:59.716996 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e4dd3-33d6-4024-8fe3-a49aec1479a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:51:59.717880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e4dd3-33d6-4024-8fe3-a49aec1479a6 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:51:59.718307 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e4dd3-33d6-4024-8fe3-a49aec1479a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:51:59.718765 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e4dd3-33d6-4024-8fe3-a49aec1479a6 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:51:59.719916 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e4dd3-33d6-4024-8fe3-a49aec1479a6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:51:59.722355 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e4dd3-33d6-4024-8fe3-a49aec1479a6 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:51:59.751555 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 512/1020] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 08:51:59 2022] POST /identity/v3/services => generated 242 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:52:01.565184 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b218c1-6618-40e5-b881-254fe23003e9 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:01.565758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b218c1-6618-40e5-b881-254fe23003e9 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:01.566171 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b218c1-6618-40e5-b881-254fe23003e9 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:01.568895 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 509/1021] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:52:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:52:01.574877 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8ff0d-0e95-4efc-a136-8ed7caca754b None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:01.575375 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8ff0d-0e95-4efc-a136-8ed7caca754b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:01.575375 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8ff0d-0e95-4efc-a136-8ed7caca754b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:01.597114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-61a8ff0d-0e95-4efc-a136-8ed7caca754b None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:52:01.598345 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-61a8ff0d-0e95-4efc-a136-8ed7caca754b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:52:01.651695 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:01.693747 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 513/1022] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:52:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:52:01.719305 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b218c1-6618-40e5-b881-254fe23003e9 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:01.819508 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0292a-a142-4073-b017-e414d3c5138b None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:01.819706 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0292a-a142-4073-b017-e414d3c5138b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:01.819984 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0292a-a142-4073-b017-e414d3c5138b None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:01.821416 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 514/1023] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:52:01.827459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d910455-ff4f-49f4-85c3-49ad72626cd2 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:01.828125 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d910455-ff4f-49f4-85c3-49ad72626cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:01.828125 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d910455-ff4f-49f4-85c3-49ad72626cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:01.848405 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-7d910455-ff4f-49f4-85c3-49ad72626cd2 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:52:01.849635 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-7d910455-ff4f-49f4-85c3-49ad72626cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:52:01.888156 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b218c1-6618-40e5-b881-254fe23003e9 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:01.931175 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb9d61-5478-4156-bd1a-81781e15f639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:01.932363 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb9d61-5478-4156-bd1a-81781e15f639 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:01.932640 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb9d61-5478-4156-bd1a-81781e15f639 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:01.932913 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb9d61-5478-4156-bd1a-81781e15f639 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:01.945338 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb9d61-5478-4156-bd1a-81781e15f639 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:52:01.950561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-26bb9d61-5478-4156-bd1a-81781e15f639 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 08:52:01.950561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:52:01.950561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:52:01.950561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:52:01.950561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:52:01.950561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:52:01.950561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:52:01.950561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:52:01.950561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:52:01.950561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:52:01.950561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:52:01.950561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:52:01.950561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:52:01.950561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:52:01.950561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:52:01.950561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:52:01.952585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:52:01.952585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:52:01.952585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:52:01.952585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:52:01.952585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:52:01.952585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:52:01.952585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:52:01.952585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:52:01.952585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:52:01.952585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:52:01.952585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:52:01.952585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:52:01.952585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:52:01.952585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:52:01.952585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:52:01.952585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:52:01.955084 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:52:01.955084 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:52:01.955084 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:52:01.955084 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:52:01.955084 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:52:01.955084 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:52:01.955084 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:52:01.955084 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:52:01.955084 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:52:01.955084 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:52:01.955084 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 08:52:01.955084 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:52:01.955084 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 510/1024] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Jul 27 08:52:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:52:01.956935 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 515/1025] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:52:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:52:01.964088 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb9d61-5478-4156-bd1a-81781e15f639 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:01.978954 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d910455-ff4f-49f4-85c3-49ad72626cd2 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:02.009632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:02.134109 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d910455-ff4f-49f4-85c3-49ad72626cd2 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:02.136191 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:02.138479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb9d61-5478-4156-bd1a-81781e15f639 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:02.182198 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22d191-2c05-4e57-be23-ff616244bb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:02.182856 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22d191-2c05-4e57-be23-ff616244bb88 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:02.183237 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22d191-2c05-4e57-be23-ff616244bb88 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:02.183510 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22d191-2c05-4e57-be23-ff616244bb88 None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:02.184431 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22d191-2c05-4e57-be23-ff616244bb88 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:02.184736 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22d191-2c05-4e57-be23-ff616244bb88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:02.186234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22d191-2c05-4e57-be23-ff616244bb88 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:02.186602 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632ced7-4585-4dd2-9722-c449314918b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:02.188668 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632ced7-4585-4dd2-9722-c449314918b1 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:02.188976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632ced7-4585-4dd2-9722-c449314918b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:02.189255 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632ced7-4585-4dd2-9722-c449314918b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:02.190828 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632ced7-4585-4dd2-9722-c449314918b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:02.192981 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632ced7-4585-4dd2-9722-c449314918b1 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:02.195043 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 516/1026] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:52:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:52:02.200665 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 511/1027] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Jul 27 08:52:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:02.207704 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22d191-2c05-4e57-be23-ff616244bb88 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:02.207944 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632ced7-4585-4dd2-9722-c449314918b1 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:02.363848 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:02.372013 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22d191-2c05-4e57-be23-ff616244bb88 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:02.381557 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632ced7-4585-4dd2-9722-c449314918b1 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:02.411255 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e2b68-de16-484a-ada5-5381f92fd4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:02.411909 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e2b68-de16-484a-ada5-5381f92fd4aa None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:02.412211 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e2b68-de16-484a-ada5-5381f92fd4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:02.412464 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e2b68-de16-484a-ada5-5381f92fd4aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:02.426681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e2b68-de16-484a-ada5-5381f92fd4aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:02.428708 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e2b68-de16-484a-ada5-5381f92fd4aa None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:02.445232 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1729c1-48d5-4434-8d2a-d335b354e648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:02.446190 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1729c1-48d5-4434-8d2a-d335b354e648 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:02.446714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1729c1-48d5-4434-8d2a-d335b354e648 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:02.447738 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1729c1-48d5-4434-8d2a-d335b354e648 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:02.448489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-ee3e2b68-de16-484a-ada5-5381f92fd4aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:52:02.448489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:52:02.448489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:52:02.448489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:52:02.448489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:52:02.448489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:52:02.448489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:52:02.448489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:52:02.448489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:52:02.448489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:52:02.448489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:52:02.448489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:52:02.448489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:52:02.448489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:52:02.448489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:52:02.449553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:52:02.449553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:52:02.449553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:52:02.449553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:52:02.449553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:52:02.449553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:52:02.449553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:52:02.449553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:52:02.449553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:52:02.449553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:52:02.449553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:52:02.449553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:52:02.449553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:52:02.449553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:52:02.449553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:52:02.449553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:52:02.449553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:52:02.450823 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:52:02.450823 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:52:02.450823 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:52:02.450823 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:52:02.451049 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1729c1-48d5-4434-8d2a-d335b354e648 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:02.451121 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 512/1028] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:52:02.451783 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1729c1-48d5-4434-8d2a-d335b354e648 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:02.458266 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e2b68-de16-484a-ada5-5381f92fd4aa None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:02.482109 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 517/1029] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 08:52:02 2022] POST /identity/v3/users => generated 285 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:52:02.608360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b93b5f-3ade-4f79-bfdc-7f5a23791ed4 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:02.609081 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b93b5f-3ade-4f79-bfdc-7f5a23791ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:02.609081 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b93b5f-3ade-4f79-bfdc-7f5a23791ed4 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:02.610651 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 518/1030] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:52:02.616226 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2d6c9-befe-42f8-b3b3-02e3f53857b7 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:02.616559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2d6c9-befe-42f8-b3b3-02e3f53857b7 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:02.616811 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2d6c9-befe-42f8-b3b3-02e3f53857b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:02.633445 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e2b68-de16-484a-ada5-5381f92fd4aa None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:02.640520 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-d9e2d6c9-befe-42f8-b3b3-02e3f53857b7 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:52:02.641950 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d9e2d6c9-befe-42f8-b3b3-02e3f53857b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:52:02.671119 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:02.699880 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc470cf-c715-4e11-8155-0499ef47a64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:02.700527 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc470cf-c715-4e11-8155-0499ef47a64a None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:02.701911 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc470cf-c715-4e11-8155-0499ef47a64a None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:02.701911 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc470cf-c715-4e11-8155-0499ef47a64a None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:02.701911 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc470cf-c715-4e11-8155-0499ef47a64a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:02.702379 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc470cf-c715-4e11-8155-0499ef47a64a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:02.703584 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc470cf-c715-4e11-8155-0499ef47a64a None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:02.728593 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 513/1031] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:52:02.734844 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc470cf-c715-4e11-8155-0499ef47a64a None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:02.761364 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:02.761941 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 519/1032] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:52:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:52:02.786617 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2d6c9-befe-42f8-b3b3-02e3f53857b7 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:02.919275 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2d6c9-befe-42f8-b3b3-02e3f53857b7 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:02.933383 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc470cf-c715-4e11-8155-0499ef47a64a None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:02.967107 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0d334-d7ad-4a88-af65-f6a2085b3a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:02.967939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0d334-d7ad-4a88-af65-f6a2085b3a03 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:02.968216 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0d334-d7ad-4a88-af65-f6a2085b3a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:02.968490 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0d334-d7ad-4a88-af65-f6a2085b3a03 None admin] PATH_INFO: `/v3/services/image` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:02.969147 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0d334-d7ad-4a88-af65-f6a2085b3a03 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:02.970626 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0d334-d7ad-4a88-af65-f6a2085b3a03 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:02.981940 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-8bf0d334-d7ad-4a88-af65-f6a2085b3a03 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 08:52:02.981940 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:52:02.981940 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:52:02.981940 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:52:02.981940 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:52:02.981940 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:52:02.981940 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:52:02.981940 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:52:02.981940 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 08:52:02.981940 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:52:02.981940 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:52:02.981940 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:52:02.981940 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:52:02.981940 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:52:02.981940 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:52:02.981940 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:52:02.981940 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:52:02.983994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:52:02.983994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:52:02.983994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:52:02.983994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:52:02.983994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:52:02.983994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:52:02.983994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:52:02.983994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:52:02.983994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:52:02.983994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:52:02.983994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:52:02.983994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:52:02.983994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:52:02.983994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:52:02.983994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:52:02.983994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:52:02.985765 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:52:02.985765 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:52:02.985765 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:52:02.985765 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:52:02.985765 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:52:02.985765 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:52:02.985765 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:52:02.985765 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:52:02.985765 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:52:02.985765 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:52:02.985765 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:52:02.985765 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:52:02.985765 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 08:52:02.985765 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:52:02.985765 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 520/1033] 10.222.0.65 () {56 vars in 1105 bytes} [Wed Jul 27 08:52:02 2022] GET /identity/v3/services/image => generated 86 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:52:02.989536 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0d334-d7ad-4a88-af65-f6a2085b3a03 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:03.005421 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060dc32b-8360-451e-ad59-f23d5c47ca2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:03.006082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dc32b-8360-451e-ad59-f23d5c47ca2f None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:03.006394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dc32b-8360-451e-ad59-f23d5c47ca2f None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:03.006738 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dc32b-8360-451e-ad59-f23d5c47ca2f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:03.018783 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060dc32b-8360-451e-ad59-f23d5c47ca2f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:03.021627 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060dc32b-8360-451e-ad59-f23d5c47ca2f None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:03.033181 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:03.050133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-060dc32b-8360-451e-ad59-f23d5c47ca2f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:52:03.050133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:52:03.050133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:52:03.050133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:52:03.050133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:52:03.050133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:52:03.050133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:52:03.050133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:52:03.050133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:52:03.050133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:52:03.050133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:52:03.050133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:52:03.050133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:52:03.050133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:52:03.050133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:52:03.050133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:52:03.052119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:52:03.052119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:52:03.052119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:52:03.052119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:52:03.052119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:52:03.052119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:52:03.052119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:52:03.052119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:52:03.052119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:52:03.052119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:52:03.052119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:52:03.052119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:52:03.052119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:52:03.052119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:52:03.052119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:52:03.052119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:52:03.052119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:52:03.052119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:52:03.054306 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:52:03.054306 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:52:03.054306 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:52:03.054306 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:52:03.054306 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:52:03.054306 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:52:03.054306 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:52:03.054306 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:52:03.054306 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:52:03.054306 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:52:03.054306 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 514/1034] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Jul 27 08:52:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:52:03.059080 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060dc32b-8360-451e-ad59-f23d5c47ca2f None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:03.158827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:03.197310 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0d334-d7ad-4a88-af65-f6a2085b3a03 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:03.211368 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060dc32b-8360-451e-ad59-f23d5c47ca2f None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:03.254136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a797983-32f7-4bcb-a292-1d900bb89619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:03.254809 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a797983-32f7-4bcb-a292-1d900bb89619 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:03.255092 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a797983-32f7-4bcb-a292-1d900bb89619 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:03.255368 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a797983-32f7-4bcb-a292-1d900bb89619 None admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:03.256272 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a797983-32f7-4bcb-a292-1d900bb89619 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:03.256540 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a797983-32f7-4bcb-a292-1d900bb89619 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:03.257916 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a797983-32f7-4bcb-a292-1d900bb89619 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:03.258905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113abc01-dbb3-42dd-9f72-4e1e436f05b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:03.260501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113abc01-dbb3-42dd-9f72-4e1e436f05b7 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:03.261005 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113abc01-dbb3-42dd-9f72-4e1e436f05b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:03.261486 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113abc01-dbb3-42dd-9f72-4e1e436f05b7 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:03.262710 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113abc01-dbb3-42dd-9f72-4e1e436f05b7 None admin] RBAC: Adding query filter params (name=image) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:03.263224 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113abc01-dbb3-42dd-9f72-4e1e436f05b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:03.265829 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113abc01-dbb3-42dd-9f72-4e1e436f05b7 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:03.276018 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 521/1035] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:52:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:03.281327 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 515/1036] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Jul 27 08:52:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:52:03.285768 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113abc01-dbb3-42dd-9f72-4e1e436f05b7 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:03.290276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a797983-32f7-4bcb-a292-1d900bb89619 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:03.410430 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a797983-32f7-4bcb-a292-1d900bb89619 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:03.436580 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:03.445293 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:03.455385 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154eac4-dd88-4311-879c-0adfb3e37d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:03.455946 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154eac4-dd88-4311-879c-0adfb3e37d43 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:03.456223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154eac4-dd88-4311-879c-0adfb3e37d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:03.456499 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154eac4-dd88-4311-879c-0adfb3e37d43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:03.468868 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113abc01-dbb3-42dd-9f72-4e1e436f05b7 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:03.524832 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6c7fd-5697-4a30-92e4-dbafdba00ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:03.526020 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6c7fd-5697-4a30-92e4-dbafdba00ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:03.526304 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6c7fd-5697-4a30-92e4-dbafdba00ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:03.526597 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6c7fd-5697-4a30-92e4-dbafdba00ec7 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:03.527293 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6c7fd-5697-4a30-92e4-dbafdba00ec7 None admin] RBAC: Adding query filter params (type=image) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:03.527600 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6c7fd-5697-4a30-92e4-dbafdba00ec7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:03.529012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6c7fd-5697-4a30-92e4-dbafdba00ec7 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:03.535161 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 522/1037] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:52:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:52:03.546282 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6c7fd-5697-4a30-92e4-dbafdba00ec7 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:03.553577 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154eac4-dd88-4311-879c-0adfb3e37d43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:03.555103 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154eac4-dd88-4311-879c-0adfb3e37d43 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:03.676356 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 516/1038] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:52:03 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:52:03.682823 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154eac4-dd88-4311-879c-0adfb3e37d43 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:03.730234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:03.733445 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6c7fd-5697-4a30-92e4-dbafdba00ec7 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:03.801600 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031868f0-3459-493e-8cfc-cd483a669804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:03.802707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031868f0-3459-493e-8cfc-cd483a669804 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:03.803210 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031868f0-3459-493e-8cfc-cd483a669804 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:03.803673 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031868f0-3459-493e-8cfc-cd483a669804 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:03.805056 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031868f0-3459-493e-8cfc-cd483a669804 None admin] RBAC: Adding query filter params (interface=public, service_id=539d51bbc1f146b181a1d8d6733cb9ed, region_id=RegionOne) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:03.805620 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031868f0-3459-493e-8cfc-cd483a669804 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:03.808604 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031868f0-3459-493e-8cfc-cd483a669804 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:03.818614 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 523/1039] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Jul 27 08:52:03 2022] GET /identity/v3/endpoints?service_id=539d51bbc1f146b181a1d8d6733cb9ed&interface=public®ion_id=RegionOne => generated 194 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:03.828739 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031868f0-3459-493e-8cfc-cd483a669804 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:03.845806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154eac4-dd88-4311-879c-0adfb3e37d43 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:03.852491 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:03.909168 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82367d-fe80-48e4-bb11-a887617bfb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:03.910240 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82367d-fe80-48e4-bb11-a887617bfb50 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:03.910720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82367d-fe80-48e4-bb11-a887617bfb50 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:03.911125 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82367d-fe80-48e4-bb11-a887617bfb50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:03.927230 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82367d-fe80-48e4-bb11-a887617bfb50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:03.929241 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82367d-fe80-48e4-bb11-a887617bfb50 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:03.955836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-5f82367d-fe80-48e4-bb11-a887617bfb50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:52:03.955836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:52:03.955836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:52:03.955836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:52:03.955836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:52:03.955836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:52:03.955836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:52:03.955836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:52:03.955836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:52:03.955836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:52:03.955836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:52:03.955836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:52:03.955836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:52:03.955836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:52:03.955836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:52:03.957599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:52:03.957599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:52:03.957599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:52:03.957599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:52:03.957599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:52:03.957599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:52:03.957599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:52:03.957599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:52:03.957599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:52:03.957599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:52:03.957599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:52:03.957599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:52:03.957599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:52:03.957599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:52:03.957599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:52:03.957599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:52:03.957599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:52:03.959642 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:52:03.959642 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:52:03.959642 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:52:03.959642 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:52:03.962906 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 517/1040] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:52:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:52:03.967389 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82367d-fe80-48e4-bb11-a887617bfb50 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:04.021959 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031868f0-3459-493e-8cfc-cd483a669804 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:04.071269 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e56774-ae1b-4db6-972c-ae0039d06fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:04.072127 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e56774-ae1b-4db6-972c-ae0039d06fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:04.072547 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e56774-ae1b-4db6-972c-ae0039d06fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:04.072947 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e56774-ae1b-4db6-972c-ae0039d06fa2 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:04.073855 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e56774-ae1b-4db6-972c-ae0039d06fa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:04.075775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e56774-ae1b-4db6-972c-ae0039d06fa2 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:04.084546 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 524/1041] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Jul 27 08:52:03 2022] GET /identity/v3/services => generated 1957 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:52:04.152137 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:04.196167 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82367d-fe80-48e4-bb11-a887617bfb50 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:04.265158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21c30e-ea74-4538-a4da-93b85a507bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:04.266143 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21c30e-ea74-4538-a4da-93b85a507bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:04.266638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21c30e-ea74-4538-a4da-93b85a507bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:04.267112 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21c30e-ea74-4538-a4da-93b85a507bd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:04.268385 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21c30e-ea74-4538-a4da-93b85a507bd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:04.268927 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21c30e-ea74-4538-a4da-93b85a507bd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:04.271534 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21c30e-ea74-4538-a4da-93b85a507bd1 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:04.294752 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 518/1042] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:52:04.303912 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e56774-ae1b-4db6-972c-ae0039d06fa2 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:04.458162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:04.506699 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e56774-ae1b-4db6-972c-ae0039d06fa2 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:04.574521 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1c8d9-44a4-4e2b-9cb9-be5831fc889d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:04.575521 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1c8d9-44a4-4e2b-9cb9-be5831fc889d None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:04.576021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1c8d9-44a4-4e2b-9cb9-be5831fc889d None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:04.576518 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1c8d9-44a4-4e2b-9cb9-be5831fc889d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:04.591779 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1c8d9-44a4-4e2b-9cb9-be5831fc889d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:04.594631 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1c8d9-44a4-4e2b-9cb9-be5831fc889d None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:04.617615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-6ef1c8d9-44a4-4e2b-9cb9-be5831fc889d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:52:04.617615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:52:04.617615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:52:04.617615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:52:04.617615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:52:04.617615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:52:04.617615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:52:04.617615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:52:04.617615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:52:04.617615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:52:04.617615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:52:04.617615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:52:04.617615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:52:04.617615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:52:04.617615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:52:04.619749 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:52:04.619749 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:52:04.619749 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:52:04.619749 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:52:04.619749 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:52:04.619749 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:52:04.619749 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:52:04.619749 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:52:04.619749 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:52:04.619749 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:52:04.619749 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:52:04.619749 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:52:04.619749 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:52:04.619749 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:52:04.619749 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:52:04.619749 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:52:04.619749 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:52:04.621519 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:52:04.621519 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:52:04.621519 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:52:04.621519 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:52:04.621519 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:52:04.621519 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:52:04.621519 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:52:04.621519 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:52:04.626753 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 525/1043] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:52:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:52:04.630723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21c30e-ea74-4538-a4da-93b85a507bd1 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:04.752720 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a43c8f-b87f-462f-9614-c1b86d1b6af7 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:04.753523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a43c8f-b87f-462f-9614-c1b86d1b6af7 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:04.753662 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a43c8f-b87f-462f-9614-c1b86d1b6af7 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:04.756398 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 526/1044] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:52:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:52:04.763667 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8c26b-e755-4778-a4fd-dceec2ee351c None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:04.764123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8c26b-e755-4778-a4fd-dceec2ee351c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:04.764529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8c26b-e755-4778-a4fd-dceec2ee351c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:04.784204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21c30e-ea74-4538-a4da-93b85a507bd1 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:04.787697 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-1ce8c26b-e755-4778-a4fd-dceec2ee351c None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:52:04.789074 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1ce8c26b-e755-4778-a4fd-dceec2ee351c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:52:04.829216 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8460e-1b1d-4bef-b674-06363282dee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:04.830474 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8460e-1b1d-4bef-b674-06363282dee1 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:04.830841 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8460e-1b1d-4bef-b674-06363282dee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:04.831131 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8460e-1b1d-4bef-b674-06363282dee1 None admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:04.831885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8460e-1b1d-4bef-b674-06363282dee1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:04.832196 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8460e-1b1d-4bef-b674-06363282dee1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:04.833661 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8460e-1b1d-4bef-b674-06363282dee1 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:04.846613 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:04.853542 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 519/1045] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:52:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:52:04.860787 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8460e-1b1d-4bef-b674-06363282dee1 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:04.895376 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 527/1046] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:52:04 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:52:04.933193 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8c26b-e755-4778-a4fd-dceec2ee351c None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:05.030807 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:05.041600 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8460e-1b1d-4bef-b674-06363282dee1 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:05.089884 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8c26b-e755-4778-a4fd-dceec2ee351c None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:05.101105 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa1bdc-4b56-47d9-8f17-0277cd0445a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:05.102078 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa1bdc-4b56-47d9-8f17-0277cd0445a0 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:05.102614 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa1bdc-4b56-47d9-8f17-0277cd0445a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:05.103069 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa1bdc-4b56-47d9-8f17-0277cd0445a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:05.104548 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa1bdc-4b56-47d9-8f17-0277cd0445a0 None admin] RBAC: Adding query filter params (role.id=1e9124c6b23746fe97007d59fe6af878, scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267, user.id=c30bc55c6a1348bb961f0d010422da87) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:05.105055 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa1bdc-4b56-47d9-8f17-0277cd0445a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:05.107589 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa1bdc-4b56-47d9-8f17-0277cd0445a0 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:05.130362 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 520/1047] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:52:04 2022] GET /identity/v3/role_assignments?user.id=c30bc55c6a1348bb961f0d010422da87&scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267&role.id=1e9124c6b23746fe97007d59fe6af878 => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:05.149330 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942d0b6-d0c8-4827-8472-8b3dd9f05e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:05.150305 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942d0b6-d0c8-4827-8472-8b3dd9f05e7a None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:05.150846 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942d0b6-d0c8-4827-8472-8b3dd9f05e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:05.151292 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942d0b6-d0c8-4827-8472-8b3dd9f05e7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:05.166896 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942d0b6-d0c8-4827-8472-8b3dd9f05e7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:52:05.172675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-9942d0b6-d0c8-4827-8472-8b3dd9f05e7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:52:05.172675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:52:05.172675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:52:05.172675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:52:05.172675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:52:05.172675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:52:05.172675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:52:05.172675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:52:05.172675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:52:05.172675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:52:05.172675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:52:05.172675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:52:05.172675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:52:05.172675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:52:05.172675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:52:05.172675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:52:05.174633 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:52:05.174633 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:52:05.174633 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:52:05.174633 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:52:05.174633 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:52:05.174633 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:52:05.174633 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:52:05.174633 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:52:05.174633 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:52:05.174633 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:52:05.174633 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:52:05.174633 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:52:05.174633 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:52:05.174633 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:52:05.174633 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:52:05.174633 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:52:05.180519 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:52:05.180519 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:52:05.180519 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:52:05.180519 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:52:05.180519 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:52:05.180519 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:52:05.180519 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:52:05.180519 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:52:05.180519 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:52:05.180519 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:52:05.180519 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:52:05.180519 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:52:05.180519 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 528/1048] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:52:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:52:05.186130 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa1bdc-4b56-47d9-8f17-0277cd0445a0 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:05.268685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:05.321712 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa1bdc-4b56-47d9-8f17-0277cd0445a0 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:05.360850 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08adb61-989b-4ead-a7d2-68707c1a40b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:05.361569 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08adb61-989b-4ead-a7d2-68707c1a40b2 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:05.361977 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08adb61-989b-4ead-a7d2-68707c1a40b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:05.362425 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08adb61-989b-4ead-a7d2-68707c1a40b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:05.363304 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08adb61-989b-4ead-a7d2-68707c1a40b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:05.363745 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08adb61-989b-4ead-a7d2-68707c1a40b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:05.365270 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08adb61-989b-4ead-a7d2-68707c1a40b2 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:05.381091 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 521/1049] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:52:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:05.383008 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942d0b6-d0c8-4827-8472-8b3dd9f05e7a None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:05.559019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942d0b6-d0c8-4827-8472-8b3dd9f05e7a None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:05.608819 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:05.625389 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7545945-3e69-4758-986f-33a44195d5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:05.626385 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7545945-3e69-4758-986f-33a44195d5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:05.626881 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7545945-3e69-4758-986f-33a44195d5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:05.627342 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7545945-3e69-4758-986f-33a44195d5b0 None admin] PATH_INFO: `/v3/users/93c7c15cfd784f91956314458893f31b` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:05.649070 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7545945-3e69-4758-986f-33a44195d5b0 None admin] RBAC: Authorizing `identity:get_user(user_id=93c7c15cfd784f91956314458893f31b)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:05.651501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7545945-3e69-4758-986f-33a44195d5b0 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:05.658188 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 529/1050] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:52:05 2022] GET /identity/v3/users/93c7c15cfd784f91956314458893f31b => generated 285 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:52:05.660244 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08adb61-989b-4ead-a7d2-68707c1a40b2 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:05.830514 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08adb61-989b-4ead-a7d2-68707c1a40b2 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:05.860404 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:05.871405 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1872f7-1d24-4391-a7b5-777c23103b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:05.872035 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1872f7-1d24-4391-a7b5-777c23103b0f None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:05.872313 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1872f7-1d24-4391-a7b5-777c23103b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:05.872585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1872f7-1d24-4391-a7b5-777c23103b0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:05.953305 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1872f7-1d24-4391-a7b5-777c23103b0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:05.954738 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1872f7-1d24-4391-a7b5-777c23103b0f None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:06.086146 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 522/1051] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:52:05 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:52:06.096806 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7545945-3e69-4758-986f-33a44195d5b0 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:06.247318 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7545945-3e69-4758-986f-33a44195d5b0 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:06.296095 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3827266-2cf4-4f53-bb23-18dde907e7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:06.296861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3827266-2cf4-4f53-bb23-18dde907e7dd None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:06.297208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3827266-2cf4-4f53-bb23-18dde907e7dd None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:06.297483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3827266-2cf4-4f53-bb23-18dde907e7dd None admin] PATH_INFO: `/v3/projects/7ad5e31e44b3463287d45ddd6726d661` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:06.298978 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3827266-2cf4-4f53-bb23-18dde907e7dd None admin] RBAC: Authorizing `identity:get_project(project_id=7ad5e31e44b3463287d45ddd6726d661)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:06.300912 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3827266-2cf4-4f53-bb23-18dde907e7dd None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:06.303462 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 530/1052] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:52:06 2022] GET /identity/v3/projects/7ad5e31e44b3463287d45ddd6726d661 => generated 311 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:06.312404 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1872f7-1d24-4391-a7b5-777c23103b0f None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:06.345104 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:06.438591 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1872f7-1d24-4391-a7b5-777c23103b0f None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:06.483438 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7054675-499c-4bb6-8161-b19405e8ac87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:06.484099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7054675-499c-4bb6-8161-b19405e8ac87 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:06.484372 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7054675-499c-4bb6-8161-b19405e8ac87 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:06.484649 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7054675-499c-4bb6-8161-b19405e8ac87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:06.485494 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7054675-499c-4bb6-8161-b19405e8ac87 None admin] RBAC: Adding query filter params (role.id=20bc872844094480b9dca67a25b69e84, scope.project.id=7ad5e31e44b3463287d45ddd6726d661, user.id=93c7c15cfd784f91956314458893f31b) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:06.485805 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7054675-499c-4bb6-8161-b19405e8ac87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:06.487367 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7054675-499c-4bb6-8161-b19405e8ac87 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:06.495348 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 523/1053] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:52:06 2022] GET /identity/v3/role_assignments?user.id=93c7c15cfd784f91956314458893f31b&scope.project.id=7ad5e31e44b3463287d45ddd6726d661&role.id=20bc872844094480b9dca67a25b69e84 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:06.823633 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38a06b-3685-46bc-a897-8f04ea0c4b22 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:06.824071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38a06b-3685-46bc-a897-8f04ea0c4b22 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:06.824178 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38a06b-3685-46bc-a897-8f04ea0c4b22 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:06.825742 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 531/1054] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:52:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:52:06.831164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37b889-448d-488a-9fa3-f726e4ffead7 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:06.831653 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37b889-448d-488a-9fa3-f726e4ffead7 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:06.831730 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37b889-448d-488a-9fa3-f726e4ffead7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:06.850563 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-da37b889-448d-488a-9fa3-f726e4ffead7 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:52:06.851765 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-da37b889-448d-488a-9fa3-f726e4ffead7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:52:06.925863 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 524/1055] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:52:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:52:06.949191 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38a06b-3685-46bc-a897-8f04ea0c4b22 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:07.009065 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:07.109400 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38a06b-3685-46bc-a897-8f04ea0c4b22 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:07.178270 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5bcf9a-060c-45bf-bef5-67e50a396596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:07.179160 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bcf9a-060c-45bf-bef5-67e50a396596 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:07.179610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bcf9a-060c-45bf-bef5-67e50a396596 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:07.180109 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bcf9a-060c-45bf-bef5-67e50a396596 None admin] PATH_INFO: `/v3/services/image` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:07.181302 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5bcf9a-060c-45bf-bef5-67e50a396596 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:07.184430 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5bcf9a-060c-45bf-bef5-67e50a396596 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:07.202789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-9a5bcf9a-060c-45bf-bef5-67e50a396596 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 08:52:07.202789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:52:07.202789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:52:07.202789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:52:07.202789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:52:07.202789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:52:07.202789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:52:07.202789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:52:07.202789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 08:52:07.202789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:52:07.202789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:52:07.202789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:52:07.202789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:52:07.202789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:52:07.202789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:52:07.202789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:52:07.202789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:52:07.204176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:52:07.204176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:52:07.204176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:52:07.204176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:52:07.204176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:52:07.204176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:52:07.204176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:52:07.204176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:52:07.204176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:52:07.204176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:52:07.204176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:52:07.204176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:52:07.204176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:52:07.204176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:52:07.204176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:52:07.204176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:52:07.210799 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:52:07.210799 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:52:07.210799 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:52:07.210799 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:52:07.210799 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:52:07.210799 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:52:07.210799 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:52:07.210799 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:52:07.210799 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:52:07.210799 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:52:07.210799 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:52:07.210799 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:52:07.210799 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 08:52:07.210799 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:52:07.210799 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 532/1056] 10.222.0.65 () {56 vars in 1105 bytes} [Wed Jul 27 08:52:06 2022] GET /identity/v3/services/image => generated 86 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:52:07.214544 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37b889-448d-488a-9fa3-f726e4ffead7 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:07.252183 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:07.372732 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37b889-448d-488a-9fa3-f726e4ffead7 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:07.416609 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98cac0e-8be7-41b9-9b3e-4e8998bd3da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:07.417269 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cac0e-8be7-41b9-9b3e-4e8998bd3da0 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:07.417556 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cac0e-8be7-41b9-9b3e-4e8998bd3da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:07.417833 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cac0e-8be7-41b9-9b3e-4e8998bd3da0 None admin] PATH_INFO: `/v3/services` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:07.418560 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98cac0e-8be7-41b9-9b3e-4e8998bd3da0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:07.418867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98cac0e-8be7-41b9-9b3e-4e8998bd3da0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:07.420349 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98cac0e-8be7-41b9-9b3e-4e8998bd3da0 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:07.426563 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 525/1057] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:52:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:07.433410 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5bcf9a-060c-45bf-bef5-67e50a396596 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:07.604449 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5bcf9a-060c-45bf-bef5-67e50a396596 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:07.629333 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:07.664704 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b967a9-8077-4d5e-ba75-f481308056fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:07.666290 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b967a9-8077-4d5e-ba75-f481308056fd None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:07.666832 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b967a9-8077-4d5e-ba75-f481308056fd None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:07.667337 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b967a9-8077-4d5e-ba75-f481308056fd None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:07.668599 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b967a9-8077-4d5e-ba75-f481308056fd None admin] RBAC: Adding query filter params (type=image) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:07.669143 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b967a9-8077-4d5e-ba75-f481308056fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:07.671907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b967a9-8077-4d5e-ba75-f481308056fd None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:07.686389 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 533/1058] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:52:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:52:07.689105 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98cac0e-8be7-41b9-9b3e-4e8998bd3da0 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:07.722439 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c90ce-524d-42a2-a2ce-0adb53af34ee None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:07.722740 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c90ce-524d-42a2-a2ce-0adb53af34ee None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:07.722991 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c90ce-524d-42a2-a2ce-0adb53af34ee None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:07.724420 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 534/1059] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:52:07.731141 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1fc28-a7bb-478a-983b-4a00f85ba2de None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:07.731487 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1fc28-a7bb-478a-983b-4a00f85ba2de None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:07.731703 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1fc28-a7bb-478a-983b-4a00f85ba2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:07.760102 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-2ff1fc28-a7bb-478a-983b-4a00f85ba2de None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:52:07.762223 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-2ff1fc28-a7bb-478a-983b-4a00f85ba2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:52:07.818414 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:07.839340 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98cac0e-8be7-41b9-9b3e-4e8998bd3da0 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:07.870175 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 535/1060] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:52:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:52:07.880983 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df881909-55fb-465f-a685-95fd2169c643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:07.881726 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df881909-55fb-465f-a685-95fd2169c643 None admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:07.882131 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df881909-55fb-465f-a685-95fd2169c643 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:07.882560 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df881909-55fb-465f-a685-95fd2169c643 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:07.883445 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df881909-55fb-465f-a685-95fd2169c643 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:07.885096 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df881909-55fb-465f-a685-95fd2169c643 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:07.892183 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1fc28-a7bb-478a-983b-4a00f85ba2de None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:07.911384 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 526/1061] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 08:52:07 2022] POST /identity/v3/endpoints => generated 327 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:52:08.046376 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1fc28-a7bb-478a-983b-4a00f85ba2de None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:08.066160 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:08.106390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92175e19-13d4-4ef8-8700-ea994d8aa336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:08.107061 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92175e19-13d4-4ef8-8700-ea994d8aa336 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:08.107347 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92175e19-13d4-4ef8-8700-ea994d8aa336 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:08.107616 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92175e19-13d4-4ef8-8700-ea994d8aa336 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:08.123946 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92175e19-13d4-4ef8-8700-ea994d8aa336 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:52:08.129067 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-92175e19-13d4-4ef8-8700-ea994d8aa336 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 08:52:08.129067 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:52:08.129067 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:52:08.129067 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:52:08.129067 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:52:08.129067 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:52:08.129067 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:52:08.129067 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:52:08.129067 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:52:08.129067 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:52:08.129067 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:52:08.129067 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:52:08.129067 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:52:08.129067 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:52:08.129067 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:52:08.129067 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:52:08.130770 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:52:08.130770 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:52:08.130770 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:52:08.130770 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:52:08.130770 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:52:08.130770 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:52:08.130770 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:52:08.130770 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:52:08.130770 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:52:08.130770 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:52:08.130770 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:52:08.130770 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:52:08.130770 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:52:08.130770 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:52:08.130770 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:52:08.130770 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:52:08.133071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:52:08.133071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:52:08.133071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:52:08.133071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:52:08.133071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:52:08.133071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:52:08.133071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:52:08.133071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:52:08.133071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:52:08.133071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:52:08.133071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 08:52:08.133071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:52:08.133071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 536/1062] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Jul 27 08:52:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:52:08.138876 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df881909-55fb-465f-a685-95fd2169c643 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:08.319201 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df881909-55fb-465f-a685-95fd2169c643 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:08.380114 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0794c9-1f7a-4e7b-8f42-6900eca5b261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:08.381119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0794c9-1f7a-4e7b-8f42-6900eca5b261 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:08.381578 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0794c9-1f7a-4e7b-8f42-6900eca5b261 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:08.382048 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0794c9-1f7a-4e7b-8f42-6900eca5b261 None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:08.383445 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0794c9-1f7a-4e7b-8f42-6900eca5b261 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:08.383908 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0794c9-1f7a-4e7b-8f42-6900eca5b261 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:08.387045 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0794c9-1f7a-4e7b-8f42-6900eca5b261 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:08.408254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 527/1063] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Jul 27 08:52:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:52:08.410447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92175e19-13d4-4ef8-8700-ea994d8aa336 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:08.544748 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92175e19-13d4-4ef8-8700-ea994d8aa336 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:08.582612 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b0bb2-943f-4c50-96f1-9c1c8c9de5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:08.583262 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b0bb2-943f-4c50-96f1-9c1c8c9de5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:08.583536 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b0bb2-943f-4c50-96f1-9c1c8c9de5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:08.583811 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b0bb2-943f-4c50-96f1-9c1c8c9de5b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:08.597088 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b0bb2-943f-4c50-96f1-9c1c8c9de5b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:08.598586 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b0bb2-943f-4c50-96f1-9c1c8c9de5b5 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:08.614710 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-128b0bb2-943f-4c50-96f1-9c1c8c9de5b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:52:08.614710 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:52:08.614710 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:52:08.614710 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:52:08.614710 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:52:08.614710 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:52:08.614710 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:52:08.614710 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:52:08.614710 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:52:08.614710 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:52:08.614710 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:52:08.614710 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:52:08.614710 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:52:08.614710 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:52:08.614710 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:52:08.621713 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:52:08.621713 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:52:08.621713 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:52:08.621713 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:52:08.621713 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:52:08.621713 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:52:08.621713 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:52:08.621713 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:52:08.621713 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:52:08.621713 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:52:08.621713 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:52:08.621713 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:52:08.621713 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:52:08.621713 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:52:08.621713 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:52:08.621713 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:52:08.621713 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:52:08.623046 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:52:08.623046 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:52:08.623046 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:52:08.623046 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:52:08.623046 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 537/1064] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:52:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:52:08.623349 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0794c9-1f7a-4e7b-8f42-6900eca5b261 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:08.626343 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:08.716580 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83532a7-d28a-472a-8192-74486b96b248 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:08.717002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83532a7-d28a-472a-8192-74486b96b248 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:08.717499 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83532a7-d28a-472a-8192-74486b96b248 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:08.720254 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 538/1065] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:52:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:52:08.728651 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbc298-93b0-420f-b20e-0c68e02a4848 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:08.729058 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbc298-93b0-420f-b20e-0c68e02a4848 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:08.729317 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbc298-93b0-420f-b20e-0c68e02a4848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:08.744802 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0794c9-1f7a-4e7b-8f42-6900eca5b261 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:08.752694 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-6ccbc298-93b0-420f-b20e-0c68e02a4848 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:52:08.753914 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6ccbc298-93b0-420f-b20e-0c68e02a4848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:52:08.779840 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:08.786374 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882ee01-a5c4-41cb-9095-8b31cd49001c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:08.787012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882ee01-a5c4-41cb-9095-8b31cd49001c None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:08.787292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882ee01-a5c4-41cb-9095-8b31cd49001c None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:08.787692 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882ee01-a5c4-41cb-9095-8b31cd49001c None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:08.788271 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882ee01-a5c4-41cb-9095-8b31cd49001c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:08.788572 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882ee01-a5c4-41cb-9095-8b31cd49001c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:08.789955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882ee01-a5c4-41cb-9095-8b31cd49001c None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:08.811135 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 528/1066] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:08.818472 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882ee01-a5c4-41cb-9095-8b31cd49001c None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:08.882843 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 539/1067] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:52:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:52:08.901974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:08.905507 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccbc298-93b0-420f-b20e-0c68e02a4848 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:08.960203 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882ee01-a5c4-41cb-9095-8b31cd49001c None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:09.000542 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a1cec-a21d-4f2a-8720-9fb192bf3595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:09.001099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a1cec-a21d-4f2a-8720-9fb192bf3595 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:09.001378 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a1cec-a21d-4f2a-8720-9fb192bf3595 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:09.001649 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a1cec-a21d-4f2a-8720-9fb192bf3595 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:09.010004 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a1cec-a21d-4f2a-8720-9fb192bf3595 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:09.011929 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a1cec-a21d-4f2a-8720-9fb192bf3595 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:09.029284 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-417a1cec-a21d-4f2a-8720-9fb192bf3595 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:52:09.029284 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:52:09.029284 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:52:09.029284 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:52:09.029284 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:52:09.029284 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:52:09.029284 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:52:09.029284 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:52:09.029284 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:52:09.029284 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:52:09.029284 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:52:09.029284 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:52:09.029284 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:52:09.029284 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:52:09.029284 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:52:09.029284 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:52:09.030357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:52:09.030357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:52:09.030357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:52:09.030357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:52:09.030357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:52:09.030357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:52:09.030357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:52:09.030357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:52:09.030357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:52:09.030357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:52:09.030357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:52:09.030357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:52:09.030357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:52:09.030357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:52:09.030357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:52:09.030357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:52:09.030357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:52:09.030357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:52:09.031318 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:52:09.031318 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:52:09.031318 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:52:09.031318 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:52:09.031318 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:52:09.031318 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:52:09.031318 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:52:09.031318 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:52:09.031318 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:52:09.031318 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:52:09.031318 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 529/1068] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Jul 27 08:52:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:52:09.037289 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a1cec-a21d-4f2a-8720-9fb192bf3595 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:09.037899 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccbc298-93b0-420f-b20e-0c68e02a4848 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:09.079499 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a3b35-3d28-4fce-9297-13e5bd464e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:09.080155 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a3b35-3d28-4fce-9297-13e5bd464e45 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:09.080438 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a3b35-3d28-4fce-9297-13e5bd464e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:09.080702 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a3b35-3d28-4fce-9297-13e5bd464e45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:09.092069 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a3b35-3d28-4fce-9297-13e5bd464e45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:52:09.097026 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-2c9a3b35-3d28-4fce-9297-13e5bd464e45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:52:09.097026 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:52:09.097026 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:52:09.097026 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:52:09.097026 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:52:09.097026 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:52:09.097026 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:52:09.097026 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:52:09.097026 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:52:09.097026 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:52:09.097026 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:52:09.097026 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:52:09.097026 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:52:09.097026 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:52:09.097026 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:52:09.097026 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:52:09.097979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:52:09.097979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:52:09.097979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:52:09.097979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:52:09.097979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:52:09.097979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:52:09.097979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:52:09.097979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:52:09.097979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:52:09.097979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:52:09.097979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:52:09.097979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:52:09.097979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:52:09.097979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:52:09.097979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:52:09.097979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:52:09.098852 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:52:09.098852 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:52:09.098852 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:52:09.098852 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:52:09.098852 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:52:09.098852 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:52:09.098852 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:52:09.098852 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:52:09.098852 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:52:09.098852 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:52:09.098852 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:52:09.098852 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:52:09.098852 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 540/1069] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:52:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:52:09.105302 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a3b35-3d28-4fce-9297-13e5bd464e45 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:09.119840 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:09.174839 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a1cec-a21d-4f2a-8720-9fb192bf3595 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:09.202010 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:09.216427 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04dbb0-b86f-4085-8b49-8818e2fa9b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:09.217947 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04dbb0-b86f-4085-8b49-8818e2fa9b52 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:09.218232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04dbb0-b86f-4085-8b49-8818e2fa9b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:09.218542 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04dbb0-b86f-4085-8b49-8818e2fa9b52 None admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:09.219359 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04dbb0-b86f-4085-8b49-8818e2fa9b52 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:09.219669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04dbb0-b86f-4085-8b49-8818e2fa9b52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:09.221130 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04dbb0-b86f-4085-8b49-8818e2fa9b52 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:09.243491 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 530/1070] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Jul 27 08:52:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:52:09.249519 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04dbb0-b86f-4085-8b49-8818e2fa9b52 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:09.271799 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a3b35-3d28-4fce-9297-13e5bd464e45 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:09.321076 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d04c65-d984-454f-99b1-ac240594b99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:09.321897 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d04c65-d984-454f-99b1-ac240594b99f None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:09.322847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d04c65-d984-454f-99b1-ac240594b99f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:09.322997 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d04c65-d984-454f-99b1-ac240594b99f None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:09.323954 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d04c65-d984-454f-99b1-ac240594b99f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:09.324470 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d04c65-d984-454f-99b1-ac240594b99f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:09.326379 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d04c65-d984-454f-99b1-ac240594b99f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:09.342844 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 541/1071] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:52:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:52:09.345123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d04c65-d984-454f-99b1-ac240594b99f None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:09.422782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:09.440055 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04dbb0-b86f-4085-8b49-8818e2fa9b52 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:09.482518 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5c138-3592-4485-b73a-5c0e2a775f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:09.483171 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5c138-3592-4485-b73a-5c0e2a775f1c None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:09.483454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5c138-3592-4485-b73a-5c0e2a775f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:09.483723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5c138-3592-4485-b73a-5c0e2a775f1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:09.484487 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d04c65-d984-454f-99b1-ac240594b99f None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:09.498644 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5c138-3592-4485-b73a-5c0e2a775f1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:09.499638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5c138-3592-4485-b73a-5c0e2a775f1c None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:09.516846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-4bf5c138-3592-4485-b73a-5c0e2a775f1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:52:09.516846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:52:09.516846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:52:09.516846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:52:09.516846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:52:09.516846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:52:09.516846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:52:09.516846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:52:09.516846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:52:09.516846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:52:09.516846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:52:09.516846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:52:09.516846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:52:09.516846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:52:09.516846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:52:09.518200 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:52:09.518200 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:52:09.518200 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:52:09.518200 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:52:09.518200 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:52:09.518200 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:52:09.518200 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:52:09.518200 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:52:09.518200 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:52:09.518200 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:52:09.518200 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:52:09.518200 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:52:09.518200 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:52:09.518200 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:52:09.518200 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:52:09.518200 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:52:09.518200 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:52:09.520506 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:52:09.520506 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:52:09.520506 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:52:09.520506 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:52:09.522975 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 531/1072] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:52:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:52:09.524935 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5c138-3592-4485-b73a-5c0e2a775f1c None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:09.546217 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d47b2-cf58-4120-9036-25354f4b8cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:09.547312 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d47b2-cf58-4120-9036-25354f4b8cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:09.547806 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d47b2-cf58-4120-9036-25354f4b8cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:09.548294 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d47b2-cf58-4120-9036-25354f4b8cb6 None admin] PATH_INFO: `/v3/users/93c7c15cfd784f91956314458893f31b` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:09.550167 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d47b2-cf58-4120-9036-25354f4b8cb6 None admin] RBAC: Authorizing `identity:get_user(user_id=93c7c15cfd784f91956314458893f31b)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:09.553183 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d47b2-cf58-4120-9036-25354f4b8cb6 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:09.556321 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 542/1073] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:52:09 2022] GET /identity/v3/users/93c7c15cfd784f91956314458893f31b => generated 285 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:52:09.563639 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d47b2-cf58-4120-9036-25354f4b8cb6 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:09.578175 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:09.682059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5c138-3592-4485-b73a-5c0e2a775f1c None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:09.731559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbdd7b-b1e8-406a-9cdf-53b978f47d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:09.732197 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbdd7b-b1e8-406a-9cdf-53b978f47d25 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:09.732480 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbdd7b-b1e8-406a-9cdf-53b978f47d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:09.732761 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbdd7b-b1e8-406a-9cdf-53b978f47d25 None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:09.733476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bbdd7b-b1e8-406a-9cdf-53b978f47d25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:09.733779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bbdd7b-b1e8-406a-9cdf-53b978f47d25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:09.735273 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bbdd7b-b1e8-406a-9cdf-53b978f47d25 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:09.756463 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 532/1074] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:09.757533 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d47b2-cf58-4120-9036-25354f4b8cb6 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:09.757865 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbdd7b-b1e8-406a-9cdf-53b978f47d25 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:09.818662 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efceb3-2c67-412c-a777-8914c1158632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:09.819693 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efceb3-2c67-412c-a777-8914c1158632 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:09.820163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efceb3-2c67-412c-a777-8914c1158632 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:09.820669 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efceb3-2c67-412c-a777-8914c1158632 None admin] PATH_INFO: `/v3/projects/7ad5e31e44b3463287d45ddd6726d661` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:09.823354 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4efceb3-2c67-412c-a777-8914c1158632 None admin] RBAC: Authorizing `identity:get_project(project_id=7ad5e31e44b3463287d45ddd6726d661)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:09.826467 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4efceb3-2c67-412c-a777-8914c1158632 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:09.832588 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 543/1075] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:52:09 2022] GET /identity/v3/projects/7ad5e31e44b3463287d45ddd6726d661 => generated 311 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:09.838790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efceb3-2c67-412c-a777-8914c1158632 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:09.851360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:09.902538 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:09.918445 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbdd7b-b1e8-406a-9cdf-53b978f47d25 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:09.972906 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd836f-aabc-4e6d-b083-a5982f9e2e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:09.973566 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd836f-aabc-4e6d-b083-a5982f9e2e73 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:09.973845 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd836f-aabc-4e6d-b083-a5982f9e2e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:09.974120 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd836f-aabc-4e6d-b083-a5982f9e2e73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:09.983046 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd836f-aabc-4e6d-b083-a5982f9e2e73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:09.984553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd836f-aabc-4e6d-b083-a5982f9e2e73 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:09.997245 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-21cd836f-aabc-4e6d-b083-a5982f9e2e73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:52:09.997245 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:52:09.997245 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:52:09.997245 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:52:09.997245 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:52:09.997245 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:52:09.997245 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:52:09.997245 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:52:09.997245 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:52:09.997245 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:52:09.997245 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:52:09.997245 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:52:09.997245 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:52:09.997245 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:52:09.997245 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:52:09.998262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:52:09.998262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:52:09.998262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:52:09.998262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:52:09.998262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:52:09.998262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:52:09.998262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:52:09.998262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:52:09.998262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:52:09.998262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:52:09.998262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:52:09.998262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:52:09.998262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:52:09.998262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:52:09.998262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:52:09.998262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:52:09.998262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:52:09.999256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:52:09.999256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:52:09.999256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:52:09.999256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:52:09.999256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:52:09.999256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:52:09.999256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:52:09.999256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:52:09.999256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 533/1076] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:52:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:52:10.006044 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd836f-aabc-4e6d-b083-a5982f9e2e73 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:10.026677 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efceb3-2c67-412c-a777-8914c1158632 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:10.093086 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4ff84-3dc5-4f3a-bab9-e498dbf3e9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:10.094051 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4ff84-3dc5-4f3a-bab9-e498dbf3e9b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:10.094634 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4ff84-3dc5-4f3a-bab9-e498dbf3e9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:10.095514 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4ff84-3dc5-4f3a-bab9-e498dbf3e9b0 None admin] PATH_INFO: `/v3/projects/7ad5e31e44b3463287d45ddd6726d661/users/93c7c15cfd784f91956314458893f31b/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:10.099338 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4ff84-3dc5-4f3a-bab9-e498dbf3e9b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ad5e31e44b3463287d45ddd6726d661, user_id=93c7c15cfd784f91956314458893f31b, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:10.100798 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4ff84-3dc5-4f3a-bab9-e498dbf3e9b0 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:10.128722 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 544/1077] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 08:52:09 2022] PUT /identity/v3/projects/7ad5e31e44b3463287d45ddd6726d661/users/93c7c15cfd784f91956314458893f31b/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:52:10.138062 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd836f-aabc-4e6d-b083-a5982f9e2e73 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:10.184109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafdca8-af54-4e29-b16d-cb4a6a624c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:10.184747 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafdca8-af54-4e29-b16d-cb4a6a624c7a None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:10.185033 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafdca8-af54-4e29-b16d-cb4a6a624c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:10.185311 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafdca8-af54-4e29-b16d-cb4a6a624c7a None admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:10.186096 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cafdca8-af54-4e29-b16d-cb4a6a624c7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:10.186521 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cafdca8-af54-4e29-b16d-cb4a6a624c7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:10.188014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cafdca8-af54-4e29-b16d-cb4a6a624c7a None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:10.204797 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 534/1078] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:52:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:52:10.211314 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4ff84-3dc5-4f3a-bab9-e498dbf3e9b0 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:10.260743 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5e8b7-d5ec-472c-b625-7451558979b2 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:10.261032 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5e8b7-d5ec-472c-b625-7451558979b2 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:10.261300 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5e8b7-d5ec-472c-b625-7451558979b2 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:10.262813 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 535/1079] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:52:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:52:10.271066 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876c55c-164a-49d7-a14f-55970c13eaab None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:10.271394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876c55c-164a-49d7-a14f-55970c13eaab None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:10.271758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876c55c-164a-49d7-a14f-55970c13eaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:10.296438 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-7876c55c-164a-49d7-a14f-55970c13eaab None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:52:10.297742 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-7876c55c-164a-49d7-a14f-55970c13eaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:52:10.307568 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:10.309741 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:10.382357 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4ff84-3dc5-4f3a-bab9-e498dbf3e9b0 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:10.412208 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 536/1080] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:52:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:52:10.434915 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876c55c-164a-49d7-a14f-55970c13eaab None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:10.448821 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d274a1-f418-4e38-90b3-7f44aa9645ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:10.450239 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d274a1-f418-4e38-90b3-7f44aa9645ec None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:10.450933 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d274a1-f418-4e38-90b3-7f44aa9645ec None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:10.451678 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d274a1-f418-4e38-90b3-7f44aa9645ec None admin] PATH_INFO: `/v3/projects/3f77fdd017ea4a9b9b49f6e87ba7f267/users/c30bc55c6a1348bb961f0d010422da87/roles/1e9124c6b23746fe97007d59fe6af878` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:10.456708 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d274a1-f418-4e38-90b3-7f44aa9645ec None admin] RBAC: Authorizing `identity:create_grant(project_id=3f77fdd017ea4a9b9b49f6e87ba7f267, user_id=c30bc55c6a1348bb961f0d010422da87, role_id=1e9124c6b23746fe97007d59fe6af878)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:10.459695 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d274a1-f418-4e38-90b3-7f44aa9645ec None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:10.489120 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 545/1081] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 08:52:10 2022] PUT /identity/v3/projects/3f77fdd017ea4a9b9b49f6e87ba7f267/users/c30bc55c6a1348bb961f0d010422da87/roles/1e9124c6b23746fe97007d59fe6af878 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 08:52:10.562870 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876c55c-164a-49d7-a14f-55970c13eaab None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:10.608490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355e58e-af33-4d67-adb9-1d80b3398463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:10.609141 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355e58e-af33-4d67-adb9-1d80b3398463 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:10.609420 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355e58e-af33-4d67-adb9-1d80b3398463 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:10.609704 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355e58e-af33-4d67-adb9-1d80b3398463 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:10.626240 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:10.719188 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355e58e-af33-4d67-adb9-1d80b3398463 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:10.720632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355e58e-af33-4d67-adb9-1d80b3398463 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:10.859442 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 537/1082] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:52:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 08:52:10.865682 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d274a1-f418-4e38-90b3-7f44aa9645ec None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:11.025488 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d274a1-f418-4e38-90b3-7f44aa9645ec None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:11.061117 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:11.074897 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09097056-0b7c-43c0-9faa-40d126f07e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:11.075877 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09097056-0b7c-43c0-9faa-40d126f07e36 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:11.076819 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09097056-0b7c-43c0-9faa-40d126f07e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:11.076819 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09097056-0b7c-43c0-9faa-40d126f07e36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:11.092654 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09097056-0b7c-43c0-9faa-40d126f07e36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:11.094180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09097056-0b7c-43c0-9faa-40d126f07e36 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:11.112583 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-09097056-0b7c-43c0-9faa-40d126f07e36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:52:11.112583 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:52:11.112583 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:52:11.112583 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:52:11.112583 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:52:11.112583 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:52:11.112583 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:52:11.112583 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:52:11.112583 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:52:11.112583 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:52:11.112583 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:52:11.112583 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:52:11.112583 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:52:11.112583 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:52:11.112583 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:52:11.114298 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:52:11.114298 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:52:11.114298 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:52:11.114298 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:52:11.114298 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:52:11.114298 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:52:11.114298 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:52:11.114298 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:52:11.114298 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:52:11.114298 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:52:11.114298 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:52:11.114298 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:52:11.114298 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:52:11.114298 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:52:11.114298 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:52:11.114298 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:52:11.114298 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:52:11.116085 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:52:11.116085 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:52:11.116085 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:52:11.116085 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:52:11.116085 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 546/1083] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:52:11.130587 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355e58e-af33-4d67-adb9-1d80b3398463 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:11.204857 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:11.282873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355e58e-af33-4d67-adb9-1d80b3398463 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:11.327774 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56285c9-f60d-4a7f-b868-9e070f7fd9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:11.328729 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56285c9-f60d-4a7f-b868-9e070f7fd9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:11.329132 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56285c9-f60d-4a7f-b868-9e070f7fd9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:11.329441 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56285c9-f60d-4a7f-b868-9e070f7fd9c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:11.330553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56285c9-f60d-4a7f-b868-9e070f7fd9c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:11.330883 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56285c9-f60d-4a7f-b868-9e070f7fd9c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:11.332983 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56285c9-f60d-4a7f-b868-9e070f7fd9c1 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:11.351996 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 538/1084] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:12.347307 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2d2fd-0686-4bad-8e9f-7536e89f4717 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:12.347844 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2d2fd-0686-4bad-8e9f-7536e89f4717 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:12.347844 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2d2fd-0686-4bad-8e9f-7536e89f4717 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:12.349384 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 547/1085] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:52:12.355239 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b4068-f8a0-4fad-88ff-6f263f8c05af None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:12.355746 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b4068-f8a0-4fad-88ff-6f263f8c05af None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:12.355833 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b4068-f8a0-4fad-88ff-6f263f8c05af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:12.376272 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-cd8b4068-f8a0-4fad-88ff-6f263f8c05af None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:52:12.377374 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-cd8b4068-f8a0-4fad-88ff-6f263f8c05af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:52:12.454344 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 539/1086] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:52:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:52:12.496062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2d2fd-0686-4bad-8e9f-7536e89f4717 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:12.598631 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9966f-1517-4f72-914f-2a1ff974d7b2 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:12.599040 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9966f-1517-4f72-914f-2a1ff974d7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:12.599411 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9966f-1517-4f72-914f-2a1ff974d7b2 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:12.600896 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 540/1087] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:52:12.606703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ff9ae-f139-4ba8-9dcc-fa3225300d5b None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:12.606985 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ff9ae-f139-4ba8-9dcc-fa3225300d5b None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:12.607262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ff9ae-f139-4ba8-9dcc-fa3225300d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:12.627158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-d94ff9ae-f139-4ba8-9dcc-fa3225300d5b None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:52:12.628324 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-d94ff9ae-f139-4ba8-9dcc-fa3225300d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:52:12.635359 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2d2fd-0686-4bad-8e9f-7536e89f4717 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:12.665155 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:12.680316 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb37a2c-b14a-4d4d-9d15-0a3ad481f665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:12.681097 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb37a2c-b14a-4d4d-9d15-0a3ad481f665 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:12.681452 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb37a2c-b14a-4d4d-9d15-0a3ad481f665 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:12.681909 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb37a2c-b14a-4d4d-9d15-0a3ad481f665 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:12.699423 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb37a2c-b14a-4d4d-9d15-0a3ad481f665 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:52:12.704554 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-bfb37a2c-b14a-4d4d-9d15-0a3ad481f665 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:52:12.704554 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:52:12.704554 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:52:12.704554 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:52:12.704554 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:52:12.704554 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:52:12.704554 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:52:12.704554 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:52:12.704554 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:52:12.704554 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:52:12.704554 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:52:12.704554 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:52:12.704554 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:52:12.704554 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:52:12.704554 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:52:12.704554 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:52:12.706562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:52:12.706562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:52:12.706562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:52:12.706562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:52:12.706562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:52:12.706562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:52:12.706562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:52:12.706562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:52:12.706562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:52:12.706562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:52:12.706562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:52:12.706562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:52:12.706562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:52:12.706562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:52:12.706562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:52:12.706562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:52:12.708255 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:52:12.708255 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:52:12.708255 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:52:12.708255 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:52:12.708255 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:52:12.708255 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:52:12.708255 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:52:12.708255 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:52:12.708255 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:52:12.708255 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:52:12.708255 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:52:12.708255 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:52:12.708255 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 548/1088] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:52:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:52:12.712434 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb37a2c-b14a-4d4d-9d15-0a3ad481f665 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:12.723932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 541/1089] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:52:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:52:12.749063 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ff9ae-f139-4ba8-9dcc-fa3225300d5b None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:12.767737 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:12.834960 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb37a2c-b14a-4d4d-9d15-0a3ad481f665 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:12.860525 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ff9ae-f139-4ba8-9dcc-fa3225300d5b None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:12.874487 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2a006-d461-4ac8-80ae-7b5e5ddbb90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:12.875119 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2a006-d461-4ac8-80ae-7b5e5ddbb90c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:12.875399 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2a006-d461-4ac8-80ae-7b5e5ddbb90c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:12.875671 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2a006-d461-4ac8-80ae-7b5e5ddbb90c None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:12.876397 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2a006-d461-4ac8-80ae-7b5e5ddbb90c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:12.876712 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2a006-d461-4ac8-80ae-7b5e5ddbb90c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:12.878168 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2a006-d461-4ac8-80ae-7b5e5ddbb90c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:12.887517 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 549/1090] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:52:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:52:12.894473 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2a006-d461-4ac8-80ae-7b5e5ddbb90c None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:12.900967 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcb552-f0dc-4623-8760-54490b1e40a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:12.901631 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcb552-f0dc-4623-8760-54490b1e40a4 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:12.901910 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcb552-f0dc-4623-8760-54490b1e40a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:12.902184 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcb552-f0dc-4623-8760-54490b1e40a4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:12.913870 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fcb552-f0dc-4623-8760-54490b1e40a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:52:12.919824 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-16fcb552-f0dc-4623-8760-54490b1e40a4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 08:52:12.919824 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:52:12.919824 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:52:12.919824 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:52:12.919824 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:52:12.919824 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:52:12.919824 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:52:12.919824 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:52:12.919824 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:52:12.919824 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:52:12.919824 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:52:12.919824 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:52:12.919824 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:52:12.919824 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:52:12.919824 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:52:12.919824 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:52:12.921136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:52:12.921136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:52:12.921136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:52:12.921136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:52:12.921136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:52:12.921136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:52:12.921136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:52:12.921136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:52:12.921136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:52:12.921136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:52:12.921136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:52:12.921136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:52:12.921136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:52:12.921136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:52:12.921136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:52:12.921136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:52:12.922015 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:52:12.922015 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:52:12.922015 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:52:12.922015 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:52:12.922015 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:52:12.922015 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:52:12.922015 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:52:12.922015 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:52:12.922015 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:52:12.922015 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:52:12.922015 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 08:52:12.922015 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:52:12.922015 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 542/1091] 10.222.0.65 () {56 vars in 1120 bytes} [Wed Jul 27 08:52:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:52:12.930994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcb552-f0dc-4623-8760-54490b1e40a4 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:12.972967 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:13.004460 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:13.007612 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2a006-d461-4ac8-80ae-7b5e5ddbb90c None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:13.048766 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4b61c-d3fe-4b08-ab9e-3ee0ae2656e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:13.049811 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4b61c-d3fe-4b08-ab9e-3ee0ae2656e0 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:13.050332 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4b61c-d3fe-4b08-ab9e-3ee0ae2656e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:13.050854 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4b61c-d3fe-4b08-ab9e-3ee0ae2656e0 None admin] PATH_INFO: `/v3/users/93c7c15cfd784f91956314458893f31b` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:13.052967 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f4b61c-d3fe-4b08-ab9e-3ee0ae2656e0 None admin] RBAC: Authorizing `identity:get_user(user_id=93c7c15cfd784f91956314458893f31b)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:13.055791 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f4b61c-d3fe-4b08-ab9e-3ee0ae2656e0 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:13.064390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 550/1092] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:52:12 2022] GET /identity/v3/users/93c7c15cfd784f91956314458893f31b => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:52:13.064595 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcb552-f0dc-4623-8760-54490b1e40a4 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:13.065674 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4b61c-d3fe-4b08-ab9e-3ee0ae2656e0 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:13.102282 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b58c59-f872-4245-b88c-72970687df15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:13.103068 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b58c59-f872-4245-b88c-72970687df15 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:13.104003 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b58c59-f872-4245-b88c-72970687df15 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:13.104410 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b58c59-f872-4245-b88c-72970687df15 None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:13.105257 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b58c59-f872-4245-b88c-72970687df15 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:13.105683 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b58c59-f872-4245-b88c-72970687df15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:13.107493 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b58c59-f872-4245-b88c-72970687df15 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:13.117200 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 543/1093] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Jul 27 08:52:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:52:13.122932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b58c59-f872-4245-b88c-72970687df15 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:13.202530 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4b61c-d3fe-4b08-ab9e-3ee0ae2656e0 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:13.223885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:13.243129 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b58c59-f872-4245-b88c-72970687df15 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:13.254131 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375aa17-d9c7-4af2-9238-4b22e838dff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:13.255256 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375aa17-d9c7-4af2-9238-4b22e838dff3 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:13.255752 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375aa17-d9c7-4af2-9238-4b22e838dff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:13.256209 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375aa17-d9c7-4af2-9238-4b22e838dff3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:13.290802 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8627a-7ee6-4c7b-992f-713fc48db613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:13.291548 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8627a-7ee6-4c7b-992f-713fc48db613 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:13.291835 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8627a-7ee6-4c7b-992f-713fc48db613 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:13.292118 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8627a-7ee6-4c7b-992f-713fc48db613 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:13.300234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:13.304383 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8627a-7ee6-4c7b-992f-713fc48db613 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:13.307287 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8627a-7ee6-4c7b-992f-713fc48db613 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:13.323515 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-52d8627a-7ee6-4c7b-992f-713fc48db613 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:52:13.323515 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:52:13.323515 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:52:13.323515 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:52:13.323515 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:52:13.323515 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:52:13.323515 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:52:13.323515 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:52:13.323515 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:52:13.323515 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:52:13.323515 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:52:13.323515 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:52:13.323515 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:52:13.323515 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:52:13.323515 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:52:13.324678 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:52:13.324678 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:52:13.324678 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:52:13.324678 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:52:13.324678 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:52:13.324678 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:52:13.324678 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:52:13.324678 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:52:13.324678 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:52:13.324678 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:52:13.324678 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:52:13.324678 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:52:13.324678 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:52:13.324678 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:52:13.324678 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:52:13.324678 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:52:13.324678 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:52:13.325648 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:52:13.325648 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:52:13.325648 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:52:13.325648 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:52:13.325648 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 544/1094] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:52:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:52:13.330770 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8627a-7ee6-4c7b-992f-713fc48db613 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:13.339360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375aa17-d9c7-4af2-9238-4b22e838dff3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:13.340839 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375aa17-d9c7-4af2-9238-4b22e838dff3 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:13.440835 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8627a-7ee6-4c7b-992f-713fc48db613 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:13.445804 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 551/1095] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:52:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:52:13.452863 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375aa17-d9c7-4af2-9238-4b22e838dff3 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:13.482457 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098645d-fb44-44df-9fc0-be0f8589abfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:13.483101 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098645d-fb44-44df-9fc0-be0f8589abfc None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:13.483386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098645d-fb44-44df-9fc0-be0f8589abfc None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:13.483665 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098645d-fb44-44df-9fc0-be0f8589abfc None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:13.484787 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098645d-fb44-44df-9fc0-be0f8589abfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:13.484787 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098645d-fb44-44df-9fc0-be0f8589abfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:13.486111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098645d-fb44-44df-9fc0-be0f8589abfc None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:13.488826 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:13.501074 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 545/1096] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:52:13.507209 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098645d-fb44-44df-9fc0-be0f8589abfc None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:13.531011 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:13.573017 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375aa17-d9c7-4af2-9238-4b22e838dff3 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:13.611807 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5046d6-8683-45fb-9e94-713cdbac8103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:13.612457 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5046d6-8683-45fb-9e94-713cdbac8103 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:13.612735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5046d6-8683-45fb-9e94-713cdbac8103 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:13.613008 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5046d6-8683-45fb-9e94-713cdbac8103 None admin] PATH_INFO: `/v3/projects/7ad5e31e44b3463287d45ddd6726d661` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:13.614205 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5046d6-8683-45fb-9e94-713cdbac8103 None admin] RBAC: Authorizing `identity:get_project(project_id=7ad5e31e44b3463287d45ddd6726d661)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:13.615694 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5046d6-8683-45fb-9e94-713cdbac8103 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:13.617418 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 552/1097] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:52:13 2022] GET /identity/v3/projects/7ad5e31e44b3463287d45ddd6726d661 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:52:13.624041 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5046d6-8683-45fb-9e94-713cdbac8103 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:13.628411 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098645d-fb44-44df-9fc0-be0f8589abfc None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:13.666835 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6e98b-681f-4ff3-94ab-7d153f6b6aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:13.667494 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6e98b-681f-4ff3-94ab-7d153f6b6aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:13.667786 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6e98b-681f-4ff3-94ab-7d153f6b6aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:13.668033 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6e98b-681f-4ff3-94ab-7d153f6b6aa8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:13.676076 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6e98b-681f-4ff3-94ab-7d153f6b6aa8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:13.677544 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6e98b-681f-4ff3-94ab-7d153f6b6aa8 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:13.690148 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-e4f6e98b-681f-4ff3-94ab-7d153f6b6aa8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:52:13.690148 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:52:13.690148 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:52:13.690148 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:52:13.690148 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:52:13.690148 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:52:13.690148 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:52:13.690148 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:52:13.690148 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:52:13.690148 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:52:13.690148 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:52:13.690148 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:52:13.690148 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:52:13.690148 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:52:13.690148 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:52:13.690148 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:52:13.691326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:52:13.691326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:52:13.691326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:52:13.691326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:52:13.691326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:52:13.691326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:52:13.691326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:52:13.691326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:52:13.691326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:52:13.691326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:52:13.691326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:52:13.691326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:52:13.691326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:52:13.691326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:52:13.691326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:52:13.691326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:52:13.691326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:52:13.691326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:52:13.692726 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:52:13.692726 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:52:13.692726 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:52:13.692726 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:52:13.692726 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:52:13.692726 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:52:13.692726 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:52:13.692726 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:52:13.692726 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 08:52:13.692726 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:52:13.692726 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 546/1098] 10.222.0.65 () {56 vars in 1093 bytes} [Wed Jul 27 08:52:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:52:13.697982 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6e98b-681f-4ff3-94ab-7d153f6b6aa8 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:13.761880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5046d6-8683-45fb-9e94-713cdbac8103 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:13.763945 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:13.817163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f73c20-00b2-46dd-b07f-f05129c948c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:13.817807 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f73c20-00b2-46dd-b07f-f05129c948c4 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:13.818088 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f73c20-00b2-46dd-b07f-f05129c948c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:13.818394 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f73c20-00b2-46dd-b07f-f05129c948c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:13.819217 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f73c20-00b2-46dd-b07f-f05129c948c4 None admin] RBAC: Adding query filter params (role.id=20bc872844094480b9dca67a25b69e84, scope.project.id=7ad5e31e44b3463287d45ddd6726d661, user.id=93c7c15cfd784f91956314458893f31b) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:13.819531 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f73c20-00b2-46dd-b07f-f05129c948c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:13.821023 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f73c20-00b2-46dd-b07f-f05129c948c4 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:13.825106 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:13.831060 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 553/1099] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:52:13 2022] GET /identity/v3/role_assignments?user.id=93c7c15cfd784f91956314458893f31b&scope.project.id=7ad5e31e44b3463287d45ddd6726d661&role.id=20bc872844094480b9dca67a25b69e84 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:52:13.831318 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6e98b-681f-4ff3-94ab-7d153f6b6aa8 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:13.875979 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a30a72-63d6-484b-8e62-a3318741f4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:13.876604 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a30a72-63d6-484b-8e62-a3318741f4d2 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:13.876884 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a30a72-63d6-484b-8e62-a3318741f4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:13.877155 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a30a72-63d6-484b-8e62-a3318741f4d2 None admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:13.877985 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a30a72-63d6-484b-8e62-a3318741f4d2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:13.878298 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a30a72-63d6-484b-8e62-a3318741f4d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:13.879834 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a30a72-63d6-484b-8e62-a3318741f4d2 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:13.902446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 547/1100] 10.222.0.65 () {56 vars in 1133 bytes} [Wed Jul 27 08:52:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:13.908937 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f73c20-00b2-46dd-b07f-f05129c948c4 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:14.031173 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f73c20-00b2-46dd-b07f-f05129c948c4 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:14.070204 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47a3cf-3d8c-432e-84e0-c66b6cf606c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:14.070931 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47a3cf-3d8c-432e-84e0-c66b6cf606c4 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:14.071216 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47a3cf-3d8c-432e-84e0-c66b6cf606c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:14.071488 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47a3cf-3d8c-432e-84e0-c66b6cf606c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:14.146211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:14.149049 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47a3cf-3d8c-432e-84e0-c66b6cf606c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:14.150899 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47a3cf-3d8c-432e-84e0-c66b6cf606c4 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:14.262689 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 554/1101] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:52:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:52:14.269015 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a30a72-63d6-484b-8e62-a3318741f4d2 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:14.386431 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a30a72-63d6-484b-8e62-a3318741f4d2 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:14.402110 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:14.426143 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac08a4-c274-465b-8cb5-0ff62e53c756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:14.426831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac08a4-c274-465b-8cb5-0ff62e53c756 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:14.427113 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac08a4-c274-465b-8cb5-0ff62e53c756 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:14.427388 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac08a4-c274-465b-8cb5-0ff62e53c756 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:14.440255 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac08a4-c274-465b-8cb5-0ff62e53c756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:14.441722 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac08a4-c274-465b-8cb5-0ff62e53c756 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:14.458386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-73ac08a4-c274-465b-8cb5-0ff62e53c756 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:52:14.458386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:52:14.458386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:52:14.458386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:52:14.458386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:52:14.458386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:52:14.458386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:52:14.458386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:52:14.458386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:52:14.458386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:52:14.458386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:52:14.458386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:52:14.458386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:52:14.458386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:52:14.458386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:52:14.460082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:52:14.460082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:52:14.460082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:52:14.460082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:52:14.460082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:52:14.460082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:52:14.460082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:52:14.460082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:52:14.460082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:52:14.460082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:52:14.460082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:52:14.460082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:52:14.460082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:52:14.460082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:52:14.460082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:52:14.460082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:52:14.460082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:52:14.461047 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:52:14.461047 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:52:14.461047 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:52:14.461047 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:52:14.461047 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 548/1102] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:52:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:52:14.466165 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47a3cf-3d8c-432e-84e0-c66b6cf606c4 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:14.594901 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:14.600028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47a3cf-3d8c-432e-84e0-c66b6cf606c4 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:14.661231 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28950873-9f95-4feb-9f28-b9bf918f721b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:14.662149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28950873-9f95-4feb-9f28-b9bf918f721b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:14.662665 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28950873-9f95-4feb-9f28-b9bf918f721b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:14.663138 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28950873-9f95-4feb-9f28-b9bf918f721b None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:14.664396 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28950873-9f95-4feb-9f28-b9bf918f721b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:14.664934 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28950873-9f95-4feb-9f28-b9bf918f721b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:14.667598 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28950873-9f95-4feb-9f28-b9bf918f721b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:14.694341 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 555/1103] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:14.695675 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac08a4-c274-465b-8cb5-0ff62e53c756 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:14.804156 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac08a4-c274-465b-8cb5-0ff62e53c756 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:14.842107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885ab71-4d30-4b4d-adfc-1401e0b285d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:14.842789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885ab71-4d30-4b4d-adfc-1401e0b285d1 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:14.843070 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885ab71-4d30-4b4d-adfc-1401e0b285d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:14.843343 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885ab71-4d30-4b4d-adfc-1401e0b285d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:14.850797 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885ab71-4d30-4b4d-adfc-1401e0b285d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:14.852213 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885ab71-4d30-4b4d-adfc-1401e0b285d1 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:14.864641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-8885ab71-4d30-4b4d-adfc-1401e0b285d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:52:14.864641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:52:14.864641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:52:14.864641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:52:14.864641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:52:14.864641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:52:14.864641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:52:14.864641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:52:14.864641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:52:14.864641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:52:14.864641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:52:14.864641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:52:14.864641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:52:14.864641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:52:14.864641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:52:14.866586 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:52:14.866586 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:52:14.866586 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:52:14.866586 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:52:14.866586 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:52:14.866586 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:52:14.866586 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:52:14.866586 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:52:14.866586 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:52:14.866586 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:52:14.866586 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:52:14.866586 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:52:14.866586 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:52:14.866586 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:52:14.866586 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:52:14.866586 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:52:14.866586 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:52:14.868859 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:52:14.868859 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:52:14.868859 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:52:14.868859 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:52:14.868859 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:52:14.868859 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:52:14.868859 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:52:14.868859 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:52:14.868859 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 549/1104] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:52:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:52:14.873505 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28950873-9f95-4feb-9f28-b9bf918f721b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:14.993874 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28950873-9f95-4feb-9f28-b9bf918f721b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:15.035449 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b0a51-ae9e-4dbb-8bd9-cb962597d6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:15.036082 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b0a51-ae9e-4dbb-8bd9-cb962597d6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:15.036356 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b0a51-ae9e-4dbb-8bd9-cb962597d6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:15.036627 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b0a51-ae9e-4dbb-8bd9-cb962597d6a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:15.037388 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b0a51-ae9e-4dbb-8bd9-cb962597d6a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:15.037691 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b0a51-ae9e-4dbb-8bd9-cb962597d6a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:15.039147 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b0a51-ae9e-4dbb-8bd9-cb962597d6a3 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:15.053465 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 556/1105] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:52:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:15.060866 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885ab71-4d30-4b4d-adfc-1401e0b285d1 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:15.095772 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:15.186592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885ab71-4d30-4b4d-adfc-1401e0b285d1 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:15.226643 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab84fcb-920a-4415-ae9b-ac1189591924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:15.227353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab84fcb-920a-4415-ae9b-ac1189591924 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:15.227705 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab84fcb-920a-4415-ae9b-ac1189591924 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:15.228038 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab84fcb-920a-4415-ae9b-ac1189591924 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:15.229463 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab84fcb-920a-4415-ae9b-ac1189591924 None admin] RBAC: Adding query filter params (role.id=1e9124c6b23746fe97007d59fe6af878, scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267, user.id=c30bc55c6a1348bb961f0d010422da87) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:15.229830 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab84fcb-920a-4415-ae9b-ac1189591924 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:15.231412 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab84fcb-920a-4415-ae9b-ac1189591924 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:15.238267 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 550/1106] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:52:15 2022] GET /identity/v3/role_assignments?user.id=c30bc55c6a1348bb961f0d010422da87&scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267&role.id=1e9124c6b23746fe97007d59fe6af878 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:52:15.967038 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956d692-acbf-4b52-bb99-93b37543795d None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:15.967591 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956d692-acbf-4b52-bb99-93b37543795d None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:15.967934 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956d692-acbf-4b52-bb99-93b37543795d None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:15.970270 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 557/1107] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:52:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:52:15.977017 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba59fc1-1d9b-4d1b-88d4-6db04c522dc6 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:15.977495 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba59fc1-1d9b-4d1b-88d4-6db04c522dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:15.977905 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba59fc1-1d9b-4d1b-88d4-6db04c522dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:15.997996 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-6ba59fc1-1d9b-4d1b-88d4-6db04c522dc6 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:52:15.999269 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-6ba59fc1-1d9b-4d1b-88d4-6db04c522dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:52:16.082959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 551/1108] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:52:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:52:16.108966 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956d692-acbf-4b52-bb99-93b37543795d None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:16.148714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:16.249645 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956d692-acbf-4b52-bb99-93b37543795d None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:16.287722 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083136db-97c5-42fe-8b37-68391c0fae2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:16.288384 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083136db-97c5-42fe-8b37-68391c0fae2a None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:16.288664 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083136db-97c5-42fe-8b37-68391c0fae2a None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:16.288934 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083136db-97c5-42fe-8b37-68391c0fae2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:16.290150 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083136db-97c5-42fe-8b37-68391c0fae2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:16.292136 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083136db-97c5-42fe-8b37-68391c0fae2a None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:16.293833 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 558/1109] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:52:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:16.299891 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba59fc1-1d9b-4d1b-88d4-6db04c522dc6 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:16.322955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:16.403092 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba59fc1-1d9b-4d1b-88d4-6db04c522dc6 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:16.438075 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c21987-5657-40a5-bdc0-f66ae39d7877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:16.438718 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c21987-5657-40a5-bdc0-f66ae39d7877 None admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:16.438998 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c21987-5657-40a5-bdc0-f66ae39d7877 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:16.439271 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c21987-5657-40a5-bdc0-f66ae39d7877 None admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:16.439949 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c21987-5657-40a5-bdc0-f66ae39d7877 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:16.441393 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c21987-5657-40a5-bdc0-f66ae39d7877 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:16.463322 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 552/1110] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 08:52:16 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:52:18.569861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7367a-e438-4982-8912-7e5a292287b8 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:18.570472 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7367a-e438-4982-8912-7e5a292287b8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:18.570472 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7367a-e438-4982-8912-7e5a292287b8 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:18.571947 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 559/1111] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:52:18.578091 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596fef4-8473-4263-a244-7ec12cd597f7 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:18.578614 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596fef4-8473-4263-a244-7ec12cd597f7 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:18.578707 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596fef4-8473-4263-a244-7ec12cd597f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:18.597622 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-2596fef4-8473-4263-a244-7ec12cd597f7 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:52:18.598871 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-2596fef4-8473-4263-a244-7ec12cd597f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:52:18.674778 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 553/1112] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:52:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:52:18.704724 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7367a-e438-4982-8912-7e5a292287b8 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:18.799615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:18.814076 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7367a-e438-4982-8912-7e5a292287b8 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:18.850865 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7098f5d-18c1-42a2-9a9f-d9849410995e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:18.851415 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7098f5d-18c1-42a2-9a9f-d9849410995e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:18.851693 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7098f5d-18c1-42a2-9a9f-d9849410995e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:18.851962 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7098f5d-18c1-42a2-9a9f-d9849410995e None admin] PATH_INFO: `/v3/roles/07fbbf1ea87a40f791466f0c934b4183` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:18.853935 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7098f5d-18c1-42a2-9a9f-d9849410995e None admin] RBAC: Authorizing `identity:get_role(role_id=07fbbf1ea87a40f791466f0c934b4183)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:18.855827 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7098f5d-18c1-42a2-9a9f-d9849410995e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:18.857226 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 560/1113] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:52:18 2022] GET /identity/v3/roles/07fbbf1ea87a40f791466f0c934b4183 => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:18.864184 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596fef4-8473-4263-a244-7ec12cd597f7 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:18.874884 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:18.975943 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596fef4-8473-4263-a244-7ec12cd597f7 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:19.016489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a893af-cfac-4ed4-b091-e097c01c0ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:19.017156 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a893af-cfac-4ed4-b091-e097c01c0ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:19.017438 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a893af-cfac-4ed4-b091-e097c01c0ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:19.017713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a893af-cfac-4ed4-b091-e097c01c0ca0 None admin] PATH_INFO: `/v3/users/781f8b43ce3b4d558d62d5c5ee82eca3` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:19.035204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a893af-cfac-4ed4-b091-e097c01c0ca0 None admin] RBAC: Authorizing `identity:get_user(user_id=781f8b43ce3b4d558d62d5c5ee82eca3)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:19.036696 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a893af-cfac-4ed4-b091-e097c01c0ca0 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:19.038516 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 554/1114] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:52:18 2022] GET /identity/v3/users/781f8b43ce3b4d558d62d5c5ee82eca3 => generated 286 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:19.044859 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7098f5d-18c1-42a2-9a9f-d9849410995e None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:19.162988 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7098f5d-18c1-42a2-9a9f-d9849410995e None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:19.200069 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980826a2-812d-4caa-b72e-c9b56310abcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:19.200698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980826a2-812d-4caa-b72e-c9b56310abcd None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:19.200980 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980826a2-812d-4caa-b72e-c9b56310abcd None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:19.201283 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980826a2-812d-4caa-b72e-c9b56310abcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:19.233631 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:19.280601 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980826a2-812d-4caa-b72e-c9b56310abcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:19.282061 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980826a2-812d-4caa-b72e-c9b56310abcd None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:19.386709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 561/1115] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:52:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:52:19.392955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a893af-cfac-4ed4-b091-e097c01c0ca0 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:19.458902 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:19.499657 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a893af-cfac-4ed4-b091-e097c01c0ca0 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:19.534743 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cb7d3-c3c3-4720-8bbf-ad105748d361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:19.535383 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cb7d3-c3c3-4720-8bbf-ad105748d361 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:19.535665 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cb7d3-c3c3-4720-8bbf-ad105748d361 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:19.535939 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cb7d3-c3c3-4720-8bbf-ad105748d361 None admin] PATH_INFO: `/v3/projects/7ad5e31e44b3463287d45ddd6726d661` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:19.537109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1cb7d3-c3c3-4720-8bbf-ad105748d361 None admin] RBAC: Authorizing `identity:get_project(project_id=7ad5e31e44b3463287d45ddd6726d661)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:19.538579 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1cb7d3-c3c3-4720-8bbf-ad105748d361 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:19.540285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 555/1116] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:52:19 2022] GET /identity/v3/projects/7ad5e31e44b3463287d45ddd6726d661 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:19.547069 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980826a2-812d-4caa-b72e-c9b56310abcd None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:19.605207 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:19.650199 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980826a2-812d-4caa-b72e-c9b56310abcd None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:19.687793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df617b-4511-4a47-86f6-aaf5040c610b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:19.688431 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df617b-4511-4a47-86f6-aaf5040c610b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:19.688713 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df617b-4511-4a47-86f6-aaf5040c610b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:19.688989 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df617b-4511-4a47-86f6-aaf5040c610b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:19.689792 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df617b-4511-4a47-86f6-aaf5040c610b None admin] RBAC: Adding query filter params (role.id=07fbbf1ea87a40f791466f0c934b4183, scope.project.id=7ad5e31e44b3463287d45ddd6726d661, user.id=781f8b43ce3b4d558d62d5c5ee82eca3) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:19.690108 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df617b-4511-4a47-86f6-aaf5040c610b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:19.691601 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df617b-4511-4a47-86f6-aaf5040c610b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:19.697956 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 562/1117] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:52:19 2022] GET /identity/v3/role_assignments?user.id=781f8b43ce3b4d558d62d5c5ee82eca3&scope.project.id=7ad5e31e44b3463287d45ddd6726d661&role.id=07fbbf1ea87a40f791466f0c934b4183 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:21.746673 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7701553-2f59-4a2d-ade3-baa3024c48d6 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:21.747218 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7701553-2f59-4a2d-ade3-baa3024c48d6 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:21.747218 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7701553-2f59-4a2d-ade3-baa3024c48d6 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:21.748584 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 556/1118] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:52:21.754355 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0ddb7-774d-48c3-b5c4-fd0ec121bfee None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:21.754866 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0ddb7-774d-48c3-b5c4-fd0ec121bfee None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:21.755034 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0ddb7-774d-48c3-b5c4-fd0ec121bfee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:21.774902 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-97c0ddb7-774d-48c3-b5c4-fd0ec121bfee None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:52:21.776359 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-97c0ddb7-774d-48c3-b5c4-fd0ec121bfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:52:21.847900 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 563/1119] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:52:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:52:21.874344 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7701553-2f59-4a2d-ade3-baa3024c48d6 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:21.982475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7701553-2f59-4a2d-ade3-baa3024c48d6 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:22.020143 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:22.027493 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74c9ce-c29e-4d97-9ad2-bb423e440d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:22.028147 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74c9ce-c29e-4d97-9ad2-bb423e440d8b None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:22.028432 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74c9ce-c29e-4d97-9ad2-bb423e440d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:22.028714 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74c9ce-c29e-4d97-9ad2-bb423e440d8b None admin] PATH_INFO: `/v3/roles/07fbbf1ea87a40f791466f0c934b4183` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:22.030211 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74c9ce-c29e-4d97-9ad2-bb423e440d8b None admin] RBAC: Authorizing `identity:get_role(role_id=07fbbf1ea87a40f791466f0c934b4183)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:22.031635 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74c9ce-c29e-4d97-9ad2-bb423e440d8b None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:22.033545 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 557/1120] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:52:21 2022] GET /identity/v3/roles/07fbbf1ea87a40f791466f0c934b4183 => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:22.042120 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0ddb7-774d-48c3-b5c4-fd0ec121bfee None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:22.094694 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:22.160601 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0ddb7-774d-48c3-b5c4-fd0ec121bfee None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:22.196477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f02705-5179-4083-b1fb-33fec38696a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:22.197127 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f02705-5179-4083-b1fb-33fec38696a6 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:22.197956 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f02705-5179-4083-b1fb-33fec38696a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:22.198239 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f02705-5179-4083-b1fb-33fec38696a6 None admin] PATH_INFO: `/v3/users/781f8b43ce3b4d558d62d5c5ee82eca3` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:22.199495 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f02705-5179-4083-b1fb-33fec38696a6 None admin] RBAC: Authorizing `identity:get_user(user_id=781f8b43ce3b4d558d62d5c5ee82eca3)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:22.200954 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f02705-5179-4083-b1fb-33fec38696a6 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:22.202676 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 564/1121] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:52:22 2022] GET /identity/v3/users/781f8b43ce3b4d558d62d5c5ee82eca3 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:22.208809 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74c9ce-c29e-4d97-9ad2-bb423e440d8b None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:22.317853 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74c9ce-c29e-4d97-9ad2-bb423e440d8b None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:22.354048 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c263f-a2d0-42ae-b184-6be99305117d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:22.354814 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c263f-a2d0-42ae-b184-6be99305117d None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:22.355091 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c263f-a2d0-42ae-b184-6be99305117d None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:22.355366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c263f-a2d0-42ae-b184-6be99305117d None admin] PATH_INFO: `/v3/projects/7ad5e31e44b3463287d45ddd6726d661` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:22.356568 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c263f-a2d0-42ae-b184-6be99305117d None admin] RBAC: Authorizing `identity:get_project(project_id=7ad5e31e44b3463287d45ddd6726d661)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:22.358042 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c263f-a2d0-42ae-b184-6be99305117d None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:22.359874 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 558/1122] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:52:22 2022] GET /identity/v3/projects/7ad5e31e44b3463287d45ddd6726d661 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:22.366374 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f02705-5179-4083-b1fb-33fec38696a6 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:22.498853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f02705-5179-4083-b1fb-33fec38696a6 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:22.521545 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:22.544003 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af23d3-7cc1-4541-acb7-75877c1d13f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:22.544685 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af23d3-7cc1-4541-acb7-75877c1d13f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:22.544967 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af23d3-7cc1-4541-acb7-75877c1d13f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:22.545246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af23d3-7cc1-4541-acb7-75877c1d13f8 None admin] PATH_INFO: `/v3/projects/7ad5e31e44b3463287d45ddd6726d661/users/781f8b43ce3b4d558d62d5c5ee82eca3/roles/07fbbf1ea87a40f791466f0c934b4183` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:22.547470 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af23d3-7cc1-4541-acb7-75877c1d13f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ad5e31e44b3463287d45ddd6726d661, user_id=781f8b43ce3b4d558d62d5c5ee82eca3, role_id=07fbbf1ea87a40f791466f0c934b4183)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:22.548918 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af23d3-7cc1-4541-acb7-75877c1d13f8 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:22.563541 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 565/1123] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 08:52:22 2022] PUT /identity/v3/projects/7ad5e31e44b3463287d45ddd6726d661/users/781f8b43ce3b4d558d62d5c5ee82eca3/roles/07fbbf1ea87a40f791466f0c934b4183 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:52:24.614755 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f7dd2-af27-404e-8d56-02e1eebc9c19 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:24.615314 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f7dd2-af27-404e-8d56-02e1eebc9c19 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:24.615314 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f7dd2-af27-404e-8d56-02e1eebc9c19 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:24.616756 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 559/1124] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:52:24.622725 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb32859-fe86-48b6-8ce9-22ec196e2067 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:24.623132 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb32859-fe86-48b6-8ce9-22ec196e2067 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:24.623285 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb32859-fe86-48b6-8ce9-22ec196e2067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:24.641244 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-7fb32859-fe86-48b6-8ce9-22ec196e2067 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:52:24.642487 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-7fb32859-fe86-48b6-8ce9-22ec196e2067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:52:24.710206 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 566/1125] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:52:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:52:24.734030 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f7dd2-af27-404e-8d56-02e1eebc9c19 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:24.802423 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:24.837309 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f7dd2-af27-404e-8d56-02e1eebc9c19 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:24.871625 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef71d5b-c34d-40f5-b2c8-522787291bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:24.872184 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef71d5b-c34d-40f5-b2c8-522787291bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:24.872469 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef71d5b-c34d-40f5-b2c8-522787291bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:24.872746 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef71d5b-c34d-40f5-b2c8-522787291bf8 None admin] PATH_INFO: `/v3/roles/07fbbf1ea87a40f791466f0c934b4183` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:24.874200 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef71d5b-c34d-40f5-b2c8-522787291bf8 None admin] RBAC: Authorizing `identity:get_role(role_id=07fbbf1ea87a40f791466f0c934b4183)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:24.875627 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef71d5b-c34d-40f5-b2c8-522787291bf8 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:24.877010 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 560/1126] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:52:24 2022] GET /identity/v3/roles/07fbbf1ea87a40f791466f0c934b4183 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:24.883018 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb32859-fe86-48b6-8ce9-22ec196e2067 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:24.985716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb32859-fe86-48b6-8ce9-22ec196e2067 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:24.995806 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:25.023743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95167c-3c85-4300-90a9-7b2979ff758b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:25.024394 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95167c-3c85-4300-90a9-7b2979ff758b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:25.024678 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95167c-3c85-4300-90a9-7b2979ff758b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:25.024957 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95167c-3c85-4300-90a9-7b2979ff758b None admin] PATH_INFO: `/v3/users/781f8b43ce3b4d558d62d5c5ee82eca3` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:25.026711 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95167c-3c85-4300-90a9-7b2979ff758b None admin] RBAC: Authorizing `identity:get_user(user_id=781f8b43ce3b4d558d62d5c5ee82eca3)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:25.028162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95167c-3c85-4300-90a9-7b2979ff758b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:25.029780 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 567/1127] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:52:24 2022] GET /identity/v3/users/781f8b43ce3b4d558d62d5c5ee82eca3 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:25.035871 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef71d5b-c34d-40f5-b2c8-522787291bf8 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:25.140744 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef71d5b-c34d-40f5-b2c8-522787291bf8 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:25.177530 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e71c8-2c1f-4bc2-9ee8-79abc382bbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:25.178218 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e71c8-2c1f-4bc2-9ee8-79abc382bbb3 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:25.178691 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e71c8-2c1f-4bc2-9ee8-79abc382bbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:25.179040 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e71c8-2c1f-4bc2-9ee8-79abc382bbb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:25.183794 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:25.253164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e71c8-2c1f-4bc2-9ee8-79abc382bbb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:25.254664 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e71c8-2c1f-4bc2-9ee8-79abc382bbb3 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:25.365653 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 561/1128] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:52:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 08:52:25.372469 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95167c-3c85-4300-90a9-7b2979ff758b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:25.477877 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95167c-3c85-4300-90a9-7b2979ff758b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:25.513795 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a225d-7db8-4744-afa1-4b34c2cb985e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:25.514472 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a225d-7db8-4744-afa1-4b34c2cb985e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:25.514755 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a225d-7db8-4744-afa1-4b34c2cb985e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:25.515033 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a225d-7db8-4744-afa1-4b34c2cb985e None admin] PATH_INFO: `/v3/projects/7ad5e31e44b3463287d45ddd6726d661` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:25.516214 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a225d-7db8-4744-afa1-4b34c2cb985e None admin] RBAC: Authorizing `identity:get_project(project_id=7ad5e31e44b3463287d45ddd6726d661)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:25.517669 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a225d-7db8-4744-afa1-4b34c2cb985e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:25.519419 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 568/1129] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:52:25 2022] GET /identity/v3/projects/7ad5e31e44b3463287d45ddd6726d661 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:25.525926 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e71c8-2c1f-4bc2-9ee8-79abc382bbb3 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:25.562421 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:25.630371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e71c8-2c1f-4bc2-9ee8-79abc382bbb3 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:25.665747 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5133a-fb9f-4354-8e81-f820ff233b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:25.666919 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5133a-fb9f-4354-8e81-f820ff233b63 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:25.667196 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5133a-fb9f-4354-8e81-f820ff233b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:25.667464 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5133a-fb9f-4354-8e81-f820ff233b63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:25.668265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5133a-fb9f-4354-8e81-f820ff233b63 None admin] RBAC: Adding query filter params (role.id=07fbbf1ea87a40f791466f0c934b4183, scope.project.id=7ad5e31e44b3463287d45ddd6726d661, user.id=781f8b43ce3b4d558d62d5c5ee82eca3) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:25.668572 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5133a-fb9f-4354-8e81-f820ff233b63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:25.670011 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5133a-fb9f-4354-8e81-f820ff233b63 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:25.676707 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 562/1130] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:52:25 2022] GET /identity/v3/role_assignments?user.id=781f8b43ce3b4d558d62d5c5ee82eca3&scope.project.id=7ad5e31e44b3463287d45ddd6726d661&role.id=07fbbf1ea87a40f791466f0c934b4183 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:27.719528 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb82ac-4485-4e7c-9cbf-4bbf6b0f1ab2 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:27.720095 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb82ac-4485-4e7c-9cbf-4bbf6b0f1ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:27.720095 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb82ac-4485-4e7c-9cbf-4bbf6b0f1ab2 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:27.721468 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 569/1131] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:52:27.727613 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc91f2-ae96-481d-83cb-79ace44badfa None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:27.728136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc91f2-ae96-481d-83cb-79ace44badfa None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:27.731020 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc91f2-ae96-481d-83cb-79ace44badfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:27.749581 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-cdcc91f2-ae96-481d-83cb-79ace44badfa None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:52:27.750806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-cdcc91f2-ae96-481d-83cb-79ace44badfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:52:27.820075 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 563/1132] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:52:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:52:27.844272 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb82ac-4485-4e7c-9cbf-4bbf6b0f1ab2 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:27.899893 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:27.974659 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb82ac-4485-4e7c-9cbf-4bbf6b0f1ab2 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:28.029406 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33842a74-11cf-46a6-9add-f60dcdc6027c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:28.030052 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33842a74-11cf-46a6-9add-f60dcdc6027c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:28.030346 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33842a74-11cf-46a6-9add-f60dcdc6027c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:28.030625 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33842a74-11cf-46a6-9add-f60dcdc6027c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:28.031790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33842a74-11cf-46a6-9add-f60dcdc6027c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:28.033500 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33842a74-11cf-46a6-9add-f60dcdc6027c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:28.035511 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 570/1133] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:52:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:28.043565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc91f2-ae96-481d-83cb-79ace44badfa None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:28.076674 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:28.163498 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc91f2-ae96-481d-83cb-79ace44badfa None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:28.204435 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185533e1-2246-4ff0-9372-1eff13042084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:28.205050 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185533e1-2246-4ff0-9372-1eff13042084 None admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:28.205329 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185533e1-2246-4ff0-9372-1eff13042084 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:28.205596 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185533e1-2246-4ff0-9372-1eff13042084 None admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:28.206283 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185533e1-2246-4ff0-9372-1eff13042084 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:28.207760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185533e1-2246-4ff0-9372-1eff13042084 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:28.240717 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 564/1134] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 08:52:28 2022] POST /identity/v3/projects => generated 311 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:52:30.334562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4afdf-9244-4306-8347-26c39c360809 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:30.335104 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4afdf-9244-4306-8347-26c39c360809 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:30.335104 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4afdf-9244-4306-8347-26c39c360809 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:30.336470 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 571/1135] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:52:30.341855 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847c43b-d8d1-4076-a812-178cb5fe47bf None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:30.342240 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847c43b-d8d1-4076-a812-178cb5fe47bf None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:30.342434 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847c43b-d8d1-4076-a812-178cb5fe47bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:30.360349 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-4847c43b-d8d1-4076-a812-178cb5fe47bf None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:52:30.361520 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-4847c43b-d8d1-4076-a812-178cb5fe47bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:52:30.426703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 565/1136] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:52:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:52:30.450905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4afdf-9244-4306-8347-26c39c360809 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:30.552192 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4afdf-9244-4306-8347-26c39c360809 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:30.565046 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:30.585299 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481be87-3f30-431c-9e03-2ade47bd910e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:30.585931 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481be87-3f30-431c-9e03-2ade47bd910e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:30.586205 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481be87-3f30-431c-9e03-2ade47bd910e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:30.586504 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481be87-3f30-431c-9e03-2ade47bd910e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:30.587633 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481be87-3f30-431c-9e03-2ade47bd910e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:30.589598 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481be87-3f30-431c-9e03-2ade47bd910e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:30.591363 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 572/1137] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:52:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:30.597257 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847c43b-d8d1-4076-a812-178cb5fe47bf None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:30.611870 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:30.696151 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847c43b-d8d1-4076-a812-178cb5fe47bf None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:30.729403 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b7f4b-1e0e-479e-a8ee-2e355f82eca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:30.730009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b7f4b-1e0e-479e-a8ee-2e355f82eca9 None admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:30.730285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b7f4b-1e0e-479e-a8ee-2e355f82eca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:30.730594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b7f4b-1e0e-479e-a8ee-2e355f82eca9 None admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:30.731266 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b7f4b-1e0e-479e-a8ee-2e355f82eca9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:30.732699 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b7f4b-1e0e-479e-a8ee-2e355f82eca9 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:30.753140 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 566/1138] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 08:52:30 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:52:32.808615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d8389-e331-4d08-ab86-35352e7f1a7b None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:32.809184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d8389-e331-4d08-ab86-35352e7f1a7b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:32.809184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d8389-e331-4d08-ab86-35352e7f1a7b None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:32.810536 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 573/1139] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:52:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:52:32.815655 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890d38d-65cd-4d21-923a-f09591db1a7e None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:32.816079 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890d38d-65cd-4d21-923a-f09591db1a7e None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:32.816204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890d38d-65cd-4d21-923a-f09591db1a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:32.834676 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-3890d38d-65cd-4d21-923a-f09591db1a7e None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:52:32.835852 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-3890d38d-65cd-4d21-923a-f09591db1a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:52:32.904571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:32.911140 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 567/1140] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:52:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:52:32.934911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d8389-e331-4d08-ab86-35352e7f1a7b None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:33.036707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d8389-e331-4d08-ab86-35352e7f1a7b None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:33.070190 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c950169-7f22-4068-b085-f3fc054307c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:33.070776 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c950169-7f22-4068-b085-f3fc054307c3 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:33.071055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c950169-7f22-4068-b085-f3fc054307c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:33.071410 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c950169-7f22-4068-b085-f3fc054307c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:33.081812 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c950169-7f22-4068-b085-f3fc054307c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:52:33.086693 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-1c950169-7f22-4068-b085-f3fc054307c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:52:33.086693 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:52:33.086693 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:52:33.086693 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:52:33.086693 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:52:33.086693 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:52:33.086693 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:52:33.086693 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:52:33.086693 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:52:33.086693 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:52:33.086693 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:52:33.086693 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:52:33.086693 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:52:33.086693 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:52:33.086693 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:52:33.086693 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:52:33.087815 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:52:33.087815 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:52:33.087815 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:52:33.087815 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:52:33.087815 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:52:33.087815 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:52:33.087815 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:52:33.087815 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:52:33.087815 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:52:33.087815 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:52:33.087815 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:52:33.087815 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:52:33.087815 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:52:33.087815 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:52:33.087815 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:52:33.087815 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:52:33.088721 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:52:33.088721 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:52:33.088721 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:52:33.088721 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:52:33.088721 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:52:33.088721 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:52:33.088721 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:52:33.088721 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:52:33.088721 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:52:33.088721 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:52:33.088721 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:52:33.088721 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:52:33.088721 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 574/1141] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:52:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:52:33.093993 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890d38d-65cd-4d21-923a-f09591db1a7e None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:33.193899 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890d38d-65cd-4d21-923a-f09591db1a7e None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:33.226706 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0344819-d134-4c3f-b0b7-e17f8c74670f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:33.227315 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0344819-d134-4c3f-b0b7-e17f8c74670f None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:33.227598 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0344819-d134-4c3f-b0b7-e17f8c74670f None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:33.227872 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0344819-d134-4c3f-b0b7-e17f8c74670f None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:33.228587 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0344819-d134-4c3f-b0b7-e17f8c74670f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:33.229412 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0344819-d134-4c3f-b0b7-e17f8c74670f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:33.230807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0344819-d134-4c3f-b0b7-e17f8c74670f None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:33.238718 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 568/1142] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:52:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:52:33.245088 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c950169-7f22-4068-b085-f3fc054307c3 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:33.287484 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:33.345172 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c950169-7f22-4068-b085-f3fc054307c3 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:33.379007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2362784-9239-4ea3-8c99-897186953ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:33.379650 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2362784-9239-4ea3-8c99-897186953ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:33.379929 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2362784-9239-4ea3-8c99-897186953ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:33.380204 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2362784-9239-4ea3-8c99-897186953ee9 None admin] PATH_INFO: `/v3/users/8edccff36f1b4816851bf28be407536f` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:33.393895 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2362784-9239-4ea3-8c99-897186953ee9 None admin] RBAC: Authorizing `identity:get_user(user_id=8edccff36f1b4816851bf28be407536f)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:33.395366 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2362784-9239-4ea3-8c99-897186953ee9 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:33.397036 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 575/1143] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:52:33 2022] GET /identity/v3/users/8edccff36f1b4816851bf28be407536f => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:33.403612 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0344819-d134-4c3f-b0b7-e17f8c74670f None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:33.464084 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:33.505092 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0344819-d134-4c3f-b0b7-e17f8c74670f None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:33.538560 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819814b4-0d42-4feb-9f5b-042de400faa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:33.539169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819814b4-0d42-4feb-9f5b-042de400faa3 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:33.539450 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819814b4-0d42-4feb-9f5b-042de400faa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:33.539733 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819814b4-0d42-4feb-9f5b-042de400faa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:33.606502 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819814b4-0d42-4feb-9f5b-042de400faa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:33.607874 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819814b4-0d42-4feb-9f5b-042de400faa3 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:33.664531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:33.705786 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 569/1144] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:52:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:52:33.711721 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2362784-9239-4ea3-8c99-897186953ee9 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:33.806632 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:33.810661 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2362784-9239-4ea3-8c99-897186953ee9 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:33.844869 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89529f89-7c75-4a1b-b83c-0097a63fa884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:33.845512 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89529f89-7c75-4a1b-b83c-0097a63fa884 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:33.845803 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89529f89-7c75-4a1b-b83c-0097a63fa884 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:33.846106 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89529f89-7c75-4a1b-b83c-0097a63fa884 None admin] PATH_INFO: `/v3/projects/ac1258b7baca48c6bcdedb46640417b0` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:33.847256 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89529f89-7c75-4a1b-b83c-0097a63fa884 None admin] RBAC: Authorizing `identity:get_project(project_id=ac1258b7baca48c6bcdedb46640417b0)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:33.848690 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89529f89-7c75-4a1b-b83c-0097a63fa884 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:33.850387 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 576/1145] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:52:33 2022] GET /identity/v3/projects/ac1258b7baca48c6bcdedb46640417b0 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:33.857214 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819814b4-0d42-4feb-9f5b-042de400faa3 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:33.957501 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819814b4-0d42-4feb-9f5b-042de400faa3 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:33.991643 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d257cd-395e-4ff8-a433-2cc6f3626c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:33.992260 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d257cd-395e-4ff8-a433-2cc6f3626c72 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:33.992541 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d257cd-395e-4ff8-a433-2cc6f3626c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:33.992815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d257cd-395e-4ff8-a433-2cc6f3626c72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:33.993603 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d257cd-395e-4ff8-a433-2cc6f3626c72 None admin] RBAC: Adding query filter params (role.id=20bc872844094480b9dca67a25b69e84, scope.project.id=ac1258b7baca48c6bcdedb46640417b0, user.id=8edccff36f1b4816851bf28be407536f) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:33.993910 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d257cd-395e-4ff8-a433-2cc6f3626c72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:33.995989 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d257cd-395e-4ff8-a433-2cc6f3626c72 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:34.001514 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 570/1146] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:52:33 2022] GET /identity/v3/role_assignments?user.id=8edccff36f1b4816851bf28be407536f&scope.project.id=ac1258b7baca48c6bcdedb46640417b0&role.id=20bc872844094480b9dca67a25b69e84 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:35.998374 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4f64a-a300-4e87-b365-6986a4640d4d None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:35.998954 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4f64a-a300-4e87-b365-6986a4640d4d None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:35.998954 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4f64a-a300-4e87-b365-6986a4640d4d None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:36.000269 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 577/1147] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:52:36.005467 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add00f15-9e42-4b70-b5f8-d65cc6ebc218 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:36.005889 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add00f15-9e42-4b70-b5f8-d65cc6ebc218 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:36.006023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add00f15-9e42-4b70-b5f8-d65cc6ebc218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:36.025052 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-add00f15-9e42-4b70-b5f8-d65cc6ebc218 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:52:36.026854 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-add00f15-9e42-4b70-b5f8-d65cc6ebc218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:52:36.044716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:36.094597 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 571/1148] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:52:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:52:36.116867 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4f64a-a300-4e87-b365-6986a4640d4d None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:36.218441 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4f64a-a300-4e87-b365-6986a4640d4d None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:36.253498 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e7078-18e7-46e5-b28a-e37ea5f0d5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:36.254188 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e7078-18e7-46e5-b28a-e37ea5f0d5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:36.254491 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e7078-18e7-46e5-b28a-e37ea5f0d5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:36.254767 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e7078-18e7-46e5-b28a-e37ea5f0d5b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:36.265298 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e7078-18e7-46e5-b28a-e37ea5f0d5b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:52:36.270114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-1b8e7078-18e7-46e5-b28a-e37ea5f0d5b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:52:36.270114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:52:36.270114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:52:36.270114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:52:36.270114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:52:36.270114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:52:36.270114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:52:36.270114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:52:36.270114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:52:36.270114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:52:36.270114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:52:36.270114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:52:36.270114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:52:36.270114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:52:36.270114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:52:36.270114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:52:36.271259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:52:36.271259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:52:36.271259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:52:36.271259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:52:36.271259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:52:36.271259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:52:36.271259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:52:36.271259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:52:36.271259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:52:36.271259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:52:36.271259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:52:36.271259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:52:36.271259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:52:36.271259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:52:36.271259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:52:36.271259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:52:36.272516 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:52:36.272516 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:52:36.272516 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:52:36.272516 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:52:36.272516 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:52:36.272516 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:52:36.272516 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:52:36.272516 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:52:36.272516 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:52:36.272516 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:52:36.272516 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:52:36.272516 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:52:36.272516 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 578/1149] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:52:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:52:36.277453 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add00f15-9e42-4b70-b5f8-d65cc6ebc218 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:36.376025 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add00f15-9e42-4b70-b5f8-d65cc6ebc218 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:36.409958 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb525149-815f-47c9-9e39-88293e2cb711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:36.410597 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb525149-815f-47c9-9e39-88293e2cb711 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:36.410879 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb525149-815f-47c9-9e39-88293e2cb711 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:36.411153 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb525149-815f-47c9-9e39-88293e2cb711 None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:36.411868 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb525149-815f-47c9-9e39-88293e2cb711 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:36.412171 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb525149-815f-47c9-9e39-88293e2cb711 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:36.413544 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb525149-815f-47c9-9e39-88293e2cb711 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:36.422049 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 572/1150] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:52:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:52:36.428051 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e7078-18e7-46e5-b28a-e37ea5f0d5b5 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:36.455710 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:36.526766 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e7078-18e7-46e5-b28a-e37ea5f0d5b5 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:36.560260 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af2197-d3cc-4083-8aee-70369147f610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:36.560888 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af2197-d3cc-4083-8aee-70369147f610 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:36.561162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af2197-d3cc-4083-8aee-70369147f610 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:36.561431 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af2197-d3cc-4083-8aee-70369147f610 None admin] PATH_INFO: `/v3/users/8edccff36f1b4816851bf28be407536f` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:36.562593 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af2197-d3cc-4083-8aee-70369147f610 None admin] RBAC: Authorizing `identity:get_user(user_id=8edccff36f1b4816851bf28be407536f)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:36.564017 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af2197-d3cc-4083-8aee-70369147f610 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:36.565602 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 579/1151] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:52:36 2022] GET /identity/v3/users/8edccff36f1b4816851bf28be407536f => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:36.571437 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb525149-815f-47c9-9e39-88293e2cb711 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:36.589899 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:36.675880 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb525149-815f-47c9-9e39-88293e2cb711 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:36.712779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e59958-d428-454b-b48a-41c55fde31ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:36.713981 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e59958-d428-454b-b48a-41c55fde31ed None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:36.714259 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e59958-d428-454b-b48a-41c55fde31ed None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:36.714558 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e59958-d428-454b-b48a-41c55fde31ed None admin] PATH_INFO: `/v3/projects/ac1258b7baca48c6bcdedb46640417b0` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:36.715720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e59958-d428-454b-b48a-41c55fde31ed None admin] RBAC: Authorizing `identity:get_project(project_id=ac1258b7baca48c6bcdedb46640417b0)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:36.717154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e59958-d428-454b-b48a-41c55fde31ed None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:36.718880 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 573/1152] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:52:36 2022] GET /identity/v3/projects/ac1258b7baca48c6bcdedb46640417b0 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:52:36.724936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af2197-d3cc-4083-8aee-70369147f610 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:36.877101 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:36.888404 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af2197-d3cc-4083-8aee-70369147f610 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:36.944209 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab120ca-f5b1-496c-b250-5aae4b43b41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:36.945341 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab120ca-f5b1-496c-b250-5aae4b43b41f None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:36.945846 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab120ca-f5b1-496c-b250-5aae4b43b41f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:36.946369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab120ca-f5b1-496c-b250-5aae4b43b41f None admin] PATH_INFO: `/v3/projects/ac1258b7baca48c6bcdedb46640417b0/users/8edccff36f1b4816851bf28be407536f/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:36.949527 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab120ca-f5b1-496c-b250-5aae4b43b41f None admin] RBAC: Authorizing `identity:create_grant(project_id=ac1258b7baca48c6bcdedb46640417b0, user_id=8edccff36f1b4816851bf28be407536f, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:36.952321 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab120ca-f5b1-496c-b250-5aae4b43b41f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:36.968774 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 580/1153] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 08:52:36 2022] PUT /identity/v3/projects/ac1258b7baca48c6bcdedb46640417b0/users/8edccff36f1b4816851bf28be407536f/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:52:38.969058 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa183dd-35d9-4c85-a0be-c315ef87deb1 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:38.969589 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa183dd-35d9-4c85-a0be-c315ef87deb1 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:38.969589 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa183dd-35d9-4c85-a0be-c315ef87deb1 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:38.971007 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 574/1154] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:52:38.976115 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290323a0-a585-4672-b960-3caaff6f8f3a None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:38.976484 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290323a0-a585-4672-b960-3caaff6f8f3a None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:38.976677 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290323a0-a585-4672-b960-3caaff6f8f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:38.995004 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-290323a0-a585-4672-b960-3caaff6f8f3a None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:52:38.996378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-290323a0-a585-4672-b960-3caaff6f8f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:52:39.062700 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 581/1155] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:52:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:52:39.085415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa183dd-35d9-4c85-a0be-c315ef87deb1 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:39.170894 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:39.187912 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa183dd-35d9-4c85-a0be-c315ef87deb1 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:39.221477 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022a6e6-b59a-4fa4-ba90-7fd8e6fc9645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:39.222032 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022a6e6-b59a-4fa4-ba90-7fd8e6fc9645 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:39.222344 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022a6e6-b59a-4fa4-ba90-7fd8e6fc9645 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:39.222617 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022a6e6-b59a-4fa4-ba90-7fd8e6fc9645 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:39.233937 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022a6e6-b59a-4fa4-ba90-7fd8e6fc9645 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:52:39.238867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-0022a6e6-b59a-4fa4-ba90-7fd8e6fc9645 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:52:39.238867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:52:39.238867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:52:39.238867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:52:39.238867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:52:39.238867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:52:39.238867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:52:39.238867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:52:39.238867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:52:39.238867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:52:39.238867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:52:39.238867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:52:39.238867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:52:39.238867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:52:39.238867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:52:39.238867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:52:39.240107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:52:39.240107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:52:39.240107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:52:39.240107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:52:39.240107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:52:39.240107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:52:39.240107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:52:39.240107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:52:39.240107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:52:39.240107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:52:39.240107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:52:39.240107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:52:39.240107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:52:39.240107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:52:39.240107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:52:39.240107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:52:39.241168 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:52:39.241168 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:52:39.241168 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:52:39.241168 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:52:39.241168 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:52:39.241168 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:52:39.241168 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:52:39.241168 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:52:39.241168 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:52:39.241168 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:52:39.241168 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:52:39.241168 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:52:39.241168 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 575/1156] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:52:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:52:39.246674 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290323a0-a585-4672-b960-3caaff6f8f3a None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:39.327830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:39.344319 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290323a0-a585-4672-b960-3caaff6f8f3a None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:39.377328 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9e5d7-c878-4f3e-85ac-3d3156f6927b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:39.377936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9e5d7-c878-4f3e-85ac-3d3156f6927b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:39.378211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9e5d7-c878-4f3e-85ac-3d3156f6927b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:39.378506 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9e5d7-c878-4f3e-85ac-3d3156f6927b None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:39.379215 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9e5d7-c878-4f3e-85ac-3d3156f6927b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:39.379514 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9e5d7-c878-4f3e-85ac-3d3156f6927b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:39.380862 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9e5d7-c878-4f3e-85ac-3d3156f6927b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:39.389457 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 582/1157] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:52:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:39.395434 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022a6e6-b59a-4fa4-ba90-7fd8e6fc9645 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:39.494406 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022a6e6-b59a-4fa4-ba90-7fd8e6fc9645 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:39.528258 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bb42b-7188-496e-8bcf-6197c35c5c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:39.528884 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bb42b-7188-496e-8bcf-6197c35c5c22 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:39.529167 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bb42b-7188-496e-8bcf-6197c35c5c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:39.529443 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bb42b-7188-496e-8bcf-6197c35c5c22 None admin] PATH_INFO: `/v3/users/8edccff36f1b4816851bf28be407536f` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:39.530636 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41bb42b-7188-496e-8bcf-6197c35c5c22 None admin] RBAC: Authorizing `identity:get_user(user_id=8edccff36f1b4816851bf28be407536f)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:39.532075 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41bb42b-7188-496e-8bcf-6197c35c5c22 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:39.533964 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 576/1158] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:52:39 2022] GET /identity/v3/users/8edccff36f1b4816851bf28be407536f => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:52:39.539769 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9e5d7-c878-4f3e-85ac-3d3156f6927b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:39.637288 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9e5d7-c878-4f3e-85ac-3d3156f6927b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:39.673226 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb3499-9a9c-4dba-8b50-5567eea1cefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:39.673850 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb3499-9a9c-4dba-8b50-5567eea1cefc None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:39.674133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb3499-9a9c-4dba-8b50-5567eea1cefc None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:39.674442 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb3499-9a9c-4dba-8b50-5567eea1cefc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:39.690441 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:39.742679 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb3499-9a9c-4dba-8b50-5567eea1cefc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:39.744152 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb3499-9a9c-4dba-8b50-5567eea1cefc None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:39.843760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 583/1159] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:52:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:52:39.849703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bb42b-7188-496e-8bcf-6197c35c5c22 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:39.864925 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:39.949199 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bb42b-7188-496e-8bcf-6197c35c5c22 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:39.984566 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b26223-6c37-416f-bec7-1c0e78f1454f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:39.985211 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b26223-6c37-416f-bec7-1c0e78f1454f None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:39.985481 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b26223-6c37-416f-bec7-1c0e78f1454f None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:39.985751 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b26223-6c37-416f-bec7-1c0e78f1454f None admin] PATH_INFO: `/v3/projects/ac1258b7baca48c6bcdedb46640417b0` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:39.986941 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b26223-6c37-416f-bec7-1c0e78f1454f None admin] RBAC: Authorizing `identity:get_project(project_id=ac1258b7baca48c6bcdedb46640417b0)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:39.988402 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b26223-6c37-416f-bec7-1c0e78f1454f None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:39.990090 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 577/1160] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:52:39 2022] GET /identity/v3/projects/ac1258b7baca48c6bcdedb46640417b0 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:39.997003 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb3499-9a9c-4dba-8b50-5567eea1cefc None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:40.045348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:40.098590 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb3499-9a9c-4dba-8b50-5567eea1cefc None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:40.132751 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319733d-4d04-412d-a066-b2a68265ab50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:40.133372 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319733d-4d04-412d-a066-b2a68265ab50 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:40.133645 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319733d-4d04-412d-a066-b2a68265ab50 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:40.133911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319733d-4d04-412d-a066-b2a68265ab50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:40.134793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319733d-4d04-412d-a066-b2a68265ab50 None admin] RBAC: Adding query filter params (role.id=20bc872844094480b9dca67a25b69e84, scope.project.id=ac1258b7baca48c6bcdedb46640417b0, user.id=8edccff36f1b4816851bf28be407536f) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:40.135618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319733d-4d04-412d-a066-b2a68265ab50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:40.137015 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319733d-4d04-412d-a066-b2a68265ab50 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:40.142818 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 584/1161] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:52:39 2022] GET /identity/v3/role_assignments?user.id=8edccff36f1b4816851bf28be407536f&scope.project.id=ac1258b7baca48c6bcdedb46640417b0&role.id=20bc872844094480b9dca67a25b69e84 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:42.187559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af7542-8665-407d-9d13-def69bce2d80 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:42.188117 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af7542-8665-407d-9d13-def69bce2d80 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:42.188117 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af7542-8665-407d-9d13-def69bce2d80 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:42.189469 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 578/1162] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:52:42.194822 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785bf75-fea2-4323-a35b-aa337453deab None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:42.195248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785bf75-fea2-4323-a35b-aa337453deab None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:42.195374 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785bf75-fea2-4323-a35b-aa337453deab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:42.213921 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-6785bf75-fea2-4323-a35b-aa337453deab None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:52:42.215138 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6785bf75-fea2-4323-a35b-aa337453deab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:52:42.285330 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 585/1163] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:52:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:52:42.307685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af7542-8665-407d-9d13-def69bce2d80 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:42.393023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:42.413599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af7542-8665-407d-9d13-def69bce2d80 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:42.447313 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be1f29-cfa3-4570-96f5-5ed14d8f859a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:42.448440 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be1f29-cfa3-4570-96f5-5ed14d8f859a None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:42.448732 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be1f29-cfa3-4570-96f5-5ed14d8f859a None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:42.448976 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be1f29-cfa3-4570-96f5-5ed14d8f859a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:42.514905 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be1f29-cfa3-4570-96f5-5ed14d8f859a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:42.516359 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be1f29-cfa3-4570-96f5-5ed14d8f859a None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:42.594256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:42.613915 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 579/1164] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:52:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:52:42.620490 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785bf75-fea2-4323-a35b-aa337453deab None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:42.663181 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:42.726979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785bf75-fea2-4323-a35b-aa337453deab None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:42.764418 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b8d7b-1039-4957-9e1f-f0a5a8c89b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:42.765076 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b8d7b-1039-4957-9e1f-f0a5a8c89b76 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:42.765351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b8d7b-1039-4957-9e1f-f0a5a8c89b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:42.765618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b8d7b-1039-4957-9e1f-f0a5a8c89b76 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:42.773013 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b8d7b-1039-4957-9e1f-f0a5a8c89b76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:42.774508 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b8d7b-1039-4957-9e1f-f0a5a8c89b76 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:42.787318 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-ae5b8d7b-1039-4957-9e1f-f0a5a8c89b76 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 27 08:52:42.787318 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:52:42.787318 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 27 08:52:42.787318 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 27 08:52:42.787318 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:52:42.787318 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:52:42.787318 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:52:42.787318 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:52:42.787318 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 27 08:52:42.787318 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:52:42.787318 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:52:42.787318 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:52:42.787318 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:52:42.787318 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:52:42.787318 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:52:42.787318 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:52:42.787318 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:52:42.788640 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:52:42.788640 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:52:42.788640 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:52:42.788640 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:52:42.788640 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:52:42.788640 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:52:42.788640 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:52:42.788640 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:52:42.788640 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:52:42.788640 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:52:42.788640 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:52:42.788640 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:52:42.788640 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:52:42.788640 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:52:42.788640 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:52:42.788640 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:52:42.789520 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:52:42.789520 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:52:42.789520 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:52:42.789520 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:52:42.789520 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:52:42.789520 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:52:42.789520 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:52:42.789520 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:52:42.789520 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:52:42.789520 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:52:42.789520 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 27 08:52:42.789520 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:52:42.789520 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 27 08:52:42.789520 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:52:42.789520 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 586/1165] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Jul 27 08:52:42 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:52:42.795130 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be1f29-cfa3-4570-96f5-5ed14d8f859a None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:42.897420 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be1f29-cfa3-4570-96f5-5ed14d8f859a None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:42.931397 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458e66c-ede5-4323-8b2b-d10215cd4ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:42.931895 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458e66c-ede5-4323-8b2b-d10215cd4ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:42.932754 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458e66c-ede5-4323-8b2b-d10215cd4ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:42.933026 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458e66c-ede5-4323-8b2b-d10215cd4ff6 None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:42.933725 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458e66c-ede5-4323-8b2b-d10215cd4ff6 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:42.934031 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458e66c-ede5-4323-8b2b-d10215cd4ff6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:42.935429 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458e66c-ede5-4323-8b2b-d10215cd4ff6 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:42.942641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 580/1166] 10.222.0.65 () {56 vars in 1115 bytes} [Wed Jul 27 08:52:42 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:44.941118 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd293b6-93d4-434c-9e4f-69e4264c734c None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:44.941721 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd293b6-93d4-434c-9e4f-69e4264c734c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:44.941721 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd293b6-93d4-434c-9e4f-69e4264c734c None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:44.943034 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 587/1167] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:52:44.948927 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ea89c-3dea-45bd-b4fb-571f091e418c None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:44.949392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ea89c-3dea-45bd-b4fb-571f091e418c None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:44.949492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ea89c-3dea-45bd-b4fb-571f091e418c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:44.968165 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-5f0ea89c-3dea-45bd-b4fb-571f091e418c None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:52:44.969370 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-5f0ea89c-3dea-45bd-b4fb-571f091e418c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:52:45.009673 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:45.038334 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 581/1168] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:52:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:52:45.061374 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd293b6-93d4-434c-9e4f-69e4264c734c None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:45.161182 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:45.165387 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd293b6-93d4-434c-9e4f-69e4264c734c None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:45.200877 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf738b88-4354-4d49-b031-6abe79e4fe71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:45.201413 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf738b88-4354-4d49-b031-6abe79e4fe71 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:45.201692 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf738b88-4354-4d49-b031-6abe79e4fe71 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:45.201966 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf738b88-4354-4d49-b031-6abe79e4fe71 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:45.202702 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf738b88-4354-4d49-b031-6abe79e4fe71 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:45.204067 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf738b88-4354-4d49-b031-6abe79e4fe71 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:45.220488 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 588/1169] 10.222.0.65 () {60 vars in 1138 bytes} [Wed Jul 27 08:52:45 2022] POST /identity/v3/domains => generated 267 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:52:47.271647 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0dfaf-b937-4cf6-86c8-f1846e04fb6f None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:47.272209 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0dfaf-b937-4cf6-86c8-f1846e04fb6f None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:47.272209 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0dfaf-b937-4cf6-86c8-f1846e04fb6f None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:47.273583 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 582/1170] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:52:47.279321 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf818566-0d86-4d80-b149-0d41a369cb22 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:47.279703 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf818566-0d86-4d80-b149-0d41a369cb22 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:47.279887 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf818566-0d86-4d80-b149-0d41a369cb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:47.299145 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-cf818566-0d86-4d80-b149-0d41a369cb22 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:52:47.300342 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-cf818566-0d86-4d80-b149-0d41a369cb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:52:47.365183 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 589/1171] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:52:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:52:47.388253 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0dfaf-b937-4cf6-86c8-f1846e04fb6f None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:47.499404 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0dfaf-b937-4cf6-86c8-f1846e04fb6f None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:47.532892 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ca879-b2b9-4a48-9971-843d53d4d59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:47.540329 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ca879-b2b9-4a48-9971-843d53d4d59c None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:47.540741 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ca879-b2b9-4a48-9971-843d53d4d59c None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:47.541050 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ca879-b2b9-4a48-9971-843d53d4d59c None admin] PATH_INFO: `/v3/domains/ae6720b2855c4879a6407db491536d7b` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:47.552241 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ca879-b2b9-4a48-9971-843d53d4d59c None admin] RBAC: Authorizing `identity:get_domain(domain_id=ae6720b2855c4879a6407db491536d7b)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:47.553682 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ca879-b2b9-4a48-9971-843d53d4d59c None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:47.555381 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 583/1172] 10.222.0.65 () {56 vars in 1183 bytes} [Wed Jul 27 08:52:47 2022] GET /identity/v3/domains/ae6720b2855c4879a6407db491536d7b => generated 267 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:47.562279 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf818566-0d86-4d80-b149-0d41a369cb22 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:47.649822 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:47.660279 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf818566-0d86-4d80-b149-0d41a369cb22 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:47.695326 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544017f-3b24-4a06-bd22-e1095787704d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:47.695949 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544017f-3b24-4a06-bd22-e1095787704d None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:47.696234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544017f-3b24-4a06-bd22-e1095787704d None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:47.696505 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544017f-3b24-4a06-bd22-e1095787704d None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:47.697193 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f544017f-3b24-4a06-bd22-e1095787704d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:47.699149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f544017f-3b24-4a06-bd22-e1095787704d None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:47.725314 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 590/1173] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 08:52:47 2022] POST /identity/v3/projects => generated 361 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:52:49.791622 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f79d6-1dd1-450d-9b7d-d7f3868d8637 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:49.792189 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f79d6-1dd1-450d-9b7d-d7f3868d8637 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:49.792404 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f79d6-1dd1-450d-9b7d-d7f3868d8637 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:49.793692 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 584/1174] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:52:49.798991 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737286d-700b-4a72-b61e-627a08d6a678 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:49.799415 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737286d-700b-4a72-b61e-627a08d6a678 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:49.799557 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737286d-700b-4a72-b61e-627a08d6a678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:49.818024 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-6737286d-700b-4a72-b61e-627a08d6a678 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:52:49.819257 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6737286d-700b-4a72-b61e-627a08d6a678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:52:49.887141 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 591/1175] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:52:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:52:49.912311 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f79d6-1dd1-450d-9b7d-d7f3868d8637 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:49.948655 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:50.015877 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f79d6-1dd1-450d-9b7d-d7f3868d8637 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:50.051460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04de630-f097-4150-b354-aefa0add6c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:50.052027 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04de630-f097-4150-b354-aefa0add6c79 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:50.052307 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04de630-f097-4150-b354-aefa0add6c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:50.052580 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04de630-f097-4150-b354-aefa0add6c79 None admin] PATH_INFO: `/v3/domains/ae6720b2855c4879a6407db491536d7b` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:50.053716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04de630-f097-4150-b354-aefa0add6c79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ae6720b2855c4879a6407db491536d7b)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:50.055246 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04de630-f097-4150-b354-aefa0add6c79 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:50.056837 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 585/1176] 10.222.0.65 () {56 vars in 1183 bytes} [Wed Jul 27 08:52:49 2022] GET /identity/v3/domains/ae6720b2855c4879a6407db491536d7b => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:50.063346 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737286d-700b-4a72-b61e-627a08d6a678 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:50.132228 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:50.162922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737286d-700b-4a72-b61e-627a08d6a678 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:50.196558 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b034133-1d52-40df-8911-a959a1671b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:50.197176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b034133-1d52-40df-8911-a959a1671b51 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:50.197459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b034133-1d52-40df-8911-a959a1671b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:50.197771 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b034133-1d52-40df-8911-a959a1671b51 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:50.198864 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b034133-1d52-40df-8911-a959a1671b51 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:50.200313 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b034133-1d52-40df-8911-a959a1671b51 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:50.221335 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 592/1177] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 08:52:50 2022] POST /identity/v3/users => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 08:52:52.293462 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc0933-7ea5-40c8-a6cb-b80f4be10ed8 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:52.293989 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc0933-7ea5-40c8-a6cb-b80f4be10ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:52.293989 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc0933-7ea5-40c8-a6cb-b80f4be10ed8 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:52.295414 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 586/1178] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:52:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:52:52.300589 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3ec4d-3cc2-4ae0-b00e-65ad40e2382e None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:52.301006 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3ec4d-3cc2-4ae0-b00e-65ad40e2382e None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:52.301151 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3ec4d-3cc2-4ae0-b00e-65ad40e2382e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:52.319356 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-7ac3ec4d-3cc2-4ae0-b00e-65ad40e2382e None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:52:52.320554 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-7ac3ec4d-3cc2-4ae0-b00e-65ad40e2382e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:52:52.387770 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 593/1179] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:52:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:52:52.411206 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc0933-7ea5-40c8-a6cb-b80f4be10ed8 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:52.512003 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc0933-7ea5-40c8-a6cb-b80f4be10ed8 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:52.513557 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:52.547123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57b171-4a37-4a08-bc78-6bbf49101c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:52.547746 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57b171-4a37-4a08-bc78-6bbf49101c8c None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:52.548026 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57b171-4a37-4a08-bc78-6bbf49101c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:52.548299 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57b171-4a37-4a08-bc78-6bbf49101c8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:52.558791 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d57b171-4a37-4a08-bc78-6bbf49101c8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:52:52.563630 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-8d57b171-4a37-4a08-bc78-6bbf49101c8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:52:52.563630 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:52:52.563630 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:52:52.563630 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:52:52.563630 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:52:52.563630 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:52:52.563630 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:52:52.563630 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:52:52.563630 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:52:52.563630 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:52:52.563630 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:52:52.563630 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:52:52.563630 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:52:52.563630 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:52:52.563630 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:52:52.563630 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:52:52.564815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:52:52.564815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:52:52.564815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:52:52.564815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:52:52.564815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:52:52.564815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:52:52.564815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:52:52.564815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:52:52.564815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:52:52.564815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:52:52.564815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:52:52.564815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:52:52.564815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:52:52.564815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:52:52.564815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:52:52.564815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:52:52.565932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:52:52.565932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:52:52.565932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:52:52.565932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:52:52.565932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:52:52.565932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:52:52.565932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:52:52.565932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:52:52.565932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:52:52.565932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:52:52.565932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:52:52.565932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:52:52.565932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 587/1180] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:52:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:52:52.571046 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3ec4d-3cc2-4ae0-b00e-65ad40e2382e None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:52.628663 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:52.671305 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3ec4d-3cc2-4ae0-b00e-65ad40e2382e None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:52.705566 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b22ac-cd2a-4e63-afd0-737a4d86b1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:52.706189 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b22ac-cd2a-4e63-afd0-737a4d86b1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:52.706499 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b22ac-cd2a-4e63-afd0-737a4d86b1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:52.706777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b22ac-cd2a-4e63-afd0-737a4d86b1e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:52.707500 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b22ac-cd2a-4e63-afd0-737a4d86b1e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:52.707809 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b22ac-cd2a-4e63-afd0-737a4d86b1e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:52.709173 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b22ac-cd2a-4e63-afd0-737a4d86b1e5 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:52.717348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 594/1181] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:52:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:52.723183 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57b171-4a37-4a08-bc78-6bbf49101c8c None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:52.820226 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57b171-4a37-4a08-bc78-6bbf49101c8c None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:52.853217 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb553c7-954e-4e34-a2cb-6431f5215255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:52.853838 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb553c7-954e-4e34-a2cb-6431f5215255 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:52.854640 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb553c7-954e-4e34-a2cb-6431f5215255 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:52.854913 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb553c7-954e-4e34-a2cb-6431f5215255 None admin] PATH_INFO: `/v3/users/979e1ab90199480da511ae8a1fd6732a` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:52.867489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb553c7-954e-4e34-a2cb-6431f5215255 None admin] RBAC: Authorizing `identity:get_user(user_id=979e1ab90199480da511ae8a1fd6732a)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:52.868919 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb553c7-954e-4e34-a2cb-6431f5215255 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:52.871154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 588/1182] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:52:52 2022] GET /identity/v3/users/979e1ab90199480da511ae8a1fd6732a => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:52.877106 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b22ac-cd2a-4e63-afd0-737a4d86b1e5 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:52.976205 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b22ac-cd2a-4e63-afd0-737a4d86b1e5 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:53.003136 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:53.017136 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b0e14-0b26-42d5-92fe-8807f4038b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:53.017758 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b0e14-0b26-42d5-92fe-8807f4038b63 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:53.018039 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b0e14-0b26-42d5-92fe-8807f4038b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:53.018311 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b0e14-0b26-42d5-92fe-8807f4038b63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:53.086398 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b0e14-0b26-42d5-92fe-8807f4038b63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:53.087860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b0e14-0b26-42d5-92fe-8807f4038b63 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:53.186963 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 595/1183] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:52:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:52:53.192912 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb553c7-954e-4e34-a2cb-6431f5215255 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:53.215040 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:53.291814 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb553c7-954e-4e34-a2cb-6431f5215255 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:53.325474 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a76b8-1466-4ba1-9192-66bbc8ce7c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:53.326105 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a76b8-1466-4ba1-9192-66bbc8ce7c3c None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:53.326392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a76b8-1466-4ba1-9192-66bbc8ce7c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:53.326671 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a76b8-1466-4ba1-9192-66bbc8ce7c3c None admin] PATH_INFO: `/v3/projects/e0a330e040d044a4905305643653b036` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:53.327813 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a76b8-1466-4ba1-9192-66bbc8ce7c3c None admin] RBAC: Authorizing `identity:get_project(project_id=e0a330e040d044a4905305643653b036)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:53.329242 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a76b8-1466-4ba1-9192-66bbc8ce7c3c None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:53.330939 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 589/1184] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:52:53 2022] GET /identity/v3/projects/e0a330e040d044a4905305643653b036 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:53.337116 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b0e14-0b26-42d5-92fe-8807f4038b63 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:53.359070 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:53.436645 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b0e14-0b26-42d5-92fe-8807f4038b63 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:53.470440 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3b674-6342-4b2f-bc76-ff82dbaf8432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:53.471054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3b674-6342-4b2f-bc76-ff82dbaf8432 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:53.471338 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3b674-6342-4b2f-bc76-ff82dbaf8432 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:53.471615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3b674-6342-4b2f-bc76-ff82dbaf8432 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:53.472400 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3b674-6342-4b2f-bc76-ff82dbaf8432 None admin] RBAC: Adding query filter params (role.id=20bc872844094480b9dca67a25b69e84, scope.project.id=e0a330e040d044a4905305643653b036, user.id=979e1ab90199480da511ae8a1fd6732a) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:53.472711 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3b674-6342-4b2f-bc76-ff82dbaf8432 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:53.474134 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3b674-6342-4b2f-bc76-ff82dbaf8432 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:53.479596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 596/1185] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:52:53 2022] GET /identity/v3/role_assignments?user.id=979e1ab90199480da511ae8a1fd6732a&scope.project.id=e0a330e040d044a4905305643653b036&role.id=20bc872844094480b9dca67a25b69e84 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:55.470681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254f59a-b95e-4990-83a2-be63f8440625 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:55.471183 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254f59a-b95e-4990-83a2-be63f8440625 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:55.471183 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254f59a-b95e-4990-83a2-be63f8440625 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:55.472503 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 590/1186] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:52:55.477644 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b400616-fcad-40e9-a721-8ee804bea6b8 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:55.478080 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b400616-fcad-40e9-a721-8ee804bea6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:55.478182 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b400616-fcad-40e9-a721-8ee804bea6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:55.496647 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-4b400616-fcad-40e9-a721-8ee804bea6b8 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:52:55.497827 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4b400616-fcad-40e9-a721-8ee804bea6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:52:55.564646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 597/1187] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:52:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:52:55.587060 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254f59a-b95e-4990-83a2-be63f8440625 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:55.679963 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:55.693723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254f59a-b95e-4990-83a2-be63f8440625 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:55.727677 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6ba73-ef9d-4021-870c-adec7e136dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:55.728230 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6ba73-ef9d-4021-870c-adec7e136dec None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:55.728510 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6ba73-ef9d-4021-870c-adec7e136dec None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:55.728789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6ba73-ef9d-4021-870c-adec7e136dec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:55.739066 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6ba73-ef9d-4021-870c-adec7e136dec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:52:55.743926 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-98e6ba73-ef9d-4021-870c-adec7e136dec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:52:55.743926 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:52:55.743926 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:52:55.743926 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:52:55.743926 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:52:55.743926 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:52:55.743926 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:52:55.743926 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:52:55.743926 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:52:55.743926 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:52:55.743926 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:52:55.743926 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:52:55.743926 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:52:55.743926 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:52:55.743926 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:52:55.743926 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:52:55.745476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:52:55.745476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:52:55.745476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:52:55.745476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:52:55.745476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:52:55.745476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:52:55.745476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:52:55.745476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:52:55.745476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:52:55.745476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:52:55.745476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:52:55.745476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:52:55.745476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:52:55.745476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:52:55.745476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:52:55.745476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:52:55.746737 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:52:55.746737 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:52:55.746737 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:52:55.746737 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:52:55.746737 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:52:55.746737 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:52:55.746737 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:52:55.746737 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:52:55.746737 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:52:55.746737 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:52:55.746737 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:52:55.746737 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:52:55.746737 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 591/1188] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:52:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:52:55.751763 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b400616-fcad-40e9-a721-8ee804bea6b8 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:55.768525 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:55.853989 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b400616-fcad-40e9-a721-8ee804bea6b8 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:55.888266 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a12b7-c778-414f-9618-d73ce0912f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:55.888875 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a12b7-c778-414f-9618-d73ce0912f2e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:55.889159 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a12b7-c778-414f-9618-d73ce0912f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:55.889434 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a12b7-c778-414f-9618-d73ce0912f2e None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:55.890149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a12b7-c778-414f-9618-d73ce0912f2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:55.890492 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a12b7-c778-414f-9618-d73ce0912f2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:55.891857 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a12b7-c778-414f-9618-d73ce0912f2e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:55.899759 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 598/1189] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:52:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:55.905978 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6ba73-ef9d-4021-870c-adec7e136dec None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:56.004928 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6ba73-ef9d-4021-870c-adec7e136dec None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:56.038468 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae64fe-9002-460b-9d88-649fa20ee911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:56.039133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae64fe-9002-460b-9d88-649fa20ee911 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:56.040821 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae64fe-9002-460b-9d88-649fa20ee911 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:56.041097 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae64fe-9002-460b-9d88-649fa20ee911 None admin] PATH_INFO: `/v3/users/979e1ab90199480da511ae8a1fd6732a` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:56.042977 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae64fe-9002-460b-9d88-649fa20ee911 None admin] RBAC: Authorizing `identity:get_user(user_id=979e1ab90199480da511ae8a1fd6732a)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:56.044409 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae64fe-9002-460b-9d88-649fa20ee911 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:56.046006 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 592/1190] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:52:55 2022] GET /identity/v3/users/979e1ab90199480da511ae8a1fd6732a => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:56.051956 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a12b7-c778-414f-9618-d73ce0912f2e None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:56.129828 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:56.152672 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a12b7-c778-414f-9618-d73ce0912f2e None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:56.185844 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282c623-1114-4317-9afa-121e1f9723db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:56.186503 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282c623-1114-4317-9afa-121e1f9723db None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:56.186783 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282c623-1114-4317-9afa-121e1f9723db None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:56.187055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282c623-1114-4317-9afa-121e1f9723db None admin] PATH_INFO: `/v3/projects/e0a330e040d044a4905305643653b036` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:56.188191 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282c623-1114-4317-9afa-121e1f9723db None admin] RBAC: Authorizing `identity:get_project(project_id=e0a330e040d044a4905305643653b036)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:56.189627 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282c623-1114-4317-9afa-121e1f9723db None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:56.191324 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 599/1191] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:52:56 2022] GET /identity/v3/projects/e0a330e040d044a4905305643653b036 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:56.197495 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae64fe-9002-460b-9d88-649fa20ee911 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:56.216533 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:56.297552 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae64fe-9002-460b-9d88-649fa20ee911 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:56.331242 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be70e29-4d43-4251-846e-f01eddd943be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:56.331898 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be70e29-4d43-4251-846e-f01eddd943be None admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:56.332176 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be70e29-4d43-4251-846e-f01eddd943be None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:56.332448 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be70e29-4d43-4251-846e-f01eddd943be None admin] PATH_INFO: `/v3/projects/e0a330e040d044a4905305643653b036/users/979e1ab90199480da511ae8a1fd6732a/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:56.334393 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be70e29-4d43-4251-846e-f01eddd943be None admin] RBAC: Authorizing `identity:create_grant(project_id=e0a330e040d044a4905305643653b036, user_id=979e1ab90199480da511ae8a1fd6732a, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:56.335829 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be70e29-4d43-4251-846e-f01eddd943be None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:56.348847 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 593/1192] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 08:52:56 2022] PUT /identity/v3/projects/e0a330e040d044a4905305643653b036/users/979e1ab90199480da511ae8a1fd6732a/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:52:58.345500 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c9f60-29ef-4e72-a3ea-8dc01d97f327 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:58.346026 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c9f60-29ef-4e72-a3ea-8dc01d97f327 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:58.346026 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c9f60-29ef-4e72-a3ea-8dc01d97f327 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:58.347464 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 600/1193] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:52:58.352524 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ff0e4-bcde-4793-8478-b8883aeeee53 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:58.352927 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ff0e4-bcde-4793-8478-b8883aeeee53 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:58.353071 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ff0e4-bcde-4793-8478-b8883aeeee53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:58.371388 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-b36ff0e4-bcde-4793-8478-b8883aeeee53 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:52:58.372511 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-b36ff0e4-bcde-4793-8478-b8883aeeee53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:52:58.438783 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 594/1194] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:52:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:52:58.462456 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c9f60-29ef-4e72-a3ea-8dc01d97f327 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:58.562507 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c9f60-29ef-4e72-a3ea-8dc01d97f327 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:58.595672 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90648dce-8274-4054-8d71-807e2e30eb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:58.596301 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90648dce-8274-4054-8d71-807e2e30eb8b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:58.596576 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90648dce-8274-4054-8d71-807e2e30eb8b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:58.596844 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90648dce-8274-4054-8d71-807e2e30eb8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:58.606686 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90648dce-8274-4054-8d71-807e2e30eb8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:52:58.611477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-90648dce-8274-4054-8d71-807e2e30eb8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:52:58.611477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:52:58.611477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:52:58.611477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:52:58.611477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:52:58.611477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:52:58.611477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:52:58.611477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:52:58.611477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:52:58.611477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:52:58.611477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:52:58.611477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:52:58.611477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:52:58.611477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:52:58.611477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:52:58.611477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:52:58.612584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:52:58.612584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:52:58.612584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:52:58.612584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:52:58.612584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:52:58.612584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:52:58.612584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:52:58.612584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:52:58.612584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:52:58.612584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:52:58.612584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:52:58.612584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:52:58.612584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:52:58.612584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:52:58.612584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:52:58.612584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:52:58.613760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:52:58.613760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:52:58.613760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:52:58.613760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:52:58.613760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:52:58.613760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:52:58.613760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:52:58.613760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:52:58.613760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:52:58.613760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:52:58.613760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:52:58.613760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:52:58.613760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 601/1195] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:52:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:52:58.618812 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ff0e4-bcde-4793-8478-b8883aeeee53 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:58.627613 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:58.719559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ff0e4-bcde-4793-8478-b8883aeeee53 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:58.753396 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd29810-f150-4e90-8199-c164d8b0929f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:58.754024 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd29810-f150-4e90-8199-c164d8b0929f None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:58.754309 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd29810-f150-4e90-8199-c164d8b0929f None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:58.754618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd29810-f150-4e90-8199-c164d8b0929f None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:58.755343 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd29810-f150-4e90-8199-c164d8b0929f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:58.755652 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd29810-f150-4e90-8199-c164d8b0929f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:58.757023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd29810-f150-4e90-8199-c164d8b0929f None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:58.765924 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 595/1196] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:52:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:58.772089 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90648dce-8274-4054-8d71-807e2e30eb8b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:58.776714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:58.873207 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90648dce-8274-4054-8d71-807e2e30eb8b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:58.906055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833192b-13d7-45f2-b924-d8802168bfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:58.906649 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833192b-13d7-45f2-b924-d8802168bfbe None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:58.906933 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833192b-13d7-45f2-b924-d8802168bfbe None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:58.907211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833192b-13d7-45f2-b924-d8802168bfbe None admin] PATH_INFO: `/v3/users/979e1ab90199480da511ae8a1fd6732a` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:58.908373 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833192b-13d7-45f2-b924-d8802168bfbe None admin] RBAC: Authorizing `identity:get_user(user_id=979e1ab90199480da511ae8a1fd6732a)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:58.910063 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833192b-13d7-45f2-b924-d8802168bfbe None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:58.911698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 602/1197] 10.222.0.65 () {56 vars in 1177 bytes} [Wed Jul 27 08:52:58 2022] GET /identity/v3/users/979e1ab90199480da511ae8a1fd6732a => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:58.918144 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd29810-f150-4e90-8199-c164d8b0929f None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:58.983670 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:59.018040 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd29810-f150-4e90-8199-c164d8b0929f None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:59.053222 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c718e-883b-4719-b366-7239dd561fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:59.053842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c718e-883b-4719-b366-7239dd561fec None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:59.054117 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c718e-883b-4719-b366-7239dd561fec None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:59.054412 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c718e-883b-4719-b366-7239dd561fec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:59.121801 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c718e-883b-4719-b366-7239dd561fec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:59.123282 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c718e-883b-4719-b366-7239dd561fec None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:59.187219 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:59.224059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 596/1198] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:52:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:52:59.230917 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833192b-13d7-45f2-b924-d8802168bfbe None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:59.302738 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:52:59.338361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833192b-13d7-45f2-b924-d8802168bfbe None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:59.382086 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f60c45-91c1-4288-9871-7df74b054caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:59.382814 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f60c45-91c1-4288-9871-7df74b054caa None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:59.383019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f60c45-91c1-4288-9871-7df74b054caa None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:59.383294 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f60c45-91c1-4288-9871-7df74b054caa None admin] PATH_INFO: `/v3/projects/e0a330e040d044a4905305643653b036` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:59.384434 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f60c45-91c1-4288-9871-7df74b054caa None admin] RBAC: Authorizing `identity:get_project(project_id=e0a330e040d044a4905305643653b036)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:59.386721 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f60c45-91c1-4288-9871-7df74b054caa None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:59.388395 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 603/1199] 10.222.0.65 () {56 vars in 1186 bytes} [Wed Jul 27 08:52:59 2022] GET /identity/v3/projects/e0a330e040d044a4905305643653b036 => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:52:59.394600 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c718e-883b-4719-b366-7239dd561fec None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:52:59.499550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c718e-883b-4719-b366-7239dd561fec None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:52:59.535778 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2b78d-e6d9-40ff-a7aa-7afa24b97471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:52:59.536374 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2b78d-e6d9-40ff-a7aa-7afa24b97471 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:52:59.536646 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2b78d-e6d9-40ff-a7aa-7afa24b97471 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:52:59.536914 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2b78d-e6d9-40ff-a7aa-7afa24b97471 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:52:59.537710 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd2b78d-e6d9-40ff-a7aa-7afa24b97471 None admin] RBAC: Adding query filter params (role.id=20bc872844094480b9dca67a25b69e84, scope.project.id=e0a330e040d044a4905305643653b036, user.id=979e1ab90199480da511ae8a1fd6732a) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:52:59.538014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd2b78d-e6d9-40ff-a7aa-7afa24b97471 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:52:59.539493 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd2b78d-e6d9-40ff-a7aa-7afa24b97471 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:52:59.546297 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 597/1200] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:52:59 2022] GET /identity/v3/role_assignments?user.id=979e1ab90199480da511ae8a1fd6732a&scope.project.id=e0a330e040d044a4905305643653b036&role.id=20bc872844094480b9dca67a25b69e84 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:53:09.378130 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=30 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:53:09.543366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=84 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:53:55.674251 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54b0db-0f93-4c00-bfab-7d85fb00a0e0 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:53:55.674935 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54b0db-0f93-4c00-bfab-7d85fb00a0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:53:55.675092 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54b0db-0f93-4c00-bfab-7d85fb00a0e0 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:53:55.677067 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 604/1201] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:53:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:53:55.685469 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4efc03-2bca-483b-a01d-267d14866f08 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:53:55.686270 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4efc03-2bca-483b-a01d-267d14866f08 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:53:55.686661 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4efc03-2bca-483b-a01d-267d14866f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:53:55.712987 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-1f4efc03-2bca-483b-a01d-267d14866f08 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:53:55.714606 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-1f4efc03-2bca-483b-a01d-267d14866f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:53:55.812196 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 598/1202] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:53:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:53:55.837630 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54b0db-0f93-4c00-bfab-7d85fb00a0e0 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:53:56.007046 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54b0db-0f93-4c00-bfab-7d85fb00a0e0 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:53:56.067025 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596788d-0b54-4fa0-9d24-779ac394a8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:53:56.068079 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596788d-0b54-4fa0-9d24-779ac394a8fb None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:53:56.068440 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596788d-0b54-4fa0-9d24-779ac394a8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:53:56.068796 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596788d-0b54-4fa0-9d24-779ac394a8fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:53:56.089056 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596788d-0b54-4fa0-9d24-779ac394a8fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:53:56.092485 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596788d-0b54-4fa0-9d24-779ac394a8fb None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:53:56.120342 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-d596788d-0b54-4fa0-9d24-779ac394a8fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:53:56.120342 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:53:56.120342 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:53:56.120342 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:53:56.120342 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:53:56.120342 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:53:56.120342 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:53:56.120342 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:53:56.120342 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:53:56.120342 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:53:56.120342 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:53:56.120342 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:53:56.120342 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:53:56.120342 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:53:56.120342 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:53:56.121592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:53:56.121592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:53:56.121592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:53:56.121592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:53:56.121592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:53:56.121592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:53:56.121592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:53:56.121592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:53:56.121592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:53:56.121592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:53:56.121592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:53:56.121592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:53:56.121592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:53:56.121592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:53:56.121592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:53:56.121592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:53:56.121592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:53:56.122647 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:53:56.122647 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:53:56.122647 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:53:56.122647 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:53:56.123582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 605/1203] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:53:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:53:56.132002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4efc03-2bca-483b-a01d-267d14866f08 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:53:56.273563 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4efc03-2bca-483b-a01d-267d14866f08 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:53:56.317262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:53:56.325948 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b81b9-e69c-4deb-94ad-17f65e6e8f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:53:56.326678 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b81b9-e69c-4deb-94ad-17f65e6e8f72 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:53:56.326960 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b81b9-e69c-4deb-94ad-17f65e6e8f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:53:56.327247 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b81b9-e69c-4deb-94ad-17f65e6e8f72 None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:53:56.327952 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b81b9-e69c-4deb-94ad-17f65e6e8f72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:53:56.328255 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b81b9-e69c-4deb-94ad-17f65e6e8f72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:53:56.329657 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b81b9-e69c-4deb-94ad-17f65e6e8f72 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:53:56.343097 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 599/1204] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:53:56.349152 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596788d-0b54-4fa0-9d24-779ac394a8fb None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:53:56.420140 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:53:56.490549 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596788d-0b54-4fa0-9d24-779ac394a8fb None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:53:56.544163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a598b1f-0d23-4955-b4bb-7386e640d890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:53:56.545007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a598b1f-0d23-4955-b4bb-7386e640d890 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:53:56.545393 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a598b1f-0d23-4955-b4bb-7386e640d890 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:53:56.545765 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a598b1f-0d23-4955-b4bb-7386e640d890 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:53:56.546671 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a598b1f-0d23-4955-b4bb-7386e640d890 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:53:56.548369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a598b1f-0d23-4955-b4bb-7386e640d890 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:53:56.590353 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 606/1205] 10.222.0.65 () {60 vars in 1132 bytes} [Wed Jul 27 08:53:56 2022] POST /identity/v3/users => generated 251 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:53:58.942542 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aae141-1f64-4995-bd86-0093397e3f02 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:53:58.943116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aae141-1f64-4995-bd86-0093397e3f02 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:53:58.943116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aae141-1f64-4995-bd86-0093397e3f02 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:53:58.944465 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 600/1206] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:53:58.950918 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a5366-8d49-4836-bd9f-27268fadac61 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:53:58.951458 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a5366-8d49-4836-bd9f-27268fadac61 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:53:58.951592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a5366-8d49-4836-bd9f-27268fadac61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:53:58.972630 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-118a5366-8d49-4836-bd9f-27268fadac61 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:53:58.974105 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-118a5366-8d49-4836-bd9f-27268fadac61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:53:59.051371 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 607/1207] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:53:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:53:59.077219 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aae141-1f64-4995-bd86-0093397e3f02 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:53:59.206888 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aae141-1f64-4995-bd86-0093397e3f02 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:53:59.250052 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9e8fb-da56-403a-965d-348f69ee4d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:53:59.251149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9e8fb-da56-403a-965d-348f69ee4d4d None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:53:59.251429 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9e8fb-da56-403a-965d-348f69ee4d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:53:59.251702 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9e8fb-da56-403a-965d-348f69ee4d4d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:53:59.263244 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e9e8fb-da56-403a-965d-348f69ee4d4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:53:59.268455 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-e7e9e8fb-da56-403a-965d-348f69ee4d4d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:53:59.268455 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:53:59.268455 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:53:59.268455 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:53:59.268455 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:53:59.268455 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:53:59.268455 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:53:59.268455 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:53:59.268455 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:53:59.268455 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:53:59.268455 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:53:59.268455 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:53:59.268455 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:53:59.268455 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:53:59.268455 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:53:59.268455 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:53:59.269810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:53:59.269810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:53:59.269810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:53:59.269810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:53:59.269810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:53:59.269810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:53:59.269810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:53:59.269810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:53:59.269810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:53:59.269810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:53:59.269810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:53:59.269810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:53:59.269810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:53:59.269810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:53:59.269810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:53:59.269810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:53:59.271005 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:53:59.271005 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:53:59.271005 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:53:59.271005 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:53:59.271005 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:53:59.271005 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:53:59.271005 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:53:59.271005 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:53:59.271005 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:53:59.271005 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:53:59.271005 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:53:59.271005 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:53:59.271005 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 601/1208] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 08:53:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:53:59.275935 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a5366-8d49-4836-bd9f-27268fadac61 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:53:59.329023 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:53:59.422818 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a5366-8d49-4836-bd9f-27268fadac61 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:53:59.468296 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd09624-6eb2-4e35-80ee-c34d402b3d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:53:59.468954 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd09624-6eb2-4e35-80ee-c34d402b3d89 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:53:59.469301 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd09624-6eb2-4e35-80ee-c34d402b3d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:53:59.469640 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd09624-6eb2-4e35-80ee-c34d402b3d89 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:53:59.470492 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd09624-6eb2-4e35-80ee-c34d402b3d89 None admin] RBAC: Adding query filter params (name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:53:59.470880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd09624-6eb2-4e35-80ee-c34d402b3d89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:53:59.472377 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd09624-6eb2-4e35-80ee-c34d402b3d89 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:53:59.482679 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 608/1209] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 08:53:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:53:59.488989 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9e8fb-da56-403a-965d-348f69ee4d4d None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:53:59.554353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:53:59.628571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9e8fb-da56-403a-965d-348f69ee4d4d None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:53:59.686955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134f756-81a4-4007-8cd1-68da6c97ce68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:53:59.687645 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134f756-81a4-4007-8cd1-68da6c97ce68 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:53:59.687985 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134f756-81a4-4007-8cd1-68da6c97ce68 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:53:59.688555 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134f756-81a4-4007-8cd1-68da6c97ce68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:53:59.705933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134f756-81a4-4007-8cd1-68da6c97ce68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:53:59.707897 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134f756-81a4-4007-8cd1-68da6c97ce68 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:53:59.727685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-4134f756-81a4-4007-8cd1-68da6c97ce68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:53:59.727685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:53:59.727685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:53:59.727685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:53:59.727685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:53:59.727685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:53:59.727685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:53:59.727685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:53:59.727685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:53:59.727685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:53:59.727685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:53:59.727685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:53:59.727685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:53:59.727685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:53:59.727685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:53:59.728618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:53:59.728618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:53:59.728618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:53:59.728618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:53:59.728618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:53:59.728618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:53:59.728618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:53:59.728618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:53:59.728618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:53:59.728618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:53:59.728618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:53:59.728618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:53:59.728618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:53:59.728618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:53:59.728618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:53:59.728618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:53:59.728618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:53:59.729927 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:53:59.729927 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:53:59.729927 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:53:59.729927 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:53:59.730740 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 602/1210] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:53:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:53:59.734634 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd09624-6eb2-4e35-80ee-c34d402b3d89 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:53:59.874052 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:53:59.878994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd09624-6eb2-4e35-80ee-c34d402b3d89 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:53:59.931210 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37defc61-cd51-449e-a440-ba6d8bcb5dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:53:59.931463 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37defc61-cd51-449e-a440-ba6d8bcb5dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:53:59.931580 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37defc61-cd51-449e-a440-ba6d8bcb5dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:53:59.931902 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37defc61-cd51-449e-a440-ba6d8bcb5dc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:53:59.932860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37defc61-cd51-449e-a440-ba6d8bcb5dc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:53:59.932860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37defc61-cd51-449e-a440-ba6d8bcb5dc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:53:59.934524 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37defc61-cd51-449e-a440-ba6d8bcb5dc7 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:53:59.957007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 609/1211] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:53:59.958249 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134f756-81a4-4007-8cd1-68da6c97ce68 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:00.068983 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134f756-81a4-4007-8cd1-68da6c97ce68 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:00.072299 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:00.107224 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a03a14-06eb-48d7-ab67-0882a631b98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:00.107876 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a03a14-06eb-48d7-ab67-0882a631b98a None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:00.108197 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a03a14-06eb-48d7-ab67-0882a631b98a None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:00.108437 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a03a14-06eb-48d7-ab67-0882a631b98a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:00.116729 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a03a14-06eb-48d7-ab67-0882a631b98a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:00.118011 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a03a14-06eb-48d7-ab67-0882a631b98a None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:00.132594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-f4a03a14-06eb-48d7-ab67-0882a631b98a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 08:54:00.132594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:00.132594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:54:00.132594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:54:00.132594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:54:00.132594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:54:00.132594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:54:00.132594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:54:00.132594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:54:00.132594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:54:00.132594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:54:00.132594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:54:00.132594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:54:00.132594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:54:00.132594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:54:00.132594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:54:00.137550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:54:00.137550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:54:00.137550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:54:00.137550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:54:00.137550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:54:00.137550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:54:00.137550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:54:00.137550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:54:00.137550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:54:00.137550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:54:00.137550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:54:00.137550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:54:00.137550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:54:00.137550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:54:00.137550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:54:00.137550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:54:00.137550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:54:00.137550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:54:00.138562 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:54:00.138562 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:54:00.138562 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:54:00.138562 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:54:00.138562 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:54:00.138562 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:54:00.138562 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:54:00.138562 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:54:00.138562 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 08:54:00.138562 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:54:00.138562 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 603/1212] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:53:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:54:00.140560 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37defc61-cd51-449e-a440-ba6d8bcb5dc7 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:00.264507 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37defc61-cd51-449e-a440-ba6d8bcb5dc7 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:00.308615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d3918-df35-471d-b974-879fd36ad420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:00.309722 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d3918-df35-471d-b974-879fd36ad420 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:00.310064 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d3918-df35-471d-b974-879fd36ad420 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:00.310294 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d3918-df35-471d-b974-879fd36ad420 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:00.311122 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d3918-df35-471d-b974-879fd36ad420 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:00.311425 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d3918-df35-471d-b974-879fd36ad420 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:00.313098 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d3918-df35-471d-b974-879fd36ad420 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:00.334882 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 610/1213] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Jul 27 08:54:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:54:00.342929 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a03a14-06eb-48d7-ab67-0882a631b98a None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:00.473133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a03a14-06eb-48d7-ab67-0882a631b98a None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:00.513025 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106bcb2-23f9-46c6-87ac-5349ae294293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:00.513839 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106bcb2-23f9-46c6-87ac-5349ae294293 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:00.514359 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106bcb2-23f9-46c6-87ac-5349ae294293 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:00.514710 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106bcb2-23f9-46c6-87ac-5349ae294293 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:00.553101 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:00.602249 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106bcb2-23f9-46c6-87ac-5349ae294293 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:00.603706 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106bcb2-23f9-46c6-87ac-5349ae294293 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:00.736235 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 604/1214] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:54:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:54:00.744094 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d3918-df35-471d-b974-879fd36ad420 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:00.770959 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:00.879971 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d3918-df35-471d-b974-879fd36ad420 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:00.922707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49b3bc-a508-4b83-bb68-27fd560cf2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:00.923419 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49b3bc-a508-4b83-bb68-27fd560cf2a7 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:00.923706 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49b3bc-a508-4b83-bb68-27fd560cf2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:00.924068 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49b3bc-a508-4b83-bb68-27fd560cf2a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:00.936354 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49b3bc-a508-4b83-bb68-27fd560cf2a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:00.937818 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49b3bc-a508-4b83-bb68-27fd560cf2a7 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:00.955591 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-4d49b3bc-a508-4b83-bb68-27fd560cf2a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:54:00.955591 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:00.955591 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:54:00.955591 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:54:00.955591 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:54:00.955591 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:54:00.955591 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:54:00.955591 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:54:00.955591 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:54:00.955591 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:54:00.955591 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:54:00.955591 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:54:00.955591 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:54:00.955591 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:54:00.955591 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:54:00.956958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:54:00.956958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:54:00.956958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:54:00.956958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:54:00.956958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:54:00.956958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:54:00.956958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:54:00.956958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:54:00.956958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:54:00.956958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:54:00.956958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:54:00.956958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:54:00.956958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:54:00.956958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:54:00.956958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:54:00.956958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:54:00.956958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:54:00.963375 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:54:00.963375 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:54:00.963375 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:54:00.963375 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:54:00.963375 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 611/1215] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:54:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:54:00.963751 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106bcb2-23f9-46c6-87ac-5349ae294293 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:01.035639 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:01.079574 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106bcb2-23f9-46c6-87ac-5349ae294293 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:01.123857 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2929de2-b21b-4cab-a29f-15c3916a8bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:01.124698 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2929de2-b21b-4cab-a29f-15c3916a8bad None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:01.125046 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2929de2-b21b-4cab-a29f-15c3916a8bad None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:01.125327 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2929de2-b21b-4cab-a29f-15c3916a8bad None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:01.126036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2929de2-b21b-4cab-a29f-15c3916a8bad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:01.126430 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2929de2-b21b-4cab-a29f-15c3916a8bad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:01.127890 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2929de2-b21b-4cab-a29f-15c3916a8bad None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:01.144090 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 605/1216] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:54:01.150095 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49b3bc-a508-4b83-bb68-27fd560cf2a7 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:01.232580 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:01.265860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49b3bc-a508-4b83-bb68-27fd560cf2a7 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:01.301976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd16c2-3840-4ecf-a846-8e552f0414fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:01.302662 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd16c2-3840-4ecf-a846-8e552f0414fa None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:01.302997 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd16c2-3840-4ecf-a846-8e552f0414fa None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:01.303256 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd16c2-3840-4ecf-a846-8e552f0414fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:01.310433 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd16c2-3840-4ecf-a846-8e552f0414fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:01.311857 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd16c2-3840-4ecf-a846-8e552f0414fa None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:01.323574 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-b9cd16c2-3840-4ecf-a846-8e552f0414fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:54:01.323574 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:01.323574 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:54:01.323574 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:54:01.323574 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:54:01.323574 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:54:01.323574 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:54:01.323574 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:54:01.323574 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:54:01.323574 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:54:01.323574 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:54:01.323574 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:54:01.323574 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:54:01.323574 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:54:01.323574 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:54:01.325502 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:54:01.325502 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:54:01.325502 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:54:01.325502 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:54:01.325502 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:54:01.325502 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:54:01.325502 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:54:01.325502 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:54:01.325502 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:54:01.325502 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:54:01.325502 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:54:01.325502 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:54:01.325502 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:54:01.325502 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:54:01.325502 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:54:01.325502 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:54:01.325502 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:54:01.326917 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:54:01.326917 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:54:01.326917 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:54:01.326917 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:54:01.326917 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:54:01.326917 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:54:01.326917 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:54:01.326917 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:54:01.330247 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 612/1217] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:54:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:54:01.331177 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2929de2-b21b-4cab-a29f-15c3916a8bad None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:01.445595 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2929de2-b21b-4cab-a29f-15c3916a8bad None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:01.470822 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:01.486681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3dbf6-97f1-4504-a867-685dc97b54cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:01.487433 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3dbf6-97f1-4504-a867-685dc97b54cc None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:01.487823 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3dbf6-97f1-4504-a867-685dc97b54cc None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:01.488226 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3dbf6-97f1-4504-a867-685dc97b54cc None admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:01.489205 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3dbf6-97f1-4504-a867-685dc97b54cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:01.489518 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3dbf6-97f1-4504-a867-685dc97b54cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:01.491620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3dbf6-97f1-4504-a867-685dc97b54cc None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:01.508193 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 606/1218] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:54:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:54:01.514904 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd16c2-3840-4ecf-a846-8e552f0414fa None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:01.631428 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd16c2-3840-4ecf-a846-8e552f0414fa None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:01.664164 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:01.671316 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbb097-b4be-4398-a396-856300b90667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:01.672150 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbb097-b4be-4398-a396-856300b90667 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:01.673218 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbb097-b4be-4398-a396-856300b90667 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:01.673757 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbb097-b4be-4398-a396-856300b90667 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:01.675297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdbb097-b4be-4398-a396-856300b90667 None admin] RBAC: Adding query filter params (role.id=e476894ef72943f9b83d98d0704edfea, scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267, user.id=3d69004d02f9426b86e07907a553e523) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:01.675923 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdbb097-b4be-4398-a396-856300b90667 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:01.677686 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdbb097-b4be-4398-a396-856300b90667 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:01.685649 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 613/1219] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:54:01 2022] GET /identity/v3/role_assignments?user.id=3d69004d02f9426b86e07907a553e523&scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267&role.id=e476894ef72943f9b83d98d0704edfea => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:54:03.847541 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f630836-cede-4a37-b049-3193a5f225d5 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:03.848427 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f630836-cede-4a37-b049-3193a5f225d5 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:03.848584 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f630836-cede-4a37-b049-3193a5f225d5 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:03.851027 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 607/1220] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:54:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:54:03.858906 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916199d-d8ce-41b8-b93f-ee2226af8cb2 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:03.859561 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916199d-d8ce-41b8-b93f-ee2226af8cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:03.859561 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916199d-d8ce-41b8-b93f-ee2226af8cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:03.879690 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-0916199d-d8ce-41b8-b93f-ee2226af8cb2 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:54:03.880939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-0916199d-d8ce-41b8-b93f-ee2226af8cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:54:04.004220 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 614/1221] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:54:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 08:54:04.035776 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f630836-cede-4a37-b049-3193a5f225d5 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:04.195510 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f630836-cede-4a37-b049-3193a5f225d5 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:04.252785 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44129460-0cb0-49dd-8379-69f0d162c856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:04.253526 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44129460-0cb0-49dd-8379-69f0d162c856 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:04.253780 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44129460-0cb0-49dd-8379-69f0d162c856 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:04.254132 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44129460-0cb0-49dd-8379-69f0d162c856 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:04.269237 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44129460-0cb0-49dd-8379-69f0d162c856 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:54:04.274571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-44129460-0cb0-49dd-8379-69f0d162c856 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:54:04.274571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:04.274571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:54:04.274571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:54:04.274571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:54:04.274571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:54:04.274571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:54:04.274571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:54:04.274571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:54:04.274571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:54:04.274571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:54:04.274571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:54:04.274571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:54:04.274571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:54:04.274571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:54:04.274571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:54:04.276583 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:54:04.276583 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:54:04.276583 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:54:04.276583 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:54:04.276583 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:54:04.276583 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:54:04.276583 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:54:04.276583 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:54:04.276583 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:54:04.276583 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:54:04.276583 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:54:04.276583 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:54:04.276583 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:54:04.276583 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:54:04.276583 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:54:04.276583 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:54:04.279241 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:54:04.279241 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:54:04.279241 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:54:04.279241 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:54:04.279241 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:54:04.279241 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:54:04.279241 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:54:04.279241 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:54:04.279241 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:54:04.279241 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:54:04.279241 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:54:04.279241 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:54:04.279241 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 608/1222] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 08:54:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:54:04.283663 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916199d-d8ce-41b8-b93f-ee2226af8cb2 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:04.422563 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916199d-d8ce-41b8-b93f-ee2226af8cb2 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:04.457859 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:04.478888 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ce7ed-ec17-4fa9-a57e-e3cbae35d8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:04.480105 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ce7ed-ec17-4fa9-a57e-e3cbae35d8aa None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:04.481407 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ce7ed-ec17-4fa9-a57e-e3cbae35d8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:04.481955 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ce7ed-ec17-4fa9-a57e-e3cbae35d8aa None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:04.483527 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ce7ed-ec17-4fa9-a57e-e3cbae35d8aa None admin] RBAC: Adding query filter params (name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:04.484150 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ce7ed-ec17-4fa9-a57e-e3cbae35d8aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:04.486885 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ce7ed-ec17-4fa9-a57e-e3cbae35d8aa None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:04.504518 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 615/1223] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 08:54:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:54:04.510977 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44129460-0cb0-49dd-8379-69f0d162c856 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:04.578507 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:04.656967 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44129460-0cb0-49dd-8379-69f0d162c856 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:04.716470 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1edc0e-6b65-4cee-9e4b-9a4e31b22ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:04.717420 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1edc0e-6b65-4cee-9e4b-9a4e31b22ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:04.717902 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1edc0e-6b65-4cee-9e4b-9a4e31b22ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:04.718414 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1edc0e-6b65-4cee-9e4b-9a4e31b22ec6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:04.738110 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1edc0e-6b65-4cee-9e4b-9a4e31b22ec6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:04.740913 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1edc0e-6b65-4cee-9e4b-9a4e31b22ec6 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:04.764120 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-9f1edc0e-6b65-4cee-9e4b-9a4e31b22ec6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:54:04.764120 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:04.764120 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:54:04.764120 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:54:04.764120 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:54:04.764120 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:54:04.764120 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:54:04.764120 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:54:04.764120 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:54:04.764120 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:54:04.764120 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:54:04.764120 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:54:04.764120 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:54:04.764120 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:54:04.764120 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:54:04.766285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:54:04.766285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:54:04.766285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:54:04.766285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:54:04.766285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:54:04.766285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:54:04.766285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:54:04.766285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:54:04.766285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:54:04.766285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:54:04.766285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:54:04.766285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:54:04.766285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:54:04.766285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:54:04.766285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:54:04.766285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:54:04.766285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:54:04.768164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:54:04.768164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:54:04.768164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:54:04.768164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:54:04.768164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 609/1224] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:54:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:54:04.773520 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ce7ed-ec17-4fa9-a57e-e3cbae35d8aa None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:04.916240 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ce7ed-ec17-4fa9-a57e-e3cbae35d8aa None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:04.959260 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d2dea-ae5b-4ff3-bb4c-998945393460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:04.960245 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d2dea-ae5b-4ff3-bb4c-998945393460 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:04.960611 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d2dea-ae5b-4ff3-bb4c-998945393460 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:04.961146 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d2dea-ae5b-4ff3-bb4c-998945393460 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:04.962066 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d2dea-ae5b-4ff3-bb4c-998945393460 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:04.962640 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d2dea-ae5b-4ff3-bb4c-998945393460 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:04.964389 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d2dea-ae5b-4ff3-bb4c-998945393460 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:04.987616 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 616/1225] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:54:04.989123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1edc0e-6b65-4cee-9e4b-9a4e31b22ec6 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:05.145601 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:05.159222 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1edc0e-6b65-4cee-9e4b-9a4e31b22ec6 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:05.214531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbfefc-23e9-476f-8e26-adf395e89c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:05.215792 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbfefc-23e9-476f-8e26-adf395e89c5c None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:05.216129 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbfefc-23e9-476f-8e26-adf395e89c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:05.216477 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbfefc-23e9-476f-8e26-adf395e89c5c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:05.225088 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdbfefc-23e9-476f-8e26-adf395e89c5c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:05.226696 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdbfefc-23e9-476f-8e26-adf395e89c5c None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:05.240550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-8cdbfefc-23e9-476f-8e26-adf395e89c5c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 08:54:05.240550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:05.240550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:54:05.240550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:54:05.240550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:54:05.240550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:54:05.240550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:54:05.240550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:54:05.240550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:54:05.240550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:54:05.240550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:54:05.240550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:54:05.240550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:54:05.240550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:54:05.240550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:54:05.240550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:54:05.242636 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:54:05.242636 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:54:05.242636 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:54:05.242636 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:54:05.242636 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:54:05.242636 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:54:05.242636 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:54:05.242636 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:54:05.242636 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:54:05.242636 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:54:05.242636 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:54:05.242636 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:54:05.242636 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:54:05.242636 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:54:05.242636 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:54:05.242636 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:54:05.242636 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:54:05.242636 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:54:05.244584 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:54:05.244584 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:54:05.244584 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:54:05.244584 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:54:05.244584 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:54:05.244584 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:54:05.244584 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:54:05.244584 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:54:05.244584 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 08:54:05.244584 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:54:05.244584 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 610/1226] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:54:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:54:05.249965 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d2dea-ae5b-4ff3-bb4c-998945393460 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:05.312145 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:05.385216 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d2dea-ae5b-4ff3-bb4c-998945393460 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:05.444311 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdfb38-00d3-474d-8d25-d930ce96becb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:05.445388 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdfb38-00d3-474d-8d25-d930ce96becb None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:05.445900 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdfb38-00d3-474d-8d25-d930ce96becb None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:05.446291 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdfb38-00d3-474d-8d25-d930ce96becb None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:05.447965 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdfb38-00d3-474d-8d25-d930ce96becb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:05.448495 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdfb38-00d3-474d-8d25-d930ce96becb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:05.451848 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdfb38-00d3-474d-8d25-d930ce96becb None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:05.485303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 617/1227] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Jul 27 08:54:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:54:05.487209 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbfefc-23e9-476f-8e26-adf395e89c5c None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:05.638009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbfefc-23e9-476f-8e26-adf395e89c5c None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:05.689707 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe590d6-afe6-421b-88cf-7fde254c9fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:05.691118 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe590d6-afe6-421b-88cf-7fde254c9fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:05.691621 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe590d6-afe6-421b-88cf-7fde254c9fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:05.692084 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe590d6-afe6-421b-88cf-7fde254c9fe3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:05.713991 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe590d6-afe6-421b-88cf-7fde254c9fe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:05.716802 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe590d6-afe6-421b-88cf-7fde254c9fe3 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:05.737135 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-cfe590d6-afe6-421b-88cf-7fde254c9fe3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:54:05.737135 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:05.737135 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:54:05.737135 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:54:05.737135 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:54:05.737135 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:54:05.737135 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:54:05.737135 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:54:05.737135 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:54:05.737135 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:54:05.737135 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:54:05.737135 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:54:05.737135 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:54:05.737135 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:54:05.737135 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:54:05.739316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:54:05.739316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:54:05.739316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:54:05.739316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:54:05.739316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:54:05.739316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:54:05.739316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:54:05.739316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:54:05.739316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:54:05.739316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:54:05.739316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:54:05.739316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:54:05.739316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:54:05.739316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:54:05.739316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:54:05.739316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:54:05.739316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:54:05.741316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:54:05.741316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:54:05.741316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:54:05.741316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:54:05.745639 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 611/1228] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:54:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:54:05.747531 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdfb38-00d3-474d-8d25-d930ce96becb None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:05.917414 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdfb38-00d3-474d-8d25-d930ce96becb None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:05.922748 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:05.969859 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0e4df-66e5-4d88-8c1e-903d75d2b1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:05.970595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0e4df-66e5-4d88-8c1e-903d75d2b1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:05.970874 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0e4df-66e5-4d88-8c1e-903d75d2b1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:05.971319 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0e4df-66e5-4d88-8c1e-903d75d2b1d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:05.972374 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0e4df-66e5-4d88-8c1e-903d75d2b1d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:05.972659 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0e4df-66e5-4d88-8c1e-903d75d2b1d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:05.974604 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0e4df-66e5-4d88-8c1e-903d75d2b1d2 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:05.992287 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 618/1229] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:54:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:54:06.002262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe590d6-afe6-421b-88cf-7fde254c9fe3 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:06.016292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:06.156281 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe590d6-afe6-421b-88cf-7fde254c9fe3 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:06.205423 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35794ba-a5f2-44f6-8025-6004cc0d6ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:06.207381 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35794ba-a5f2-44f6-8025-6004cc0d6ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:06.207875 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35794ba-a5f2-44f6-8025-6004cc0d6ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:06.208593 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35794ba-a5f2-44f6-8025-6004cc0d6ed3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:06.224138 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35794ba-a5f2-44f6-8025-6004cc0d6ed3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:06.227081 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35794ba-a5f2-44f6-8025-6004cc0d6ed3 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:06.254733 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-a35794ba-a5f2-44f6-8025-6004cc0d6ed3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:54:06.254733 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:06.254733 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:54:06.254733 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:54:06.254733 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:54:06.254733 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:54:06.254733 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:54:06.254733 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:54:06.254733 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:54:06.254733 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:54:06.254733 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:54:06.254733 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:54:06.254733 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:54:06.254733 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:54:06.254733 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:54:06.256713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:54:06.256713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:54:06.256713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:54:06.256713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:54:06.256713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:54:06.256713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:54:06.256713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:54:06.256713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:54:06.256713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:54:06.256713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:54:06.256713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:54:06.256713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:54:06.256713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:54:06.256713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:54:06.256713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:54:06.256713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:54:06.256713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:54:06.258609 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:54:06.258609 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:54:06.258609 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:54:06.258609 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:54:06.258609 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:54:06.258609 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:54:06.258609 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:54:06.258609 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:54:06.266829 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 612/1230] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:54:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:54:06.270676 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0e4df-66e5-4d88-8c1e-903d75d2b1d2 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:06.427241 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0e4df-66e5-4d88-8c1e-903d75d2b1d2 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:06.479493 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5687fa-a798-4f54-bca6-1dc075b370ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:06.480010 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5687fa-a798-4f54-bca6-1dc075b370ab None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:06.480292 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5687fa-a798-4f54-bca6-1dc075b370ab None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:06.481107 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5687fa-a798-4f54-bca6-1dc075b370ab None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:06.482154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5687fa-a798-4f54-bca6-1dc075b370ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:06.482522 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5687fa-a798-4f54-bca6-1dc075b370ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:06.484019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5687fa-a798-4f54-bca6-1dc075b370ab None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:06.499246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 619/1231] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:54:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:54:06.507107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35794ba-a5f2-44f6-8025-6004cc0d6ed3 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:06.605362 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:06.652207 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35794ba-a5f2-44f6-8025-6004cc0d6ed3 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:06.701028 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19992a7-e75e-41b9-bc34-3d3c87b37a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:06.702150 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19992a7-e75e-41b9-bc34-3d3c87b37a4c None admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:06.702727 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19992a7-e75e-41b9-bc34-3d3c87b37a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:06.703384 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19992a7-e75e-41b9-bc34-3d3c87b37a4c None admin] PATH_INFO: `/v3/projects/3f77fdd017ea4a9b9b49f6e87ba7f267/users/3d69004d02f9426b86e07907a553e523/roles/e476894ef72943f9b83d98d0704edfea` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:06.739447 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19992a7-e75e-41b9-bc34-3d3c87b37a4c None admin] RBAC: Authorizing `identity:create_grant(project_id=3f77fdd017ea4a9b9b49f6e87ba7f267, user_id=3d69004d02f9426b86e07907a553e523, role_id=e476894ef72943f9b83d98d0704edfea)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:06.742599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19992a7-e75e-41b9-bc34-3d3c87b37a4c None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:06.760594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 613/1232] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 08:54:06 2022] PUT /identity/v3/projects/3f77fdd017ea4a9b9b49f6e87ba7f267/users/3d69004d02f9426b86e07907a553e523/roles/e476894ef72943f9b83d98d0704edfea => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:54:09.144995 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756e3dc-73d4-4a31-9392-7775ce0a6697 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:09.145759 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756e3dc-73d4-4a31-9392-7775ce0a6697 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:09.145759 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756e3dc-73d4-4a31-9392-7775ce0a6697 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:09.147525 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 620/1233] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:54:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:54:09.154545 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370510ee-159e-4904-b330-d42ad3114b09 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:09.155148 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370510ee-159e-4904-b330-d42ad3114b09 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:09.155148 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370510ee-159e-4904-b330-d42ad3114b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:09.181409 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-370510ee-159e-4904-b330-d42ad3114b09 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:54:09.183241 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-370510ee-159e-4904-b330-d42ad3114b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:54:09.297016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 614/1234] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:54:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:54:09.323682 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756e3dc-73d4-4a31-9392-7775ce0a6697 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:09.368149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:09.485593 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756e3dc-73d4-4a31-9392-7775ce0a6697 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:09.531264 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0ce3f-eaff-4623-92d1-7cd285266791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:09.532039 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0ce3f-eaff-4623-92d1-7cd285266791 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:09.532326 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0ce3f-eaff-4623-92d1-7cd285266791 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:09.532680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0ce3f-eaff-4623-92d1-7cd285266791 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:09.546090 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0ce3f-eaff-4623-92d1-7cd285266791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:54:09.552469 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-08d0ce3f-eaff-4623-92d1-7cd285266791 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:54:09.552469 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:09.552469 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:54:09.552469 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:54:09.552469 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:54:09.552469 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:54:09.552469 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:54:09.552469 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:54:09.552469 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:54:09.552469 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:54:09.552469 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:54:09.552469 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:54:09.552469 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:54:09.552469 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:54:09.552469 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:54:09.552469 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:54:09.554016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:54:09.554016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:54:09.554016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:54:09.554016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:54:09.554016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:54:09.554016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:54:09.554016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:54:09.554016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:54:09.554016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:54:09.554016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:54:09.554016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:54:09.554016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:54:09.554016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:54:09.554016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:54:09.554016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:54:09.554016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:54:09.555504 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:54:09.555504 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:54:09.555504 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:54:09.555504 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:54:09.555504 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:54:09.555504 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:54:09.555504 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:54:09.555504 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:54:09.555504 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:54:09.555504 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:54:09.555504 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 08:54:09.555504 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:54:09.555504 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 621/1235] 10.222.0.65 () {56 vars in 1102 bytes} [Wed Jul 27 08:54:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:54:09.563628 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370510ee-159e-4904-b330-d42ad3114b09 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:09.637175 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:09.721276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370510ee-159e-4904-b330-d42ad3114b09 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:09.774421 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d31a01-93b7-41c2-8f23-69da5c7bb641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:09.775225 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d31a01-93b7-41c2-8f23-69da5c7bb641 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:09.775529 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d31a01-93b7-41c2-8f23-69da5c7bb641 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:09.775803 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d31a01-93b7-41c2-8f23-69da5c7bb641 None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:09.776579 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d31a01-93b7-41c2-8f23-69da5c7bb641 None admin] RBAC: Adding query filter params (name=service) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:09.776880 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d31a01-93b7-41c2-8f23-69da5c7bb641 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:09.779226 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d31a01-93b7-41c2-8f23-69da5c7bb641 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:09.789596 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 615/1236] 10.222.0.65 () {56 vars in 1103 bytes} [Wed Jul 27 08:54:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:54:09.796830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0ce3f-eaff-4623-92d1-7cd285266791 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:09.912050 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:09.940556 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0ce3f-eaff-4623-92d1-7cd285266791 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:09.982430 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3897bb-38c5-43dd-847c-8e1c326ac4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:09.983118 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3897bb-38c5-43dd-847c-8e1c326ac4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:09.983396 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3897bb-38c5-43dd-847c-8e1c326ac4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:09.983665 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3897bb-38c5-43dd-847c-8e1c326ac4f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:09.996199 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3897bb-38c5-43dd-847c-8e1c326ac4f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:09.997685 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3897bb-38c5-43dd-847c-8e1c326ac4f0 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:10.013133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-fd3897bb-38c5-43dd-847c-8e1c326ac4f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:54:10.013133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:10.013133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:54:10.013133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:54:10.013133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:54:10.013133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:54:10.013133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:54:10.013133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:54:10.013133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:54:10.013133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:54:10.013133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:54:10.013133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:54:10.013133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:54:10.013133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:54:10.013133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:54:10.015071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:54:10.015071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:54:10.015071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:54:10.015071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:54:10.015071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:54:10.015071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:54:10.015071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:54:10.015071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:54:10.015071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:54:10.015071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:54:10.015071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:54:10.015071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:54:10.015071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:54:10.015071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:54:10.015071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:54:10.015071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:54:10.015071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:54:10.017402 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:54:10.017402 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:54:10.017402 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:54:10.017402 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:54:10.019525 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 622/1237] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:54:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:54:10.020386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d31a01-93b7-41c2-8f23-69da5c7bb641 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:10.178346 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d31a01-93b7-41c2-8f23-69da5c7bb641 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:10.195623 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:10.240614 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732724b1-06a1-441b-ac92-6920b2635a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:10.241621 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732724b1-06a1-441b-ac92-6920b2635a5c None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:10.242133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732724b1-06a1-441b-ac92-6920b2635a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:10.242653 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732724b1-06a1-441b-ac92-6920b2635a5c None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:10.243902 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732724b1-06a1-441b-ac92-6920b2635a5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:10.244395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732724b1-06a1-441b-ac92-6920b2635a5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:10.246142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732724b1-06a1-441b-ac92-6920b2635a5c None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:10.267404 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 616/1238] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:54:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:54:10.274047 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3897bb-38c5-43dd-847c-8e1c326ac4f0 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:10.454405 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3897bb-38c5-43dd-847c-8e1c326ac4f0 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:10.511520 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad181f-784b-43c0-94a8-4dc8ef51005c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:10.513760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad181f-784b-43c0-94a8-4dc8ef51005c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:10.513760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad181f-784b-43c0-94a8-4dc8ef51005c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:10.514050 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad181f-784b-43c0-94a8-4dc8ef51005c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:10.519230 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:10.527987 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad181f-784b-43c0-94a8-4dc8ef51005c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:10.529960 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad181f-784b-43c0-94a8-4dc8ef51005c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:10.545553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-e2ad181f-784b-43c0-94a8-4dc8ef51005c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 08:54:10.545553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:10.545553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:54:10.545553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:54:10.545553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:54:10.545553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:54:10.545553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:54:10.545553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:54:10.545553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:54:10.545553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:54:10.545553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:54:10.545553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:54:10.545553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:54:10.545553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:54:10.545553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:54:10.545553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:54:10.547573 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:54:10.547573 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:54:10.547573 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:54:10.547573 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:54:10.547573 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:54:10.547573 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:54:10.547573 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:54:10.547573 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:54:10.547573 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:54:10.547573 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:54:10.547573 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:54:10.547573 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:54:10.547573 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:54:10.547573 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:54:10.547573 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:54:10.547573 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:54:10.547573 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:54:10.547573 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:54:10.548647 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:54:10.548647 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:54:10.548647 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:54:10.548647 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:54:10.548647 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:54:10.548647 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:54:10.548647 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:54:10.548647 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:54:10.548647 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 08:54:10.548647 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:54:10.548647 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 623/1239] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:54:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:54:10.555719 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732724b1-06a1-441b-ac92-6920b2635a5c None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:10.691956 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732724b1-06a1-441b-ac92-6920b2635a5c None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:10.752502 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860073aa-7e06-4d6e-b5db-eab103d0057b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:10.753376 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860073aa-7e06-4d6e-b5db-eab103d0057b None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:10.753818 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860073aa-7e06-4d6e-b5db-eab103d0057b None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:10.754253 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860073aa-7e06-4d6e-b5db-eab103d0057b None admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:10.755709 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860073aa-7e06-4d6e-b5db-eab103d0057b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:10.756277 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860073aa-7e06-4d6e-b5db-eab103d0057b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:10.759006 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860073aa-7e06-4d6e-b5db-eab103d0057b None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:10.787839 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 617/1240] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Jul 27 08:54:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:54:10.794993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad181f-784b-43c0-94a8-4dc8ef51005c None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:10.962616 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad181f-784b-43c0-94a8-4dc8ef51005c None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:11.019828 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1943c42-90f6-44df-be6f-b1d2dbbc51c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:11.020475 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1943c42-90f6-44df-be6f-b1d2dbbc51c2 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:11.020760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1943c42-90f6-44df-be6f-b1d2dbbc51c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:11.021035 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1943c42-90f6-44df-be6f-b1d2dbbc51c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:11.105977 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:11.117630 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1943c42-90f6-44df-be6f-b1d2dbbc51c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:11.120815 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1943c42-90f6-44df-be6f-b1d2dbbc51c2 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:11.261664 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 624/1241] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:54:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:54:11.268792 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860073aa-7e06-4d6e-b5db-eab103d0057b None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:11.312226 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:11.450349 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860073aa-7e06-4d6e-b5db-eab103d0057b None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:11.517137 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cedca6c-10ad-4b1a-bfd7-e072289f3507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:11.517842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedca6c-10ad-4b1a-bfd7-e072289f3507 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:11.518121 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedca6c-10ad-4b1a-bfd7-e072289f3507 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:11.518439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedca6c-10ad-4b1a-bfd7-e072289f3507 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:11.534229 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cedca6c-10ad-4b1a-bfd7-e072289f3507 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:11.536527 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cedca6c-10ad-4b1a-bfd7-e072289f3507 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:11.560392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-7cedca6c-10ad-4b1a-bfd7-e072289f3507 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:54:11.560392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:11.560392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:54:11.560392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:54:11.560392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:54:11.560392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:54:11.560392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:54:11.560392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:54:11.560392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:54:11.560392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:54:11.560392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:54:11.560392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:54:11.560392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:54:11.560392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:54:11.560392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:54:11.562180 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:54:11.562180 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:54:11.562180 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:54:11.562180 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:54:11.562180 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:54:11.562180 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:54:11.562180 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:54:11.562180 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:54:11.562180 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:54:11.562180 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:54:11.562180 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:54:11.562180 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:54:11.562180 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:54:11.562180 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:54:11.562180 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:54:11.562180 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:54:11.562180 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:54:11.564077 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:54:11.564077 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:54:11.564077 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:54:11.564077 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:54:11.564077 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 618/1242] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:54:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:54:11.569517 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1943c42-90f6-44df-be6f-b1d2dbbc51c2 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:11.710521 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:11.725109 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1943c42-90f6-44df-be6f-b1d2dbbc51c2 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:11.782765 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fcafb-f513-4dfe-9c06-aa2a92a08aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:11.783412 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fcafb-f513-4dfe-9c06-aa2a92a08aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:11.783734 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fcafb-f513-4dfe-9c06-aa2a92a08aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:11.784194 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fcafb-f513-4dfe-9c06-aa2a92a08aa5 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:11.785211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1fcafb-f513-4dfe-9c06-aa2a92a08aa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:11.785719 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1fcafb-f513-4dfe-9c06-aa2a92a08aa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:11.787790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1fcafb-f513-4dfe-9c06-aa2a92a08aa5 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:11.805309 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 625/1243] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:54:11.815371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cedca6c-10ad-4b1a-bfd7-e072289f3507 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:11.935855 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:11.969166 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cedca6c-10ad-4b1a-bfd7-e072289f3507 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:12.022940 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520be93-4210-4853-acb1-5714866db669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:12.024258 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520be93-4210-4853-acb1-5714866db669 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:12.024722 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520be93-4210-4853-acb1-5714866db669 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:12.025297 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520be93-4210-4853-acb1-5714866db669 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:12.034713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a520be93-4210-4853-acb1-5714866db669 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:12.036860 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a520be93-4210-4853-acb1-5714866db669 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:12.056036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-a520be93-4210-4853-acb1-5714866db669 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:54:12.056036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:12.056036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:54:12.056036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:54:12.056036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:54:12.056036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:54:12.056036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:54:12.056036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:54:12.056036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:54:12.056036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:54:12.056036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:54:12.056036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:54:12.056036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:54:12.056036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:54:12.056036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:54:12.064143 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:54:12.064143 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:54:12.064143 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:54:12.064143 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:54:12.064143 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:54:12.064143 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:54:12.064143 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:54:12.064143 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:54:12.064143 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:54:12.064143 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:54:12.064143 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:54:12.064143 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:54:12.064143 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:54:12.064143 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:54:12.064143 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:54:12.064143 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:54:12.064143 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:54:12.066542 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:54:12.066542 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:54:12.066542 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:54:12.066542 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:54:12.066542 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:54:12.066542 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:54:12.066542 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:54:12.066542 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:54:12.066542 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 619/1244] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:54:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:54:12.067774 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fcafb-f513-4dfe-9c06-aa2a92a08aa5 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:12.227397 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fcafb-f513-4dfe-9c06-aa2a92a08aa5 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:12.279736 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0184e-f977-4e2a-9d1c-8374b7dc6c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:12.280400 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0184e-f977-4e2a-9d1c-8374b7dc6c76 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:12.280732 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0184e-f977-4e2a-9d1c-8374b7dc6c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:12.281161 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0184e-f977-4e2a-9d1c-8374b7dc6c76 None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:12.281962 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0184e-f977-4e2a-9d1c-8374b7dc6c76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:12.282451 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0184e-f977-4e2a-9d1c-8374b7dc6c76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:12.284101 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0184e-f977-4e2a-9d1c-8374b7dc6c76 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:12.300631 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 626/1245] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:54:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:54:12.308598 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520be93-4210-4853-acb1-5714866db669 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:12.444886 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520be93-4210-4853-acb1-5714866db669 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:12.492766 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007d55e-20bf-450b-8631-06c8d37fc218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:12.493454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007d55e-20bf-450b-8631-06c8d37fc218 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:12.493767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007d55e-20bf-450b-8631-06c8d37fc218 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:12.494121 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007d55e-20bf-450b-8631-06c8d37fc218 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:12.494994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007d55e-20bf-450b-8631-06c8d37fc218 None admin] RBAC: Adding query filter params (role.id=e476894ef72943f9b83d98d0704edfea, scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267, user.id=3d69004d02f9426b86e07907a553e523) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:12.497175 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007d55e-20bf-450b-8631-06c8d37fc218 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:12.497402 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007d55e-20bf-450b-8631-06c8d37fc218 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:12.504932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 620/1246] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:54:12 2022] GET /identity/v3/role_assignments?user.id=3d69004d02f9426b86e07907a553e523&scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267&role.id=e476894ef72943f9b83d98d0704edfea => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:54:14.851163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18cda0-5d60-4b8b-a8c1-bca11adf86e6 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:14.851780 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18cda0-5d60-4b8b-a8c1-bca11adf86e6 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:14.851992 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18cda0-5d60-4b8b-a8c1-bca11adf86e6 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:14.854281 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 627/1247] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:54:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:54:14.864372 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70296c4d-c2f0-40f3-89f0-8f55dd495179 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:14.864947 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70296c4d-c2f0-40f3-89f0-8f55dd495179 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:14.865109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70296c4d-c2f0-40f3-89f0-8f55dd495179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:14.874170 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:14.893551 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-70296c4d-c2f0-40f3-89f0-8f55dd495179 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:54:14.895278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-70296c4d-c2f0-40f3-89f0-8f55dd495179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:54:15.015172 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 621/1248] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:54:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:54:15.039952 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18cda0-5d60-4b8b-a8c1-bca11adf86e6 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:15.066786 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:15.189399 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18cda0-5d60-4b8b-a8c1-bca11adf86e6 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:15.234054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e436f-02c8-434e-9714-8691bdd70c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:15.234835 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e436f-02c8-434e-9714-8691bdd70c51 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:15.235116 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e436f-02c8-434e-9714-8691bdd70c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:15.235382 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e436f-02c8-434e-9714-8691bdd70c51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:15.251517 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e436f-02c8-434e-9714-8691bdd70c51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:54:15.258629 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-891e436f-02c8-434e-9714-8691bdd70c51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:54:15.258629 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:15.258629 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:54:15.258629 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:54:15.258629 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:54:15.258629 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:54:15.258629 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:54:15.258629 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:54:15.258629 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:54:15.258629 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:54:15.258629 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:54:15.258629 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:54:15.258629 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:54:15.258629 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:54:15.258629 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:54:15.258629 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:54:15.260613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:54:15.260613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:54:15.260613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:54:15.260613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:54:15.260613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:54:15.260613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:54:15.260613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:54:15.260613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:54:15.260613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:54:15.260613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:54:15.260613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:54:15.260613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:54:15.260613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:54:15.260613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:54:15.260613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:54:15.260613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:54:15.269091 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:54:15.269091 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:54:15.269091 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:54:15.269091 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:54:15.269091 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:54:15.269091 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:54:15.269091 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:54:15.269091 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:54:15.269091 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:54:15.269091 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:54:15.269091 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:54:15.269091 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:54:15.269091 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 628/1249] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:54:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:54:15.270509 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70296c4d-c2f0-40f3-89f0-8f55dd495179 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:15.421979 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70296c4d-c2f0-40f3-89f0-8f55dd495179 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:15.474655 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:15.483688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a0d7e-2a32-4516-ba4c-1595f9447fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:15.484326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a0d7e-2a32-4516-ba4c-1595f9447fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:15.485167 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a0d7e-2a32-4516-ba4c-1595f9447fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:15.485167 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a0d7e-2a32-4516-ba4c-1595f9447fd4 None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:15.486392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a0d7e-2a32-4516-ba4c-1595f9447fd4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:15.486624 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a0d7e-2a32-4516-ba4c-1595f9447fd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:15.488179 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a0d7e-2a32-4516-ba4c-1595f9447fd4 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:15.500787 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 622/1250] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:54:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:54:15.506649 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e436f-02c8-434e-9714-8691bdd70c51 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:15.613653 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:15.641412 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e436f-02c8-434e-9714-8691bdd70c51 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:15.694148 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856f605-8f8b-4883-baca-ad1e6b7d2d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:15.695525 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856f605-8f8b-4883-baca-ad1e6b7d2d7d None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:15.696002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856f605-8f8b-4883-baca-ad1e6b7d2d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:15.696424 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856f605-8f8b-4883-baca-ad1e6b7d2d7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:15.717644 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856f605-8f8b-4883-baca-ad1e6b7d2d7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:15.720076 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856f605-8f8b-4883-baca-ad1e6b7d2d7d None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:15.747497 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-9856f605-8f8b-4883-baca-ad1e6b7d2d7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:54:15.747497 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:15.747497 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:54:15.747497 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:54:15.747497 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:54:15.747497 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:54:15.747497 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:54:15.747497 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:54:15.747497 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:54:15.747497 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:54:15.747497 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:54:15.747497 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:54:15.747497 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:54:15.747497 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:54:15.747497 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:54:15.749738 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:54:15.749738 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:54:15.749738 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:54:15.749738 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:54:15.749738 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:54:15.749738 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:54:15.749738 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:54:15.749738 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:54:15.749738 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:54:15.749738 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:54:15.749738 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:54:15.749738 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:54:15.749738 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:54:15.749738 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:54:15.749738 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:54:15.749738 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:54:15.749738 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:54:15.751136 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:54:15.751136 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:54:15.751136 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:54:15.751136 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:54:15.751136 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 629/1251] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:54:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:54:15.756118 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a0d7e-2a32-4516-ba4c-1595f9447fd4 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:15.915137 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a0d7e-2a32-4516-ba4c-1595f9447fd4 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:15.964074 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d9186-0d23-4807-a2b1-d363b3842b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:15.964624 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d9186-0d23-4807-a2b1-d363b3842b2b None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:15.964905 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d9186-0d23-4807-a2b1-d363b3842b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:15.965725 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d9186-0d23-4807-a2b1-d363b3842b2b None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:15.967073 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d9186-0d23-4807-a2b1-d363b3842b2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:15.967426 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d9186-0d23-4807-a2b1-d363b3842b2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:15.969195 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d9186-0d23-4807-a2b1-d363b3842b2b None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:15.986576 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 623/1252] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:54:15.993035 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856f605-8f8b-4883-baca-ad1e6b7d2d7d None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:16.170692 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856f605-8f8b-4883-baca-ad1e6b7d2d7d None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:16.216411 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:16.226647 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c6aef-5187-4dab-a153-34c760b2743a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:16.227359 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c6aef-5187-4dab-a153-34c760b2743a None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:16.227638 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c6aef-5187-4dab-a153-34c760b2743a None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:16.227909 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c6aef-5187-4dab-a153-34c760b2743a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:16.238163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c6aef-5187-4dab-a153-34c760b2743a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:16.239732 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c6aef-5187-4dab-a153-34c760b2743a None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:16.254735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-3e9c6aef-5187-4dab-a153-34c760b2743a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 08:54:16.254735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:16.254735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:54:16.254735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:54:16.254735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:54:16.254735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:54:16.254735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:54:16.254735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:54:16.254735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:54:16.254735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:54:16.254735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:54:16.254735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:54:16.254735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:54:16.254735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:54:16.254735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:54:16.254735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:54:16.260333 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:54:16.260333 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:54:16.260333 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:54:16.260333 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:54:16.260333 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:54:16.260333 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:54:16.260333 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:54:16.260333 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:54:16.260333 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:54:16.260333 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:54:16.260333 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:54:16.260333 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:54:16.260333 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:54:16.260333 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:54:16.260333 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:54:16.260333 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:54:16.260333 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:54:16.260333 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:54:16.261775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:54:16.261775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:54:16.261775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:54:16.261775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:54:16.261775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:54:16.261775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:54:16.261775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:54:16.261775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:54:16.261775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 08:54:16.261775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:54:16.261775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 630/1253] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:54:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:54:16.266796 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d9186-0d23-4807-a2b1-d363b3842b2b None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:16.350108 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:16.420852 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d9186-0d23-4807-a2b1-d363b3842b2b None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:16.479972 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d8f5e-ee71-44ca-9655-066b913bdf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:16.481508 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d8f5e-ee71-44ca-9655-066b913bdf78 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:16.481996 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d8f5e-ee71-44ca-9655-066b913bdf78 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:16.482462 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d8f5e-ee71-44ca-9655-066b913bdf78 None admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:16.483391 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d8f5e-ee71-44ca-9655-066b913bdf78 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:16.483766 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d8f5e-ee71-44ca-9655-066b913bdf78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:16.485790 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d8f5e-ee71-44ca-9655-066b913bdf78 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:16.511290 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 624/1254] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Jul 27 08:54:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:54:16.517993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c6aef-5187-4dab-a153-34c760b2743a None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:16.657164 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c6aef-5187-4dab-a153-34c760b2743a None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:16.712268 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe433e-dbcb-49a7-bb3c-1a52e004541f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:16.712953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe433e-dbcb-49a7-bb3c-1a52e004541f None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:16.713193 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe433e-dbcb-49a7-bb3c-1a52e004541f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:16.713582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe433e-dbcb-49a7-bb3c-1a52e004541f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:16.785683 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:16.799957 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe433e-dbcb-49a7-bb3c-1a52e004541f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:16.801594 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe433e-dbcb-49a7-bb3c-1a52e004541f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:16.945769 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 631/1255] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:54:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 08:54:16.955894 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d8f5e-ee71-44ca-9655-066b913bdf78 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:17.090278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d8f5e-ee71-44ca-9655-066b913bdf78 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:17.112493 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:17.146183 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7be5e6-594c-4beb-a284-7b7aaf569d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:17.146991 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7be5e6-594c-4beb-a284-7b7aaf569d04 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:17.147267 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7be5e6-594c-4beb-a284-7b7aaf569d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:17.147545 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7be5e6-594c-4beb-a284-7b7aaf569d04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:17.160650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7be5e6-594c-4beb-a284-7b7aaf569d04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:17.162512 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7be5e6-594c-4beb-a284-7b7aaf569d04 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:17.180424 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-dc7be5e6-594c-4beb-a284-7b7aaf569d04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:54:17.180424 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:17.180424 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:54:17.180424 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:54:17.180424 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:54:17.180424 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:54:17.180424 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:54:17.180424 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:54:17.180424 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:54:17.180424 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:54:17.180424 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:54:17.180424 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:54:17.180424 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:54:17.180424 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:54:17.180424 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:54:17.182531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:54:17.182531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:54:17.182531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:54:17.182531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:54:17.182531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:54:17.182531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:54:17.182531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:54:17.182531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:54:17.182531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:54:17.182531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:54:17.182531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:54:17.182531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:54:17.182531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:54:17.182531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:54:17.182531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:54:17.182531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:54:17.182531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:54:17.184981 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:54:17.184981 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:54:17.184981 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:54:17.184981 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:54:17.184981 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 625/1256] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:54:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:54:17.189551 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe433e-dbcb-49a7-bb3c-1a52e004541f None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:17.300027 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:17.314365 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe433e-dbcb-49a7-bb3c-1a52e004541f None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:17.359117 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9798c-9d30-4ab2-b0e9-91146f5cc46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:17.360096 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9798c-9d30-4ab2-b0e9-91146f5cc46b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:17.360974 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9798c-9d30-4ab2-b0e9-91146f5cc46b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:17.361259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9798c-9d30-4ab2-b0e9-91146f5cc46b None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:17.362473 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9798c-9d30-4ab2-b0e9-91146f5cc46b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:17.363152 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9798c-9d30-4ab2-b0e9-91146f5cc46b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:17.366069 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9798c-9d30-4ab2-b0e9-91146f5cc46b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:17.381758 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 632/1257] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:54:17.389995 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7be5e6-594c-4beb-a284-7b7aaf569d04 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:17.522108 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7be5e6-594c-4beb-a284-7b7aaf569d04 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:17.573202 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c617d4-5e8c-442e-a291-08880b51724d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:17.574045 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c617d4-5e8c-442e-a291-08880b51724d None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:17.575079 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c617d4-5e8c-442e-a291-08880b51724d None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:17.575378 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c617d4-5e8c-442e-a291-08880b51724d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:17.584634 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c617d4-5e8c-442e-a291-08880b51724d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:17.586214 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c617d4-5e8c-442e-a291-08880b51724d None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:17.606262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-78c617d4-5e8c-442e-a291-08880b51724d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:54:17.606262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:17.606262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:54:17.606262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:54:17.606262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:54:17.606262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:54:17.606262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:54:17.606262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:54:17.606262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:54:17.606262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:54:17.606262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:54:17.606262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:54:17.606262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:54:17.606262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:54:17.606262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:54:17.607659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:54:17.607659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:54:17.607659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:54:17.607659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:54:17.607659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:54:17.607659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:54:17.607659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:54:17.607659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:54:17.607659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:54:17.607659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:54:17.607659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:54:17.607659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:54:17.607659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:54:17.607659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:54:17.607659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:54:17.607659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:54:17.607659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:54:17.608742 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:54:17.608742 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:54:17.608742 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:54:17.608742 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:54:17.608742 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:54:17.608742 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:54:17.608742 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:54:17.608742 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:54:17.614195 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 626/1258] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:54:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:54:17.615682 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9798c-9d30-4ab2-b0e9-91146f5cc46b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:17.749824 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9798c-9d30-4ab2-b0e9-91146f5cc46b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:17.790406 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10605f-e616-4ae8-b830-f8708a5a136c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:17.790903 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10605f-e616-4ae8-b830-f8708a5a136c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:17.791181 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10605f-e616-4ae8-b830-f8708a5a136c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:17.791451 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10605f-e616-4ae8-b830-f8708a5a136c None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:17.792199 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10605f-e616-4ae8-b830-f8708a5a136c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:17.792500 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10605f-e616-4ae8-b830-f8708a5a136c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:17.794337 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10605f-e616-4ae8-b830-f8708a5a136c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:17.807630 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 633/1259] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:54:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:54:17.817400 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c617d4-5e8c-442e-a291-08880b51724d None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:17.852626 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:17.960647 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c617d4-5e8c-442e-a291-08880b51724d None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:18.010713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03c29f-d403-475c-999f-52dc3ff633f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:18.011541 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03c29f-d403-475c-999f-52dc3ff633f8 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:18.011870 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03c29f-d403-475c-999f-52dc3ff633f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:18.012312 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03c29f-d403-475c-999f-52dc3ff633f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:18.013190 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03c29f-d403-475c-999f-52dc3ff633f8 None admin] RBAC: Adding query filter params (role.id=20bc872844094480b9dca67a25b69e84, scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267, user.id=3d69004d02f9426b86e07907a553e523) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:18.013537 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03c29f-d403-475c-999f-52dc3ff633f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:18.015417 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03c29f-d403-475c-999f-52dc3ff633f8 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:18.031858 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 627/1260] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:54:17 2022] GET /identity/v3/role_assignments?user.id=3d69004d02f9426b86e07907a553e523&scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267&role.id=20bc872844094480b9dca67a25b69e84 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:54:20.293213 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77be17-1fb4-4bfe-bd30-c219de9c1b02 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:20.293786 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77be17-1fb4-4bfe-bd30-c219de9c1b02 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:20.293786 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77be17-1fb4-4bfe-bd30-c219de9c1b02 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:20.295187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 634/1261] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:54:20.302175 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43425e1-dee5-4696-ac40-6d3122c15170 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:20.302749 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43425e1-dee5-4696-ac40-6d3122c15170 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:20.302749 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43425e1-dee5-4696-ac40-6d3122c15170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:20.322277 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-e43425e1-dee5-4696-ac40-6d3122c15170 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:54:20.323521 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-e43425e1-dee5-4696-ac40-6d3122c15170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:54:20.400606 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 628/1262] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:54:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:54:20.423780 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77be17-1fb4-4bfe-bd30-c219de9c1b02 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:20.439619 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:20.539660 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77be17-1fb4-4bfe-bd30-c219de9c1b02 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:20.577480 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc075e-2a93-4030-b142-4877781aab6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:20.578160 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc075e-2a93-4030-b142-4877781aab6d None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:20.578464 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc075e-2a93-4030-b142-4877781aab6d None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:20.578807 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc075e-2a93-4030-b142-4877781aab6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:20.590437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc075e-2a93-4030-b142-4877781aab6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:54:20.595994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-67bc075e-2a93-4030-b142-4877781aab6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:54:20.595994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:20.595994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:54:20.595994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:54:20.595994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:54:20.595994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:54:20.595994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:54:20.595994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:54:20.595994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:54:20.595994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:54:20.595994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:54:20.595994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:54:20.595994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:54:20.595994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:54:20.595994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:54:20.595994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:54:20.597227 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:54:20.597227 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:54:20.597227 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:54:20.597227 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:54:20.597227 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:54:20.597227 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:54:20.597227 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:54:20.597227 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:54:20.597227 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:54:20.597227 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:54:20.597227 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:54:20.597227 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:54:20.597227 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:54:20.597227 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:54:20.597227 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:54:20.597227 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:54:20.598248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:54:20.598248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:54:20.598248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:54:20.598248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:54:20.598248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:54:20.598248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:54:20.598248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:54:20.598248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:54:20.598248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:54:20.598248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:54:20.598248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:54:20.598248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:54:20.598248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 635/1263] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:54:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:54:20.603642 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43425e1-dee5-4696-ac40-6d3122c15170 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:20.625029 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:20.727074 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43425e1-dee5-4696-ac40-6d3122c15170 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:20.775407 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82105a4b-4ace-4acf-a05d-374a522caea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:20.776021 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82105a4b-4ace-4acf-a05d-374a522caea6 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:20.776295 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82105a4b-4ace-4acf-a05d-374a522caea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:20.776562 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82105a4b-4ace-4acf-a05d-374a522caea6 None admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:20.777278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82105a4b-4ace-4acf-a05d-374a522caea6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:20.777576 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82105a4b-4ace-4acf-a05d-374a522caea6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:20.779060 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82105a4b-4ace-4acf-a05d-374a522caea6 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:20.787955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 629/1264] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:54:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:54:20.794820 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc075e-2a93-4030-b142-4877781aab6d None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:20.865310 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:20.899559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc075e-2a93-4030-b142-4877781aab6d None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:20.938072 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd5f81-fa85-4302-9649-ffe3b63ca481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:20.938797 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd5f81-fa85-4302-9649-ffe3b63ca481 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:20.939085 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd5f81-fa85-4302-9649-ffe3b63ca481 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:20.939396 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd5f81-fa85-4302-9649-ffe3b63ca481 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:20.950862 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd5f81-fa85-4302-9649-ffe3b63ca481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:20.952324 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd5f81-fa85-4302-9649-ffe3b63ca481 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:20.968610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-2cfd5f81-fa85-4302-9649-ffe3b63ca481 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:54:20.968610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:20.968610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:54:20.968610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:54:20.968610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:54:20.968610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:54:20.968610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:54:20.968610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:54:20.968610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:54:20.968610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:54:20.968610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:54:20.968610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:54:20.968610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:54:20.968610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:54:20.968610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:54:20.969789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:54:20.969789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:54:20.969789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:54:20.969789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:54:20.969789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:54:20.969789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:54:20.969789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:54:20.969789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:54:20.969789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:54:20.969789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:54:20.969789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:54:20.969789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:54:20.969789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:54:20.969789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:54:20.969789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:54:20.969789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:54:20.969789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:54:20.975478 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:54:20.975478 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:54:20.975478 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:54:20.975478 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:54:20.975478 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 636/1265] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:54:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:54:20.976601 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82105a4b-4ace-4acf-a05d-374a522caea6 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:21.091807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:21.120482 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82105a4b-4ace-4acf-a05d-374a522caea6 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:21.166462 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d33720-1b85-481b-8b86-fed167e9c467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:21.167124 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d33720-1b85-481b-8b86-fed167e9c467 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:21.167416 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d33720-1b85-481b-8b86-fed167e9c467 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:21.167675 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d33720-1b85-481b-8b86-fed167e9c467 None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:21.169071 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d33720-1b85-481b-8b86-fed167e9c467 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:21.169432 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d33720-1b85-481b-8b86-fed167e9c467 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:21.170920 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d33720-1b85-481b-8b86-fed167e9c467 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:21.185756 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 630/1266] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:54:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:54:21.191799 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd5f81-fa85-4302-9649-ffe3b63ca481 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:21.313635 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd5f81-fa85-4302-9649-ffe3b63ca481 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:21.335402 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:21.353643 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234cad8-c44e-4328-85de-0202d61a4dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:21.354178 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234cad8-c44e-4328-85de-0202d61a4dab None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:21.354488 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234cad8-c44e-4328-85de-0202d61a4dab None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:21.354767 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234cad8-c44e-4328-85de-0202d61a4dab None admin] PATH_INFO: `/v3/users/placement` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:21.363515 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234cad8-c44e-4328-85de-0202d61a4dab None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:21.364979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234cad8-c44e-4328-85de-0202d61a4dab None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:21.376862 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-4234cad8-c44e-4328-85de-0202d61a4dab None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 08:54:21.376862 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:21.376862 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:54:21.376862 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:54:21.376862 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:54:21.376862 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:54:21.376862 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:54:21.376862 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:54:21.376862 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:54:21.376862 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:54:21.376862 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:54:21.376862 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:54:21.376862 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:54:21.376862 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:54:21.376862 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:54:21.376862 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:54:21.378124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:54:21.378124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:54:21.378124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:54:21.378124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:54:21.378124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:54:21.378124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:54:21.378124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:54:21.378124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:54:21.378124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:54:21.378124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:54:21.378124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:54:21.378124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:54:21.378124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:54:21.378124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:54:21.378124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:54:21.378124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:54:21.378124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:54:21.378124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:54:21.379578 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:54:21.379578 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:54:21.379578 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:54:21.379578 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:54:21.379578 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:54:21.379578 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:54:21.379578 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:54:21.379578 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:54:21.379578 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 08:54:21.379578 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:54:21.379578 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 637/1267] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:54:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 08:54:21.384081 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d33720-1b85-481b-8b86-fed167e9c467 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:21.504136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d33720-1b85-481b-8b86-fed167e9c467 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:21.540933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869c85f-9402-40fc-bb97-40e808f5e927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:21.541547 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869c85f-9402-40fc-bb97-40e808f5e927 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:21.541844 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869c85f-9402-40fc-bb97-40e808f5e927 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:21.542125 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869c85f-9402-40fc-bb97-40e808f5e927 None admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:21.543006 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869c85f-9402-40fc-bb97-40e808f5e927 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:21.543368 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869c85f-9402-40fc-bb97-40e808f5e927 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:21.545169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869c85f-9402-40fc-bb97-40e808f5e927 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:21.555203 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:21.564546 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 631/1268] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Jul 27 08:54:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:54:21.572459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234cad8-c44e-4328-85de-0202d61a4dab None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:21.689219 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234cad8-c44e-4328-85de-0202d61a4dab None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:21.734138 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7fd86-8240-4e7b-ab19-0b97e030ebea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:21.734877 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7fd86-8240-4e7b-ab19-0b97e030ebea None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:21.735193 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7fd86-8240-4e7b-ab19-0b97e030ebea None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:21.735472 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7fd86-8240-4e7b-ab19-0b97e030ebea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:21.750432 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7fd86-8240-4e7b-ab19-0b97e030ebea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:21.752106 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7fd86-8240-4e7b-ab19-0b97e030ebea None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:21.770707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-25e7fd86-8240-4e7b-ab19-0b97e030ebea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:54:21.770707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:21.770707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:54:21.770707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:54:21.770707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:54:21.770707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:54:21.770707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:54:21.770707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:54:21.770707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:54:21.770707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:54:21.770707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:54:21.770707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:54:21.770707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:54:21.770707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:54:21.770707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:54:21.771879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:54:21.771879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:54:21.771879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:54:21.771879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:54:21.771879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:54:21.771879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:54:21.771879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:54:21.771879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:54:21.771879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:54:21.771879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:54:21.771879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:54:21.771879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:54:21.771879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:54:21.771879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:54:21.771879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:54:21.771879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:54:21.771879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:54:21.773028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:54:21.773028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:54:21.773028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:54:21.773028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:54:21.773028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 638/1269] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:54:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:54:21.777957 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869c85f-9402-40fc-bb97-40e808f5e927 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:21.884520 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869c85f-9402-40fc-bb97-40e808f5e927 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:21.921976 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e9cc4-dd93-4318-a370-b8681daa9ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:21.922641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e9cc4-dd93-4318-a370-b8681daa9ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:21.922921 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e9cc4-dd93-4318-a370-b8681daa9ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:21.923269 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e9cc4-dd93-4318-a370-b8681daa9ce2 None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:21.923964 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e9cc4-dd93-4318-a370-b8681daa9ce2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:21.924266 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e9cc4-dd93-4318-a370-b8681daa9ce2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:21.925630 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e9cc4-dd93-4318-a370-b8681daa9ce2 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:21.938023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 632/1270] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:54:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:54:21.944045 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7fd86-8240-4e7b-ab19-0b97e030ebea None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:21.982751 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:22.063824 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7fd86-8240-4e7b-ab19-0b97e030ebea None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:22.099005 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5ce17-22c0-4807-896d-790754acdf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:22.099646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5ce17-22c0-4807-896d-790754acdf98 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:22.099921 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5ce17-22c0-4807-896d-790754acdf98 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:22.100190 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5ce17-22c0-4807-896d-790754acdf98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:22.108220 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5ce17-22c0-4807-896d-790754acdf98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:22.110385 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5ce17-22c0-4807-896d-790754acdf98 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:22.127208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-69f5ce17-22c0-4807-896d-790754acdf98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:54:22.127208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:22.127208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:54:22.127208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:54:22.127208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:54:22.127208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:54:22.127208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:54:22.127208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:54:22.127208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:54:22.127208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:54:22.127208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:54:22.127208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:54:22.127208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:54:22.127208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:54:22.127208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:54:22.128332 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:54:22.128332 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:54:22.128332 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:54:22.128332 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:54:22.128332 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:54:22.128332 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:54:22.128332 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:54:22.128332 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:54:22.128332 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:54:22.128332 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:54:22.128332 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:54:22.128332 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:54:22.128332 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:54:22.128332 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:54:22.128332 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:54:22.128332 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:54:22.128332 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:54:22.129501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:54:22.129501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:54:22.129501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:54:22.129501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:54:22.129501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:54:22.129501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:54:22.129501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:54:22.129501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:54:22.129501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 639/1271] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:54:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:54:22.134995 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e9cc4-dd93-4318-a370-b8681daa9ce2 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:22.202379 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:22.255617 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e9cc4-dd93-4318-a370-b8681daa9ce2 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:22.298939 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce8b51-090e-4e62-8780-ecec52b4f74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:22.299562 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce8b51-090e-4e62-8780-ecec52b4f74c None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:22.299873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce8b51-090e-4e62-8780-ecec52b4f74c None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:22.300279 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce8b51-090e-4e62-8780-ecec52b4f74c None admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:22.301185 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce8b51-090e-4e62-8780-ecec52b4f74c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:22.301499 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce8b51-090e-4e62-8780-ecec52b4f74c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:22.303142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce8b51-090e-4e62-8780-ecec52b4f74c None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:22.317060 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 633/1272] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:54:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:54:22.323126 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5ce17-22c0-4807-896d-790754acdf98 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:22.429905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:22.440445 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5ce17-22c0-4807-896d-790754acdf98 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:22.478978 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46750326-f836-4da7-b6d3-24fbed3dabac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:22.479573 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46750326-f836-4da7-b6d3-24fbed3dabac None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:22.480001 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46750326-f836-4da7-b6d3-24fbed3dabac None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:22.480296 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46750326-f836-4da7-b6d3-24fbed3dabac None admin] PATH_INFO: `/v3/projects/3f77fdd017ea4a9b9b49f6e87ba7f267/users/3d69004d02f9426b86e07907a553e523/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:22.482612 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46750326-f836-4da7-b6d3-24fbed3dabac None admin] RBAC: Authorizing `identity:create_grant(project_id=3f77fdd017ea4a9b9b49f6e87ba7f267, user_id=3d69004d02f9426b86e07907a553e523, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:22.484077 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46750326-f836-4da7-b6d3-24fbed3dabac None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:22.499807 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 640/1273] 10.222.0.65 () {58 vars in 1439 bytes} [Wed Jul 27 08:54:22 2022] PUT /identity/v3/projects/3f77fdd017ea4a9b9b49f6e87ba7f267/users/3d69004d02f9426b86e07907a553e523/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 08:54:24.685531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe7c39-cf0c-4282-a2bf-084bc24c98ed None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:24.686377 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe7c39-cf0c-4282-a2bf-084bc24c98ed None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:24.686377 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe7c39-cf0c-4282-a2bf-084bc24c98ed None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:24.687582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 634/1274] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:54:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:54:24.696196 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7789f90-0dc0-41cc-88e7-633c20ecdabe None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:24.696712 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7789f90-0dc0-41cc-88e7-633c20ecdabe None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:24.696814 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7789f90-0dc0-41cc-88e7-633c20ecdabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:24.723233 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f7789f90-0dc0-41cc-88e7-633c20ecdabe None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:54:24.724853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f7789f90-0dc0-41cc-88e7-633c20ecdabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:54:24.826294 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 641/1275] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:54:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:54:24.851185 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe7c39-cf0c-4282-a2bf-084bc24c98ed None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:24.971913 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe7c39-cf0c-4282-a2bf-084bc24c98ed None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:24.991983 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:25.010985 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044eaae-6a55-40dd-a50b-987032dbd41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:25.011628 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044eaae-6a55-40dd-a50b-987032dbd41f None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:25.012014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044eaae-6a55-40dd-a50b-987032dbd41f None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:25.012858 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044eaae-6a55-40dd-a50b-987032dbd41f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:25.024256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044eaae-6a55-40dd-a50b-987032dbd41f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 08:54:25.029537 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-b044eaae-6a55-40dd-a50b-987032dbd41f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:54:25.029537 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:25.029537 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:54:25.029537 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:54:25.029537 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:54:25.029537 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:54:25.029537 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:54:25.029537 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:54:25.029537 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:54:25.029537 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:54:25.029537 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:54:25.029537 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:54:25.029537 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 08:54:25.029537 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 08:54:25.029537 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 08:54:25.029537 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 08:54:25.030758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 08:54:25.030758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 08:54:25.030758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 08:54:25.030758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 08:54:25.030758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:54:25.030758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:54:25.030758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:54:25.030758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:54:25.030758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:54:25.030758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:54:25.030758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:54:25.030758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:54:25.030758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:54:25.030758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:54:25.030758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:54:25.030758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:54:25.032019 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:54:25.032019 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:54:25.032019 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:54:25.032019 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:54:25.032019 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 08:54:25.032019 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 08:54:25.032019 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 08:54:25.032019 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 08:54:25.032019 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 08:54:25.032019 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 08:54:25.032019 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 08:54:25.032019 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:54:25.032019 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 635/1276] 10.222.0.65 () {56 vars in 1096 bytes} [Wed Jul 27 08:54:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:54:25.037487 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7789f90-0dc0-41cc-88e7-633c20ecdabe None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:25.139007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:25.164105 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7789f90-0dc0-41cc-88e7-633c20ecdabe None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:25.202845 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363e516-455c-4843-9c41-ce1c67a84944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:25.203468 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363e516-455c-4843-9c41-ce1c67a84944 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:25.203746 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363e516-455c-4843-9c41-ce1c67a84944 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:25.204014 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363e516-455c-4843-9c41-ce1c67a84944 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:25.204734 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363e516-455c-4843-9c41-ce1c67a84944 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:25.205033 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363e516-455c-4843-9c41-ce1c67a84944 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:25.206423 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363e516-455c-4843-9c41-ce1c67a84944 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:25.215997 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 642/1277] 10.222.0.65 () {56 vars in 1099 bytes} [Wed Jul 27 08:54:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:54:25.222113 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044eaae-6a55-40dd-a50b-987032dbd41f None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:25.339067 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044eaae-6a55-40dd-a50b-987032dbd41f None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:25.378040 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469367c3-0703-490e-9ba9-a24f2e62d1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:25.378710 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469367c3-0703-490e-9ba9-a24f2e62d1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:25.379011 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469367c3-0703-490e-9ba9-a24f2e62d1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:25.379285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469367c3-0703-490e-9ba9-a24f2e62d1a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:25.390817 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469367c3-0703-490e-9ba9-a24f2e62d1a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:25.392391 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469367c3-0703-490e-9ba9-a24f2e62d1a5 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:25.408173 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-469367c3-0703-490e-9ba9-a24f2e62d1a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:54:25.408173 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:25.408173 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:54:25.408173 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:54:25.408173 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:54:25.408173 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:54:25.408173 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:54:25.408173 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:54:25.408173 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:54:25.408173 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:54:25.408173 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:54:25.408173 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:54:25.408173 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:54:25.408173 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:54:25.408173 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:54:25.409369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:54:25.409369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:54:25.409369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:54:25.409369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:54:25.409369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:54:25.409369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:54:25.409369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:54:25.409369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:54:25.409369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:54:25.409369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:54:25.409369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:54:25.409369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:54:25.409369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:54:25.409369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:54:25.409369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:54:25.409369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:54:25.409369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:54:25.410597 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:54:25.410597 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:54:25.410597 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:54:25.410597 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:54:25.410597 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 636/1278] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:54:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:54:25.416184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363e516-455c-4843-9c41-ce1c67a84944 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:25.540435 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363e516-455c-4843-9c41-ce1c67a84944 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:25.580755 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf1d07-3693-42bb-a4d3-affbc38e2ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:25.581553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf1d07-3693-42bb-a4d3-affbc38e2ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:25.581836 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf1d07-3693-42bb-a4d3-affbc38e2ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:25.582112 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf1d07-3693-42bb-a4d3-affbc38e2ec7 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:25.583002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf1d07-3693-42bb-a4d3-affbc38e2ec7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:25.583351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf1d07-3693-42bb-a4d3-affbc38e2ec7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:25.585001 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf1d07-3693-42bb-a4d3-affbc38e2ec7 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:25.599418 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 643/1279] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:54:25.605885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469367c3-0703-490e-9ba9-a24f2e62d1a5 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:25.640264 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:25.726763 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469367c3-0703-490e-9ba9-a24f2e62d1a5 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:25.771065 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c666f1c-6ec7-4c55-b41f-f98326a4fd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:25.771728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c666f1c-6ec7-4c55-b41f-f98326a4fd6f None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:25.772011 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c666f1c-6ec7-4c55-b41f-f98326a4fd6f None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:25.772285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c666f1c-6ec7-4c55-b41f-f98326a4fd6f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:25.782076 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c666f1c-6ec7-4c55-b41f-f98326a4fd6f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:25.783710 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c666f1c-6ec7-4c55-b41f-f98326a4fd6f None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:25.799439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-8c666f1c-6ec7-4c55-b41f-f98326a4fd6f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 08:54:25.799439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:25.799439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:54:25.799439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:54:25.799439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:54:25.799439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:54:25.799439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:54:25.799439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:54:25.799439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:54:25.799439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:54:25.799439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:54:25.799439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:54:25.799439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 08:54:25.799439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 08:54:25.799439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 08:54:25.799439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 08:54:25.800632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:54:25.800632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:54:25.800632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 08:54:25.800632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:54:25.800632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 08:54:25.800632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 08:54:25.800632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:54:25.800632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:54:25.800632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:54:25.800632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:54:25.800632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:54:25.800632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:54:25.800632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:54:25.800632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:54:25.800632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:54:25.800632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:54:25.800632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:54:25.800632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:54:25.801911 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:54:25.801911 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:54:25.801911 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 08:54:25.801911 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 08:54:25.801911 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 08:54:25.801911 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 08:54:25.801911 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 08:54:25.801911 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 08:54:25.801911 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 08:54:25.801911 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:54:25.801911 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 637/1280] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:54:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:54:25.807096 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf1d07-3693-42bb-a4d3-affbc38e2ec7 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:25.811520 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:25.923838 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf1d07-3693-42bb-a4d3-affbc38e2ec7 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:25.964105 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbb532-5120-426f-8e21-8da4f10d0fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:25.964855 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbb532-5120-426f-8e21-8da4f10d0fad None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:25.965139 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbb532-5120-426f-8e21-8da4f10d0fad None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:25.966144 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbb532-5120-426f-8e21-8da4f10d0fad None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:25.967014 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbb532-5120-426f-8e21-8da4f10d0fad None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:25.967318 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbb532-5120-426f-8e21-8da4f10d0fad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:25.968990 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbb532-5120-426f-8e21-8da4f10d0fad None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:25.990808 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 644/1281] 10.222.0.65 () {56 vars in 1143 bytes} [Wed Jul 27 08:54:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:54:25.997133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c666f1c-6ec7-4c55-b41f-f98326a4fd6f None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:26.096810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:26.107131 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c666f1c-6ec7-4c55-b41f-f98326a4fd6f None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:26.144647 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c829218-707f-49d0-b6fb-93496b7845d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:26.145275 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c829218-707f-49d0-b6fb-93496b7845d5 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:26.145557 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c829218-707f-49d0-b6fb-93496b7845d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:26.145830 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c829218-707f-49d0-b6fb-93496b7845d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:26.220652 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c829218-707f-49d0-b6fb-93496b7845d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:26.222366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c829218-707f-49d0-b6fb-93496b7845d5 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:26.323429 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:26.335783 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 638/1282] 10.222.0.65 () {58 vars in 1282 bytes} [Wed Jul 27 08:54:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 08:54:26.342349 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbb532-5120-426f-8e21-8da4f10d0fad None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:26.412960 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:26.459408 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbb532-5120-426f-8e21-8da4f10d0fad None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:26.499252 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aac6ec-3517-4b0c-904d-693ef3ebbf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:26.500056 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aac6ec-3517-4b0c-904d-693ef3ebbf9e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:26.500418 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aac6ec-3517-4b0c-904d-693ef3ebbf9e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:26.500713 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aac6ec-3517-4b0c-904d-693ef3ebbf9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:26.514435 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aac6ec-3517-4b0c-904d-693ef3ebbf9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:26.516253 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aac6ec-3517-4b0c-904d-693ef3ebbf9e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:26.534715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-91aac6ec-3517-4b0c-904d-693ef3ebbf9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:54:26.534715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:26.534715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:54:26.534715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:54:26.534715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:54:26.534715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:54:26.534715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:54:26.534715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:54:26.534715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:54:26.534715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:54:26.534715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:54:26.534715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:54:26.534715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 08:54:26.534715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 08:54:26.534715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 08:54:26.535893 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 08:54:26.535893 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:54:26.535893 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:54:26.535893 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:54:26.535893 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:54:26.535893 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:54:26.535893 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:54:26.535893 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:54:26.535893 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:54:26.535893 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:54:26.535893 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:54:26.535893 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:54:26.535893 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:54:26.535893 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:54:26.535893 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:54:26.535893 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:54:26.535893 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:54:26.537018 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 08:54:26.537018 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 08:54:26.537018 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 08:54:26.537018 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:54:26.537018 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 645/1283] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:54:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:54:26.543606 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c829218-707f-49d0-b6fb-93496b7845d5 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:26.655473 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c829218-707f-49d0-b6fb-93496b7845d5 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:26.703699 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167105de-5e1e-4750-a176-8daed119cbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:26.704101 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167105de-5e1e-4750-a176-8daed119cbb2 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:26.704382 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167105de-5e1e-4750-a176-8daed119cbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:26.704656 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167105de-5e1e-4750-a176-8daed119cbb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:26.705368 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167105de-5e1e-4750-a176-8daed119cbb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:26.705676 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167105de-5e1e-4750-a176-8daed119cbb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:26.707084 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167105de-5e1e-4750-a176-8daed119cbb2 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:26.719035 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 639/1284] 10.222.0.65 () {56 vars in 1109 bytes} [Wed Jul 27 08:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:54:26.725045 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aac6ec-3517-4b0c-904d-693ef3ebbf9e None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:26.833186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aac6ec-3517-4b0c-904d-693ef3ebbf9e None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:26.848048 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:26.869654 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb5fcb-3de9-47fb-9446-36e1af76ecfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:26.870296 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb5fcb-3de9-47fb-9446-36e1af76ecfd None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:26.870608 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb5fcb-3de9-47fb-9446-36e1af76ecfd None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:26.870883 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb5fcb-3de9-47fb-9446-36e1af76ecfd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:26.878424 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb5fcb-3de9-47fb-9446-36e1af76ecfd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:26.879876 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb5fcb-3de9-47fb-9446-36e1af76ecfd None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:26.891727 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-6ccb5fcb-3de9-47fb-9446-36e1af76ecfd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:54:26.891727 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:26.891727 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:54:26.891727 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:54:26.891727 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:54:26.891727 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:54:26.891727 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:54:26.891727 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:54:26.891727 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:54:26.891727 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:54:26.891727 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:54:26.891727 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:54:26.891727 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 08:54:26.891727 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 08:54:26.891727 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 08:54:26.893860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 08:54:26.893860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:54:26.893860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:54:26.893860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:54:26.893860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:54:26.893860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:54:26.893860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:54:26.893860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:54:26.893860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 27 08:54:26.893860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:54:26.893860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:54:26.893860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:54:26.893860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:54:26.893860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:54:26.893860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:54:26.893860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:54:26.893860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:54:26.896199 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 08:54:26.896199 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 08:54:26.896199 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 08:54:26.896199 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 08:54:26.896199 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 08:54:26.896199 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 08:54:26.896199 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 08:54:26.896199 dv-cinder-797608-64-smb devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 27 08:54:26.896199 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 646/1285] 10.222.0.65 () {56 vars in 1111 bytes} [Wed Jul 27 08:54:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:54:26.899047 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167105de-5e1e-4750-a176-8daed119cbb2 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:26.953462 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:27.011410 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167105de-5e1e-4750-a176-8daed119cbb2 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:27.048880 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5585433-d7e4-4a59-b8f7-72ae7b5c81f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:27.049501 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5585433-d7e4-4a59-b8f7-72ae7b5c81f0 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:27.049823 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5585433-d7e4-4a59-b8f7-72ae7b5c81f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:27.050048 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5585433-d7e4-4a59-b8f7-72ae7b5c81f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:27.050863 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5585433-d7e4-4a59-b8f7-72ae7b5c81f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:27.051170 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5585433-d7e4-4a59-b8f7-72ae7b5c81f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:27.052647 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5585433-d7e4-4a59-b8f7-72ae7b5c81f0 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:27.066161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 640/1286] 10.222.0.65 () {56 vars in 1148 bytes} [Wed Jul 27 08:54:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:54:27.073246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb5fcb-3de9-47fb-9446-36e1af76ecfd None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:27.180333 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb5fcb-3de9-47fb-9446-36e1af76ecfd None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:27.216256 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6600dc-2540-43f4-8306-0bfa4b2165a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:27.216872 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6600dc-2540-43f4-8306-0bfa4b2165a5 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:27.217147 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6600dc-2540-43f4-8306-0bfa4b2165a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:27.217417 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6600dc-2540-43f4-8306-0bfa4b2165a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:27.218205 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6600dc-2540-43f4-8306-0bfa4b2165a5 None admin] RBAC: Adding query filter params (role.id=20bc872844094480b9dca67a25b69e84, scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267, user.id=3d69004d02f9426b86e07907a553e523) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:27.220876 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6600dc-2540-43f4-8306-0bfa4b2165a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:27.225427 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6600dc-2540-43f4-8306-0bfa4b2165a5 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:27.233548 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 647/1287] 10.222.0.65 () {56 vars in 1374 bytes} [Wed Jul 27 08:54:27 2022] GET /identity/v3/role_assignments?user.id=3d69004d02f9426b86e07907a553e523&scope.project.id=3f77fdd017ea4a9b9b49f6e87ba7f267&role.id=20bc872844094480b9dca67a25b69e84 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:54:29.385955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1f9fe-f521-4bb9-b860-84ee9ff62ddd None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:29.386631 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1f9fe-f521-4bb9-b860-84ee9ff62ddd None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:29.386631 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1f9fe-f521-4bb9-b860-84ee9ff62ddd None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:29.387961 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 641/1288] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:54:29.394083 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69bf3d-efce-456e-afe3-8e4d784b52b9 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:29.394937 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69bf3d-efce-456e-afe3-8e4d784b52b9 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:29.395154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69bf3d-efce-456e-afe3-8e4d784b52b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:29.415881 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-9f69bf3d-efce-456e-afe3-8e4d784b52b9 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:54:29.417070 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9f69bf3d-efce-456e-afe3-8e4d784b52b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:54:29.449240 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:29.493500 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 648/1289] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:54:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:54:29.519165 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1f9fe-f521-4bb9-b860-84ee9ff62ddd None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:29.634585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1f9fe-f521-4bb9-b860-84ee9ff62ddd None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:29.647431 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:29.674250 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6532fd7-41b2-422a-90fd-06e2a69f55fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:29.674961 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6532fd7-41b2-422a-90fd-06e2a69f55fc None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:29.675238 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6532fd7-41b2-422a-90fd-06e2a69f55fc None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:29.675542 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6532fd7-41b2-422a-90fd-06e2a69f55fc None admin] PATH_INFO: `/v3/services/placement` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:29.676181 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6532fd7-41b2-422a-90fd-06e2a69f55fc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:29.677616 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6532fd7-41b2-422a-90fd-06e2a69f55fc None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:29.688061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-b6532fd7-41b2-422a-90fd-06e2a69f55fc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 08:54:29.688061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:29.688061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:54:29.688061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:54:29.688061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:54:29.688061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:54:29.688061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:54:29.688061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:54:29.688061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 08:54:29.688061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:54:29.688061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:54:29.688061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:54:29.688061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:29.688061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:54:29.688061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:54:29.688061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:54:29.688061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:54:29.690062 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:54:29.690062 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:54:29.690062 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:54:29.690062 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:54:29.690062 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:54:29.690062 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:54:29.690062 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:54:29.690062 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:54:29.690062 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:54:29.690062 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:54:29.690062 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:54:29.690062 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:54:29.690062 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:54:29.690062 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:54:29.690062 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:54:29.690062 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:54:29.691968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:54:29.691968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:54:29.691968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:54:29.691968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:54:29.691968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:54:29.691968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:54:29.691968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:54:29.691968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:54:29.691968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:54:29.691968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:54:29.691968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:54:29.691968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:54:29.691968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 08:54:29.691968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:54:29.691968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 642/1290] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Jul 27 08:54:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:54:29.696782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69bf3d-efce-456e-afe3-8e4d784b52b9 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:29.812360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69bf3d-efce-456e-afe3-8e4d784b52b9 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:29.847646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39722dd3-a2f4-4145-820e-e0a69e8ca1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:29.848265 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39722dd3-a2f4-4145-820e-e0a69e8ca1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:29.848543 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39722dd3-a2f4-4145-820e-e0a69e8ca1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:29.848820 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39722dd3-a2f4-4145-820e-e0a69e8ca1a4 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:29.849501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39722dd3-a2f4-4145-820e-e0a69e8ca1a4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:29.849809 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39722dd3-a2f4-4145-820e-e0a69e8ca1a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:29.851219 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39722dd3-a2f4-4145-820e-e0a69e8ca1a4 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:29.856529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 649/1291] 10.222.0.65 () {56 vars in 1116 bytes} [Wed Jul 27 08:54:29 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:54:29.862767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6532fd7-41b2-422a-90fd-06e2a69f55fc None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:29.970544 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6532fd7-41b2-422a-90fd-06e2a69f55fc None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:30.007190 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0cb28-dcdf-44f8-88dd-375c28b08fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:30.007813 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0cb28-dcdf-44f8-88dd-375c28b08fab None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:30.008093 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0cb28-dcdf-44f8-88dd-375c28b08fab None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:30.008365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0cb28-dcdf-44f8-88dd-375c28b08fab None admin] PATH_INFO: `/v3/services` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:30.009047 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0cb28-dcdf-44f8-88dd-375c28b08fab None admin] RBAC: Adding query filter params (type=placement) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:30.009349 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0cb28-dcdf-44f8-88dd-375c28b08fab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:30.010749 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0cb28-dcdf-44f8-88dd-375c28b08fab None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:30.016698 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 643/1292] 10.222.0.65 () {56 vars in 1116 bytes} [Wed Jul 27 08:54:29 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 08:54:32.172862 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95536ef4-9a30-4bf0-b6ed-8ea7a40d3693 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:32.173410 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95536ef4-9a30-4bf0-b6ed-8ea7a40d3693 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:32.173776 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95536ef4-9a30-4bf0-b6ed-8ea7a40d3693 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:32.176177 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 650/1293] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:54:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:54:32.181539 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cf066-ed35-497a-aa66-94c7755b3641 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:32.181923 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cf066-ed35-497a-aa66-94c7755b3641 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:32.182093 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cf066-ed35-497a-aa66-94c7755b3641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:32.201002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-9a0cf066-ed35-497a-aa66-94c7755b3641 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:54:32.202186 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-9a0cf066-ed35-497a-aa66-94c7755b3641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:54:32.231327 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:32.274068 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 644/1294] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:54:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:54:32.298736 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95536ef4-9a30-4bf0-b6ed-8ea7a40d3693 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:32.330192 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:32.401290 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95536ef4-9a30-4bf0-b6ed-8ea7a40d3693 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:32.435676 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fe78f-ac9c-4588-98f0-a00fdf33fd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:32.436291 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fe78f-ac9c-4588-98f0-a00fdf33fd58 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:32.436570 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fe78f-ac9c-4588-98f0-a00fdf33fd58 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:32.436840 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fe78f-ac9c-4588-98f0-a00fdf33fd58 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:32.437538 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789fe78f-ac9c-4588-98f0-a00fdf33fd58 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:32.438938 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789fe78f-ac9c-4588-98f0-a00fdf33fd58 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:32.453883 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 651/1295] 10.222.0.65 () {60 vars in 1141 bytes} [Wed Jul 27 08:54:32 2022] POST /identity/v3/services => generated 246 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:54:34.510955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447b8b9-67d8-4366-ab8a-321c7a85c4ea None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:34.511460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447b8b9-67d8-4366-ab8a-321c7a85c4ea None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:34.511460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447b8b9-67d8-4366-ab8a-321c7a85c4ea None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:34.513412 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 645/1296] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:54:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:54:34.518598 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7339104-6485-493b-ac48-c96906a46279 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:34.519055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7339104-6485-493b-ac48-c96906a46279 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:34.519150 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7339104-6485-493b-ac48-c96906a46279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:34.536939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-a7339104-6485-493b-ac48-c96906a46279 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:54:34.538142 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a7339104-6485-493b-ac48-c96906a46279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:54:34.612641 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 652/1297] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:54:34 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:54:34.635689 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447b8b9-67d8-4366-ab8a-321c7a85c4ea None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:34.757364 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447b8b9-67d8-4366-ab8a-321c7a85c4ea None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:34.795426 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0191ffc-26d8-4c5b-91e5-c3a29ffe2115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:34.796087 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0191ffc-26d8-4c5b-91e5-c3a29ffe2115 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:34.796367 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0191ffc-26d8-4c5b-91e5-c3a29ffe2115 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:34.796639 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0191ffc-26d8-4c5b-91e5-c3a29ffe2115 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:34.797283 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0191ffc-26d8-4c5b-91e5-c3a29ffe2115 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:34.798731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0191ffc-26d8-4c5b-91e5-c3a29ffe2115 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:34.808454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-c0191ffc-26d8-4c5b-91e5-c3a29ffe2115 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 08:54:34.808454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:34.808454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:54:34.808454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:54:34.808454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:54:34.808454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:54:34.808454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:54:34.808454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:54:34.808454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 08:54:34.808454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:54:34.808454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:54:34.808454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:54:34.808454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:34.808454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:54:34.808454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:54:34.808454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:54:34.808454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:54:34.810224 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:54:34.810224 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:54:34.810224 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:54:34.810224 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:54:34.810224 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:54:34.810224 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:54:34.810224 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:54:34.810224 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:54:34.810224 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:54:34.810224 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:54:34.810224 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:54:34.810224 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:54:34.810224 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:54:34.810224 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:54:34.810224 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:54:34.810224 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:54:34.811696 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:54:34.811696 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:54:34.811696 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:54:34.811696 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:54:34.811696 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:54:34.811696 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:54:34.811696 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:54:34.811696 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:54:34.811696 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:54:34.811696 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:54:34.811696 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:54:34.811696 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:54:34.811696 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 08:54:34.811696 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:54:34.811696 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 646/1298] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Jul 27 08:54:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:54:34.816750 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7339104-6485-493b-ac48-c96906a46279 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:34.837620 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:34.925651 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7339104-6485-493b-ac48-c96906a46279 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:34.960390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd419615-325c-4171-8347-ab8f42563b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:34.961019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd419615-325c-4171-8347-ab8f42563b8a None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:34.961302 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd419615-325c-4171-8347-ab8f42563b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:34.961580 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd419615-325c-4171-8347-ab8f42563b8a None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:34.962257 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd419615-325c-4171-8347-ab8f42563b8a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:34.962593 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd419615-325c-4171-8347-ab8f42563b8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:34.963963 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd419615-325c-4171-8347-ab8f42563b8a None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:34.969732 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 653/1299] 10.222.0.65 () {56 vars in 1116 bytes} [Wed Jul 27 08:54:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:54:34.975729 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0191ffc-26d8-4c5b-91e5-c3a29ffe2115 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:35.006839 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:35.076736 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0191ffc-26d8-4c5b-91e5-c3a29ffe2115 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:35.110120 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09afcc2-5d46-423a-9ecf-a11c0ca8614e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:35.110766 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09afcc2-5d46-423a-9ecf-a11c0ca8614e None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:35.111046 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09afcc2-5d46-423a-9ecf-a11c0ca8614e None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:35.111324 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09afcc2-5d46-423a-9ecf-a11c0ca8614e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:35.112075 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09afcc2-5d46-423a-9ecf-a11c0ca8614e None admin] RBAC: Adding query filter params (interface=public, service_id=fab2e46b3b3b408ca2e7a732fb627360, region_id=RegionOne) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:35.112395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09afcc2-5d46-423a-9ecf-a11c0ca8614e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:35.113744 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09afcc2-5d46-423a-9ecf-a11c0ca8614e None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:35.119235 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 647/1300] 10.222.0.65 () {56 vars in 1251 bytes} [Wed Jul 27 08:54:34 2022] GET /identity/v3/endpoints?service_id=fab2e46b3b3b408ca2e7a732fb627360&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:54:35.124858 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd419615-325c-4171-8347-ab8f42563b8a None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:35.206550 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:35.225438 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd419615-325c-4171-8347-ab8f42563b8a None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:35.264058 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9192ab-7893-48e0-bc15-7163ea6c2f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:35.264730 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9192ab-7893-48e0-bc15-7163ea6c2f34 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:35.265103 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9192ab-7893-48e0-bc15-7163ea6c2f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:35.265452 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9192ab-7893-48e0-bc15-7163ea6c2f34 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:35.266126 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9192ab-7893-48e0-bc15-7163ea6c2f34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:35.267714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9192ab-7893-48e0-bc15-7163ea6c2f34 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:35.276100 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 654/1301] 10.222.0.65 () {56 vars in 1087 bytes} [Wed Jul 27 08:54:35 2022] GET /identity/v3/services => generated 2191 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:54:37.272257 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e22e1b-0535-4865-a276-333e44482236 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:37.273077 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e22e1b-0535-4865-a276-333e44482236 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:37.273077 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e22e1b-0535-4865-a276-333e44482236 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:37.274343 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 648/1302] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:54:37.282442 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ee107-b92b-403e-ba1a-0023af7c69f5 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:37.283057 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ee107-b92b-403e-ba1a-0023af7c69f5 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:37.283485 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ee107-b92b-403e-ba1a-0023af7c69f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:37.306368 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-e54ee107-b92b-403e-ba1a-0023af7c69f5 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:54:37.307653 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e54ee107-b92b-403e-ba1a-0023af7c69f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:54:37.379370 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 655/1303] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:54:37 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 08:54:37.404547 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e22e1b-0535-4865-a276-333e44482236 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:37.500176 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:37.507187 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e22e1b-0535-4865-a276-333e44482236 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:37.541091 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28a281-8a37-4828-b23a-aff27b642574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:37.541716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28a281-8a37-4828-b23a-aff27b642574 None admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:37.541990 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28a281-8a37-4828-b23a-aff27b642574 None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:37.542256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28a281-8a37-4828-b23a-aff27b642574 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:37.542964 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28a281-8a37-4828-b23a-aff27b642574 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:37.544438 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28a281-8a37-4828-b23a-aff27b642574 None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:37.553169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application [None req-cb28a281-8a37-4828-b23a-aff27b642574 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 08:54:37.553169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:37.553169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 08:54:37.553169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 08:54:37.553169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 08:54:37.553169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 08:54:37.553169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 08:54:37.553169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:54:37.553169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 08:54:37.553169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:54:37.553169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 08:54:37.553169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:54:37.553169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 08:54:37.553169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 08:54:37.553169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 08:54:37.553169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 08:54:37.553169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 08:54:37.554395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 08:54:37.554395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 08:54:37.554395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 08:54:37.554395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 08:54:37.554395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 08:54:37.554395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 08:54:37.554395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 08:54:37.554395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 08:54:37.554395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 08:54:37.554395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 08:54:37.554395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 08:54:37.554395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 08:54:37.554395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 08:54:37.554395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 08:54:37.554395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 08:54:37.554395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 08:54:37.555428 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 08:54:37.555428 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application with Lock( Jul 27 08:54:37.555428 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 08:54:37.555428 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self._enter() Jul 27 08:54:37.555428 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 08:54:37.555428 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 08:54:37.555428 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 08:54:37.555428 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application return self.creator() Jul 27 08:54:37.555428 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 08:54:37.555428 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application created_value = creator( Jul 27 08:54:37.555428 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 08:54:37.555428 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 08:54:37.555428 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 08:54:37.555428 dv-cinder-797608-64-smb devstack@keystone.service[80153]: ERROR keystone.server.flask.application Jul 27 08:54:37.555428 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 649/1304] 10.222.0.65 () {56 vars in 1117 bytes} [Wed Jul 27 08:54:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 08:54:37.561390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ee107-b92b-403e-ba1a-0023af7c69f5 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:37.636626 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:37.661805 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ee107-b92b-403e-ba1a-0023af7c69f5 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:37.703824 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd362db3-f459-4f43-a40b-287142184e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:37.704449 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd362db3-f459-4f43-a40b-287142184e18 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:37.704725 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd362db3-f459-4f43-a40b-287142184e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:37.704994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd362db3-f459-4f43-a40b-287142184e18 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:37.705671 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd362db3-f459-4f43-a40b-287142184e18 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 08:54:37.705973 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd362db3-f459-4f43-a40b-287142184e18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:37.707371 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd362db3-f459-4f43-a40b-287142184e18 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:37.712653 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 656/1305] 10.222.0.65 () {56 vars in 1116 bytes} [Wed Jul 27 08:54:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 08:54:37.718638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28a281-8a37-4828-b23a-aff27b642574 None admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:54:37.817764 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28a281-8a37-4828-b23a-aff27b642574 None admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:54:37.851708 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172602e-9bf3-4d2d-b3ee-e31cecc3ba6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:54:37.852322 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172602e-9bf3-4d2d-b3ee-e31cecc3ba6e None admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:54:37.852596 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172602e-9bf3-4d2d-b3ee-e31cecc3ba6e None admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:54:37.852867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172602e-9bf3-4d2d-b3ee-e31cecc3ba6e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:54:37.853570 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1172602e-9bf3-4d2d-b3ee-e31cecc3ba6e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:54:37.854964 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1172602e-9bf3-4d2d-b3ee-e31cecc3ba6e None admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:54:37.877187 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 650/1306] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 08:54:37 2022] POST /identity/v3/endpoints => generated 331 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 08:54:47.709562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=30 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:54:47.871807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:55:43.631190 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82314249-7b1b-4eaa-a7fc-439008040d17 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:55:43.632012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82314249-7b1b-4eaa-a7fc-439008040d17 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:55:43.632012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82314249-7b1b-4eaa-a7fc-439008040d17 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:55:43.638481 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb248fa1-c82b-45d8-bb37-0170b67a973c None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:55:43.639529 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb248fa1-c82b-45d8-bb37-0170b67a973c None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:55:43.639751 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb248fa1-c82b-45d8-bb37-0170b67a973c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:55:43.645121 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 657/1307] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:55:43 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:55:43.750973 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-eb248fa1-c82b-45d8-bb37-0170b67a973c None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:55:43.752478 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-eb248fa1-c82b-45d8-bb37-0170b67a973c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:55:43.948972 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 651/1308] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:55:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:55:44.000450 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d8c97-1317-425c-ac07-528a61d65fa2 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:55:44.000943 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d8c97-1317-425c-ac07-528a61d65fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:55:44.001327 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d8c97-1317-425c-ac07-528a61d65fa2 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:55:44.003208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 658/1309] 10.222.0.65 () {54 vars in 965 bytes} [Wed Jul 27 08:55:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:55:44.010554 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c83ad-a2ad-4cf9-a783-a032f40927c2 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:55:44.011005 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c83ad-a2ad-4cf9-a783-a032f40927c2 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:55:44.011453 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c83ad-a2ad-4cf9-a783-a032f40927c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:55:44.197430 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-cc9c83ad-a2ad-4cf9-a783-a032f40927c2 None None] MFA Rules not processed for user `b018ac10ad804c6cbbe7fdcc1cec61e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:55:44.199090 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-cc9c83ad-a2ad-4cf9-a783-a032f40927c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:55:44.233740 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:55:44.317723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 652/1310] 10.222.0.65 () {58 vars in 1062 bytes} [Wed Jul 27 08:55:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:55:44.318534 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d8c97-1317-425c-ac07-528a61d65fa2 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:55:44.321560 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-207d8c97-1317-425c-ac07-528a61d65fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:55:44.460063 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d8c97-1317-425c-ac07-528a61d65fa2 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:55:44.547060 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bff1cb-19d4-49d4-9840-079a18e38139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:55:44.547801 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bff1cb-19d4-49d4-9840-079a18e38139 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:55:44.548153 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bff1cb-19d4-49d4-9840-079a18e38139 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:55:44.548495 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bff1cb-19d4-49d4-9840-079a18e38139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:55:44.550410 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c9bff1cb-19d4-49d4-9840-079a18e38139 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:55:44.620490 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:55:44.705085 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bff1cb-19d4-49d4-9840-079a18e38139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:55:44.707405 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bff1cb-19d4-49d4-9840-079a18e38139 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:55:44.730493 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 659/1311] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:55:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:55:47.146657 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da570d8b-57aa-483e-8f30-43f83bed7f69 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:55:47.147212 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da570d8b-57aa-483e-8f30-43f83bed7f69 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:55:47.147212 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da570d8b-57aa-483e-8f30-43f83bed7f69 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:55:47.148595 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 653/1312] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:55:47.154255 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b1ab8-706e-4de1-ae72-64c471ab98f2 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:55:47.154783 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b1ab8-706e-4de1-ae72-64c471ab98f2 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:55:47.155100 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b1ab8-706e-4de1-ae72-64c471ab98f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:55:47.237961 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-5f3b1ab8-706e-4de1-ae72-64c471ab98f2 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:55:47.239214 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-5f3b1ab8-706e-4de1-ae72-64c471ab98f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:55:47.346759 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 660/1313] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:55:47.403033 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574f852-6ca2-46df-8fa2-fde7a9ad473d None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:55:47.403309 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574f852-6ca2-46df-8fa2-fde7a9ad473d None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:55:47.403579 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574f852-6ca2-46df-8fa2-fde7a9ad473d None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:55:47.405020 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 654/1314] 10.222.0.65 () {54 vars in 965 bytes} [Wed Jul 27 08:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:55:47.411264 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa81cc-0330-4b9c-a500-5ad9134b24fb None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:55:47.411552 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa81cc-0330-4b9c-a500-5ad9134b24fb None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:55:47.411830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa81cc-0330-4b9c-a500-5ad9134b24fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:55:47.424854 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:55:47.491768 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-b2fa81cc-0330-4b9c-a500-5ad9134b24fb None None] MFA Rules not processed for user `b018ac10ad804c6cbbe7fdcc1cec61e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:55:47.493087 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b2fa81cc-0330-4b9c-a500-5ad9134b24fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:55:47.581559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 661/1315] 10.222.0.65 () {58 vars in 1062 bytes} [Wed Jul 27 08:55:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:55:47.590856 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574f852-6ca2-46df-8fa2-fde7a9ad473d None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:55:47.592533 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-7574f852-6ca2-46df-8fa2-fde7a9ad473d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:55:47.710340 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574f852-6ca2-46df-8fa2-fde7a9ad473d None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:55:47.787170 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:55:47.790584 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f96eb-7b65-4687-86be-3187250a3e67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:55:47.791804 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f96eb-7b65-4687-86be-3187250a3e67 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:55:47.792503 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f96eb-7b65-4687-86be-3187250a3e67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:55:47.792975 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f96eb-7b65-4687-86be-3187250a3e67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:55:47.797275 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-cc7f96eb-7b65-4687-86be-3187250a3e67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:55:47.919472 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f96eb-7b65-4687-86be-3187250a3e67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:55:47.922192 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f96eb-7b65-4687-86be-3187250a3e67 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:55:47.942724 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 655/1316] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:55:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:55:50.558094 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e8768-2a44-471b-8b84-44e5833ed22e None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:55:50.558759 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e8768-2a44-471b-8b84-44e5833ed22e None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:55:50.558759 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e8768-2a44-471b-8b84-44e5833ed22e None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:55:50.560034 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 662/1317] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:55:50.566599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e24ab-f717-4ef0-a77d-08ec907c22ff None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:55:50.567099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e24ab-f717-4ef0-a77d-08ec907c22ff None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:55:50.567202 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e24ab-f717-4ef0-a77d-08ec907c22ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:55:50.635332 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-380e24ab-f717-4ef0-a77d-08ec907c22ff None None] MFA Rules not processed for user `d01f9e38b5a34766b5dd6418b0516320`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:55:50.636543 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-380e24ab-f717-4ef0-a77d-08ec907c22ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:55:50.694895 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:55:50.741434 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 656/1318] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:55:50 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:55:50.781362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e8768-2a44-471b-8b84-44e5833ed22e None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:55:50.782963 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-dd7e8768-2a44-471b-8b84-44e5833ed22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:55:50.892032 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e8768-2a44-471b-8b84-44e5833ed22e None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:55:50.894911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:55:50.977485 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce81cd3-d1e0-421c-a1f3-5e62a2b3541c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:55:50.978112 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce81cd3-d1e0-421c-a1f3-5e62a2b3541c service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:55:50.978427 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce81cd3-d1e0-421c-a1f3-5e62a2b3541c service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:55:50.978707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce81cd3-d1e0-421c-a1f3-5e62a2b3541c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:55:50.980401 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-2ce81cd3-d1e0-421c-a1f3-5e62a2b3541c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:55:51.103241 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce81cd3-d1e0-421c-a1f3-5e62a2b3541c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:55:51.104704 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce81cd3-d1e0-421c-a1f3-5e62a2b3541c service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:55:51.124951 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 663/1319] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:55:50 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:55:54.080726 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd363e-3655-46b7-9e7f-f2f4da73588c None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:55:54.081300 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd363e-3655-46b7-9e7f-f2f4da73588c None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:55:54.081300 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd363e-3655-46b7-9e7f-f2f4da73588c None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:55:54.082700 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 657/1320] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:55:54.088365 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b592cc-d4dd-4e5c-9fe2-044f86dc181c None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:55:54.088894 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b592cc-d4dd-4e5c-9fe2-044f86dc181c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:55:54.088894 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b592cc-d4dd-4e5c-9fe2-044f86dc181c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:55:54.143554 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:55:54.171291 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-70b592cc-d4dd-4e5c-9fe2-044f86dc181c None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:55:54.172551 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-70b592cc-d4dd-4e5c-9fe2-044f86dc181c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:55:54.281459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 664/1321] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:55:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:55:54.323414 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd363e-3655-46b7-9e7f-f2f4da73588c None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:55:54.325269 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-27cd363e-3655-46b7-9e7f-f2f4da73588c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:55:54.435530 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd363e-3655-46b7-9e7f-f2f4da73588c None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:55:54.512769 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68d219-0722-4c37-82c0-b6ab65b3f728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:55:54.513398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68d219-0722-4c37-82c0-b6ab65b3f728 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:55:54.513677 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68d219-0722-4c37-82c0-b6ab65b3f728 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:55:54.513962 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68d219-0722-4c37-82c0-b6ab65b3f728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:55:54.515851 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-ea68d219-0722-4c37-82c0-b6ab65b3f728 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:55:54.525604 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:55:54.638199 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68d219-0722-4c37-82c0-b6ab65b3f728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:55:54.639694 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68d219-0722-4c37-82c0-b6ab65b3f728 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:55:54.659867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 658/1322] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:55:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:55:57.875193 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebbb18-6c4f-4f77-899f-373c0b042de7 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:55:57.875891 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebbb18-6c4f-4f77-899f-373c0b042de7 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:55:57.875891 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebbb18-6c4f-4f77-899f-373c0b042de7 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:55:57.877412 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 665/1323] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:55:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:55:57.883210 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79ed02-aceb-45e9-a0b6-65ded40d1403 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:55:57.883773 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79ed02-aceb-45e9-a0b6-65ded40d1403 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:55:57.883882 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79ed02-aceb-45e9-a0b6-65ded40d1403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:55:57.971943 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-3a79ed02-aceb-45e9-a0b6-65ded40d1403 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:55:57.973212 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-3a79ed02-aceb-45e9-a0b6-65ded40d1403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:55:58.041540 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:55:58.089123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 659/1324] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:55:58.131054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebbb18-6c4f-4f77-899f-373c0b042de7 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:55:58.132772 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f8ebbb18-6c4f-4f77-899f-373c0b042de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:55:58.320433 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebbb18-6c4f-4f77-899f-373c0b042de7 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:55:58.344831 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:55:58.446911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a99aa-3a46-4951-a0ee-c9c1ad6c47a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:55:58.447753 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a99aa-3a46-4951-a0ee-c9c1ad6c47a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:55:58.448933 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a99aa-3a46-4951-a0ee-c9c1ad6c47a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:55:58.448933 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a99aa-3a46-4951-a0ee-c9c1ad6c47a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:55:58.451990 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-128a99aa-3a46-4951-a0ee-c9c1ad6c47a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:55:58.594889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a99aa-3a46-4951-a0ee-c9c1ad6c47a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:55:58.596365 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a99aa-3a46-4951-a0ee-c9c1ad6c47a1 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:55:58.618911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 666/1325] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:55:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:56:00.767412 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685b7ea-1945-408e-889a-d4474e95fcc9 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:00.767945 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685b7ea-1945-408e-889a-d4474e95fcc9 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:00.767945 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685b7ea-1945-408e-889a-d4474e95fcc9 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:00.769335 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 660/1326] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:56:00.774998 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72220e6-d0ce-463f-b828-8778ceec1655 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:00.775552 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72220e6-d0ce-463f-b828-8778ceec1655 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:00.775552 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72220e6-d0ce-463f-b828-8778ceec1655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:00.830589 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:00.852213 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-a72220e6-d0ce-463f-b828-8778ceec1655 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:56:00.853435 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a72220e6-d0ce-463f-b828-8778ceec1655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:00.961835 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 667/1327] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:56:01.001351 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685b7ea-1945-408e-889a-d4474e95fcc9 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:56:01.003159 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-0685b7ea-1945-408e-889a-d4474e95fcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:01.118660 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685b7ea-1945-408e-889a-d4474e95fcc9 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:56:01.207943 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b0d2a-87c1-42f0-af07-5a7b9dbe2a4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:56:01.208582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b0d2a-87c1-42f0-af07-5a7b9dbe2a4d service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:01.208859 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b0d2a-87c1-42f0-af07-5a7b9dbe2a4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:01.209131 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b0d2a-87c1-42f0-af07-5a7b9dbe2a4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:01.210911 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-d15b0d2a-87c1-42f0-af07-5a7b9dbe2a4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:01.232099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:01.342287 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b0d2a-87c1-42f0-af07-5a7b9dbe2a4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:56:01.344342 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b0d2a-87c1-42f0-af07-5a7b9dbe2a4d service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:56:01.365563 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 661/1328] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:56:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:56:03.458930 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5507e23-3af3-418c-89ab-3bde3bf4ec85 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:03.459531 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5507e23-3af3-418c-89ab-3bde3bf4ec85 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:03.459531 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5507e23-3af3-418c-89ab-3bde3bf4ec85 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:03.460887 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 668/1329] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:56:03.466701 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5413ab-089a-41ed-8436-67c4fe0d104b None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:03.467276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5413ab-089a-41ed-8436-67c4fe0d104b None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:03.467276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5413ab-089a-41ed-8436-67c4fe0d104b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:03.538283 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-1d5413ab-089a-41ed-8436-67c4fe0d104b None None] MFA Rules not processed for user `d01f9e38b5a34766b5dd6418b0516320`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:56:03.539576 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-1d5413ab-089a-41ed-8436-67c4fe0d104b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:03.609836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:03.644311 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 662/1330] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:56:03 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:56:03.682657 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5507e23-3af3-418c-89ab-3bde3bf4ec85 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:56:03.684194 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d5507e23-3af3-418c-89ab-3bde3bf4ec85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:03.798591 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5507e23-3af3-418c-89ab-3bde3bf4ec85 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:56:03.821169 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:03.896498 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc2556-7ac2-4eb7-a739-42cc1db9c27e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:56:03.897047 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc2556-7ac2-4eb7-a739-42cc1db9c27e service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:03.897325 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc2556-7ac2-4eb7-a739-42cc1db9c27e service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:03.897596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc2556-7ac2-4eb7-a739-42cc1db9c27e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:03.899326 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-46cc2556-7ac2-4eb7-a739-42cc1db9c27e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:04.043149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc2556-7ac2-4eb7-a739-42cc1db9c27e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:56:04.044635 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc2556-7ac2-4eb7-a739-42cc1db9c27e service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:56:04.065881 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 669/1331] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:56:03 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:56:06.353150 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b0642-4f86-4a92-97ab-1c4336f97f44 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:06.353707 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b0642-4f86-4a92-97ab-1c4336f97f44 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:06.353707 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b0642-4f86-4a92-97ab-1c4336f97f44 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:06.355025 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 663/1332] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:56:06.360952 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a0bd0-a4de-4038-8c92-2198d5da5a97 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:06.361450 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a0bd0-a4de-4038-8c92-2198d5da5a97 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:06.361577 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a0bd0-a4de-4038-8c92-2198d5da5a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:06.425841 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:06.428855 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-d02a0bd0-a4de-4038-8c92-2198d5da5a97 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:56:06.430629 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d02a0bd0-a4de-4038-8c92-2198d5da5a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:06.529123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 670/1333] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:56:06.565991 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b0642-4f86-4a92-97ab-1c4336f97f44 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:56:06.567657 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-4c3b0642-4f86-4a92-97ab-1c4336f97f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:06.674110 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b0642-4f86-4a92-97ab-1c4336f97f44 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:56:06.746841 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42de8cd-467c-4f17-aea0-f23fc9ffcc4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:56:06.747452 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42de8cd-467c-4f17-aea0-f23fc9ffcc4b service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:06.747730 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42de8cd-467c-4f17-aea0-f23fc9ffcc4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:06.748003 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42de8cd-467c-4f17-aea0-f23fc9ffcc4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:06.750146 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-f42de8cd-467c-4f17-aea0-f23fc9ffcc4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:06.777630 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:06.860472 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42de8cd-467c-4f17-aea0-f23fc9ffcc4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:56:06.861919 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42de8cd-467c-4f17-aea0-f23fc9ffcc4b service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:56:06.880219 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 664/1334] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:56:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:56:08.968014 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e006b-cf0f-4245-910f-5b1189d716f4 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:08.968838 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e006b-cf0f-4245-910f-5b1189d716f4 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:08.969052 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e006b-cf0f-4245-910f-5b1189d716f4 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:08.970564 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 671/1335] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:56:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:56:08.976040 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bf5ac-6f8c-4b89-b90e-dba4e4a50fd6 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:08.976526 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bf5ac-6f8c-4b89-b90e-dba4e4a50fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:08.976625 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bf5ac-6f8c-4b89-b90e-dba4e4a50fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:09.053124 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-d89bf5ac-6f8c-4b89-b90e-dba4e4a50fd6 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:56:09.054398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-d89bf5ac-6f8c-4b89-b90e-dba4e4a50fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:09.135208 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:09.159296 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 665/1336] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:56:09.200412 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e006b-cf0f-4245-910f-5b1189d716f4 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:56:09.201992 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-2e4e006b-cf0f-4245-910f-5b1189d716f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:09.312722 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e006b-cf0f-4245-910f-5b1189d716f4 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:56:09.341688 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:09.392602 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4580946-49b2-4e66-bf05-0b8c39be4532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:56:09.393237 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4580946-49b2-4e66-bf05-0b8c39be4532 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:09.393523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4580946-49b2-4e66-bf05-0b8c39be4532 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:09.393801 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4580946-49b2-4e66-bf05-0b8c39be4532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:09.395528 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e4580946-49b2-4e66-bf05-0b8c39be4532 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:09.516314 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4580946-49b2-4e66-bf05-0b8c39be4532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:56:09.517785 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4580946-49b2-4e66-bf05-0b8c39be4532 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:56:09.537008 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 672/1337] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:56:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:56:11.986139 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b64e0-b24c-4c6b-b9f8-b09ef868180a None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:11.986753 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b64e0-b24c-4c6b-b9f8-b09ef868180a None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:11.986753 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b64e0-b24c-4c6b-b9f8-b09ef868180a None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:11.988072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 666/1338] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:56:11.994386 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed993ec5-d895-4417-acc9-744bb0b2f0d9 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:11.994861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed993ec5-d895-4417-acc9-744bb0b2f0d9 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:11.995033 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed993ec5-d895-4417-acc9-744bb0b2f0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:12.065739 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-ed993ec5-d895-4417-acc9-744bb0b2f0d9 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:56:12.066996 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ed993ec5-d895-4417-acc9-744bb0b2f0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:12.075954 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:12.172903 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 673/1339] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:56:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:56:12.210500 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b64e0-b24c-4c6b-b9f8-b09ef868180a None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:56:12.212018 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-203b64e0-b24c-4c6b-b9f8-b09ef868180a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:12.320992 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b64e0-b24c-4c6b-b9f8-b09ef868180a None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:56:12.395849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb7edb-a68f-45da-b4e9-b979ab7e7c72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:56:12.396464 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb7edb-a68f-45da-b4e9-b979ab7e7c72 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:12.396740 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb7edb-a68f-45da-b4e9-b979ab7e7c72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:12.397013 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb7edb-a68f-45da-b4e9-b979ab7e7c72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:12.398660 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-dabb7edb-a68f-45da-b4e9-b979ab7e7c72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:12.435098 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:12.510773 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb7edb-a68f-45da-b4e9-b979ab7e7c72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:56:12.512134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb7edb-a68f-45da-b4e9-b979ab7e7c72 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:56:12.531953 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 667/1340] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:56:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:56:16.726929 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1685d7-988e-481b-a8d7-24e7153de95c None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:16.727480 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1685d7-988e-481b-a8d7-24e7153de95c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:16.727480 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1685d7-988e-481b-a8d7-24e7153de95c None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:16.729052 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 674/1341] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:56:16.736031 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3edd6-d9a3-4a46-b905-d113e54ebc14 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:16.736651 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3edd6-d9a3-4a46-b905-d113e54ebc14 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:16.736651 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3edd6-d9a3-4a46-b905-d113e54ebc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:16.815856 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-bab3edd6-d9a3-4a46-b905-d113e54ebc14 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:56:16.817097 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-bab3edd6-d9a3-4a46-b905-d113e54ebc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:16.914575 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:16.927474 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 668/1342] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:56:16.967051 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1685d7-988e-481b-a8d7-24e7153de95c None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:56:16.969844 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ae1685d7-988e-481b-a8d7-24e7153de95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:17.085660 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1685d7-988e-481b-a8d7-24e7153de95c None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:56:17.135772 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:17.179911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f44f92-6228-42ce-bc8f-d7e16b9f0005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:56:17.180449 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f44f92-6228-42ce-bc8f-d7e16b9f0005 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:17.180732 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f44f92-6228-42ce-bc8f-d7e16b9f0005 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:17.181002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f44f92-6228-42ce-bc8f-d7e16b9f0005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:17.182765 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-86f44f92-6228-42ce-bc8f-d7e16b9f0005 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:17.310987 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f44f92-6228-42ce-bc8f-d7e16b9f0005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:56:17.312675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f44f92-6228-42ce-bc8f-d7e16b9f0005 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:56:17.333536 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 675/1343] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:56:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:56:20.290717 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6745b3-28b2-4cd3-992b-4c83ed12f398 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:20.291339 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6745b3-28b2-4cd3-992b-4c83ed12f398 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:20.291559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6745b3-28b2-4cd3-992b-4c83ed12f398 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:20.292963 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 669/1344] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:56:20.299288 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16977ac5-c35a-4344-a3f9-d70aed944421 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:20.299766 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16977ac5-c35a-4344-a3f9-d70aed944421 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:20.299872 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16977ac5-c35a-4344-a3f9-d70aed944421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:20.368485 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-16977ac5-c35a-4344-a3f9-d70aed944421 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:56:20.369708 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-16977ac5-c35a-4344-a3f9-d70aed944421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:20.387870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:20.469869 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 676/1345] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:56:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:56:20.508127 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6745b3-28b2-4cd3-992b-4c83ed12f398 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:56:20.509705 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-de6745b3-28b2-4cd3-992b-4c83ed12f398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:20.618218 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6745b3-28b2-4cd3-992b-4c83ed12f398 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:56:20.703372 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3bb4d-a0a8-4043-a820-36d3a4105377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:56:20.704229 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3bb4d-a0a8-4043-a820-36d3a4105377 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:20.704477 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3bb4d-a0a8-4043-a820-36d3a4105377 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:20.704837 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3bb4d-a0a8-4043-a820-36d3a4105377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:20.707103 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-a7d3bb4d-a0a8-4043-a820-36d3a4105377 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:20.756586 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:20.825148 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3bb4d-a0a8-4043-a820-36d3a4105377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:56:20.826637 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3bb4d-a0a8-4043-a820-36d3a4105377 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:56:20.847225 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 670/1346] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:56:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:56:25.211439 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635e254-e88a-4558-8de6-81d7528a4efc None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:25.212023 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635e254-e88a-4558-8de6-81d7528a4efc None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:25.212023 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635e254-e88a-4558-8de6-81d7528a4efc None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:25.213363 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 677/1347] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:56:25.220476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86b9a1-0841-48ea-8223-30fb309a144d None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:25.220476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86b9a1-0841-48ea-8223-30fb309a144d None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:25.220476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86b9a1-0841-48ea-8223-30fb309a144d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:25.295632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-ed86b9a1-0841-48ea-8223-30fb309a144d None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:56:25.297922 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-ed86b9a1-0841-48ea-8223-30fb309a144d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:25.403426 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:25.406789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 671/1348] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:56:25.447169 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635e254-e88a-4558-8de6-81d7528a4efc None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:56:25.448755 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a635e254-e88a-4558-8de6-81d7528a4efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:25.568447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635e254-e88a-4558-8de6-81d7528a4efc None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:56:25.622114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:25.653744 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8a423-fd44-4931-b05a-af4fd674ee55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:56:25.654399 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8a423-fd44-4931-b05a-af4fd674ee55 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:25.654683 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8a423-fd44-4931-b05a-af4fd674ee55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:25.654952 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8a423-fd44-4931-b05a-af4fd674ee55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:25.659624 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4bd8a423-fd44-4931-b05a-af4fd674ee55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:25.776689 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8a423-fd44-4931-b05a-af4fd674ee55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:56:25.778134 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8a423-fd44-4931-b05a-af4fd674ee55 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:56:25.797343 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 678/1349] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:56:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:56:31.158185 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6008d-8d2b-4441-8496-03ea396918b0 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:31.159105 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6008d-8d2b-4441-8496-03ea396918b0 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:31.159531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6008d-8d2b-4441-8496-03ea396918b0 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:31.163164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 672/1350] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 08:56:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:56:31.176777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0bb99-33f9-475a-bc1a-2f6c47e486d8 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:31.176777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0bb99-33f9-475a-bc1a-2f6c47e486d8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:31.176777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0bb99-33f9-475a-bc1a-2f6c47e486d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:31.357192 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f6f0bb99-33f9-475a-bc1a-2f6c47e486d8 None None] MFA Rules not processed for user `3d69004d02f9426b86e07907a553e523`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:56:31.357454 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f6f0bb99-33f9-475a-bc1a-2f6c47e486d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:31.401434 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:31.590373 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 679/1351] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 08:56:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:56:36.819406 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1081fa-7d0c-47af-9994-2a688beb19e8 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:36.819957 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1081fa-7d0c-47af-9994-2a688beb19e8 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:36.819957 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1081fa-7d0c-47af-9994-2a688beb19e8 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:36.821354 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 673/1352] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 08:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:56:36.826986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3ab66-0fb8-450f-8bec-74b6aa881a67 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:36.828046 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3ab66-0fb8-450f-8bec-74b6aa881a67 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:36.828046 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3ab66-0fb8-450f-8bec-74b6aa881a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:36.920649 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-dea3ab66-0fb8-450f-8bec-74b6aa881a67 None None] MFA Rules not processed for user `3d69004d02f9426b86e07907a553e523`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:56:36.922805 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-dea3ab66-0fb8-450f-8bec-74b6aa881a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:37.023472 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:37.064270 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 680/1353] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 08:56:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:56:38.082091 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1250c4-3e53-45f3-8016-a6765fd25cbd None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:38.082695 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1250c4-3e53-45f3-8016-a6765fd25cbd None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:38.082837 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1250c4-3e53-45f3-8016-a6765fd25cbd None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:38.084531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 674/1354] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 08:56:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:56:38.090705 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9310b-2428-4c1a-9445-b69ca7f1d1c6 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:38.091310 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9310b-2428-4c1a-9445-b69ca7f1d1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:38.091651 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9310b-2428-4c1a-9445-b69ca7f1d1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:38.191981 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-d5f9310b-2428-4c1a-9445-b69ca7f1d1c6 None None] MFA Rules not processed for user `3d69004d02f9426b86e07907a553e523`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:56:38.193535 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d5f9310b-2428-4c1a-9445-b69ca7f1d1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:38.310656 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 681/1355] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 08:56:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:56:41.869052 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b301941-4828-4ebe-9499-7036deedc46d None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:41.869605 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b301941-4828-4ebe-9499-7036deedc46d None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:41.869605 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b301941-4828-4ebe-9499-7036deedc46d None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:41.871312 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 675/1356] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:56:41.877384 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce9648-34d3-4f6e-ab1e-8d4afde2de1b None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:41.877876 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce9648-34d3-4f6e-ab1e-8d4afde2de1b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:41.877977 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce9648-34d3-4f6e-ab1e-8d4afde2de1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:41.934676 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:41.989800 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-c3ce9648-34d3-4f6e-ab1e-8d4afde2de1b None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:56:41.992034 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c3ce9648-34d3-4f6e-ab1e-8d4afde2de1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:42.169236 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 682/1357] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:56:42.259233 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125abae7-6329-41e0-ae2f-63e90d35c8bb None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:42.259886 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125abae7-6329-41e0-ae2f-63e90d35c8bb None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:42.260405 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125abae7-6329-41e0-ae2f-63e90d35c8bb None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:42.262661 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 676/1358] 10.222.0.65 () {54 vars in 962 bytes} [Wed Jul 27 08:56:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:56:42.276886 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388a6f3-59a3-47a0-9155-1e4cb29374a2 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:42.277348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388a6f3-59a3-47a0-9155-1e4cb29374a2 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:42.277827 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388a6f3-59a3-47a0-9155-1e4cb29374a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:42.410833 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-0388a6f3-59a3-47a0-9155-1e4cb29374a2 None None] MFA Rules not processed for user `c30bc55c6a1348bb961f0d010422da87`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:56:42.412701 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-0388a6f3-59a3-47a0-9155-1e4cb29374a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:42.491925 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:42.595682 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 683/1359] 10.222.0.65 () {58 vars in 1059 bytes} [Wed Jul 27 08:56:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:56:42.603609 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125abae7-6329-41e0-ae2f-63e90d35c8bb None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:56:42.605106 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-125abae7-6329-41e0-ae2f-63e90d35c8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:42.803702 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125abae7-6329-41e0-ae2f-63e90d35c8bb None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:56:42.885212 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:42.933911 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e5bd5-640f-4f96-9b9e-ff81dc9c4ca7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:56:42.934577 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e5bd5-640f-4f96-9b9e-ff81dc9c4ca7 service nova] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:42.934907 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e5bd5-640f-4f96-9b9e-ff81dc9c4ca7 service nova] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:42.935322 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e5bd5-640f-4f96-9b9e-ff81dc9c4ca7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:42.937813 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-691e5bd5-640f-4f96-9b9e-ff81dc9c4ca7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:43.070161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e5bd5-640f-4f96-9b9e-ff81dc9c4ca7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:56:43.071863 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e5bd5-640f-4f96-9b9e-ff81dc9c4ca7 service nova] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:56:43.094444 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 677/1360] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:56:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:56:46.155472 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed019bba-dc17-4a4e-87f9-0b4a455fcd28 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:46.155472 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed019bba-dc17-4a4e-87f9-0b4a455fcd28 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:46.155472 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed019bba-dc17-4a4e-87f9-0b4a455fcd28 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:46.159465 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 684/1361] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:56:46.163813 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1feb58-4346-4729-af85-58f3a2e10520 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:46.163813 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1feb58-4346-4729-af85-58f3a2e10520 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:46.163813 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1feb58-4346-4729-af85-58f3a2e10520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:46.269740 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-7a1feb58-4346-4729-af85-58f3a2e10520 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:56:46.271183 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-7a1feb58-4346-4729-af85-58f3a2e10520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:46.317430 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:46.395336 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 678/1362] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:56:46.442786 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed019bba-dc17-4a4e-87f9-0b4a455fcd28 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:56:46.445848 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ed019bba-dc17-4a4e-87f9-0b4a455fcd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:46.705808 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed019bba-dc17-4a4e-87f9-0b4a455fcd28 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:56:46.725075 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:46.856732 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd539f27-aff4-4641-a77a-9117497d71f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:56:46.857621 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd539f27-aff4-4641-a77a-9117497d71f4 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:46.858032 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd539f27-aff4-4641-a77a-9117497d71f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:46.858481 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd539f27-aff4-4641-a77a-9117497d71f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:46.860735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fd539f27-aff4-4641-a77a-9117497d71f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:47.006760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd539f27-aff4-4641-a77a-9117497d71f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:56:47.008834 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd539f27-aff4-4641-a77a-9117497d71f4 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:56:47.052713 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 685/1363] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:56:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:56:49.974428 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a24782-862c-4c49-a2e8-43e8799babd4 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:49.975318 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a24782-862c-4c49-a2e8-43e8799babd4 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:49.975318 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a24782-862c-4c49-a2e8-43e8799babd4 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:49.977072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 679/1364] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:56:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:56:49.986018 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d6109-14c3-4931-a7f4-7b305523a09d None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:49.986620 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d6109-14c3-4931-a7f4-7b305523a09d None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:49.986977 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d6109-14c3-4931-a7f4-7b305523a09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:50.018851 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:50.121336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-cb9d6109-14c3-4931-a7f4-7b305523a09d None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:56:50.123271 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-cb9d6109-14c3-4931-a7f4-7b305523a09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:50.328467 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 686/1365] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:56:50.385187 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6d098-1054-47bc-b98c-ce6592684aa8 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:50.386047 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6d098-1054-47bc-b98c-ce6592684aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:50.386872 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6d098-1054-47bc-b98c-ce6592684aa8 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:50.389664 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 680/1366] 10.222.0.65 () {54 vars in 962 bytes} [Wed Jul 27 08:56:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:56:50.399129 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac5fc3-25f5-4f85-b7ec-e26f89e8ba9a None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:50.399415 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac5fc3-25f5-4f85-b7ec-e26f89e8ba9a None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:50.399831 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac5fc3-25f5-4f85-b7ec-e26f89e8ba9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:50.505357 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-1cac5fc3-25f5-4f85-b7ec-e26f89e8ba9a None None] MFA Rules not processed for user `c30bc55c6a1348bb961f0d010422da87`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:56:50.507930 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1cac5fc3-25f5-4f85-b7ec-e26f89e8ba9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:50.574950 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:50.734883 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 687/1367] 10.222.0.65 () {58 vars in 1059 bytes} [Wed Jul 27 08:56:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:56:50.747996 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6d098-1054-47bc-b98c-ce6592684aa8 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:56:50.752038 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-02d6d098-1054-47bc-b98c-ce6592684aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:51.068300 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6d098-1054-47bc-b98c-ce6592684aa8 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:56:51.106696 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:51.290834 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5e44d-1b63-4a9c-8927-77fa56f3f0d2 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:51.291724 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5e44d-1b63-4a9c-8927-77fa56f3f0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:51.291724 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5e44d-1b63-4a9c-8927-77fa56f3f0d2 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:51.292999 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 688/1368] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:56:51.299375 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160ad0f-1c89-479a-88fd-1f0a9be79740 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:51.299690 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160ad0f-1c89-479a-88fd-1f0a9be79740 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:51.299942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160ad0f-1c89-479a-88fd-1f0a9be79740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:51.303760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431fd56-82ab-4a86-9246-f2b7568ebb0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:56:51.304657 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431fd56-82ab-4a86-9246-f2b7568ebb0d service nova] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:51.305150 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431fd56-82ab-4a86-9246-f2b7568ebb0d service nova] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:51.305553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431fd56-82ab-4a86-9246-f2b7568ebb0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:51.308388 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-9431fd56-82ab-4a86-9246-f2b7568ebb0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:51.378634 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-a160ad0f-1c89-479a-88fd-1f0a9be79740 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:56:51.379748 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a160ad0f-1c89-479a-88fd-1f0a9be79740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:51.453682 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431fd56-82ab-4a86-9246-f2b7568ebb0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:56:51.455938 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431fd56-82ab-4a86-9246-f2b7568ebb0d service nova] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:56:51.479440 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 681/1369] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:56:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 733 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:56:51.522685 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:51.534362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 689/1370] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:56:51.858885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbc1f7-f2ea-4c41-9cb4-895b447b8b23 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:51.859208 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbc1f7-f2ea-4c41-9cb4-895b447b8b23 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:51.859487 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbc1f7-f2ea-4c41-9cb4-895b447b8b23 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:51.861130 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 682/1371] 10.222.0.65 () {54 vars in 964 bytes} [Wed Jul 27 08:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:56:51.866333 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd05126-7c89-4080-9c07-2c45bc06d381 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:51.866660 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd05126-7c89-4080-9c07-2c45bc06d381 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:51.866892 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd05126-7c89-4080-9c07-2c45bc06d381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:51.958641 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-3cd05126-7c89-4080-9c07-2c45bc06d381 None None] MFA Rules not processed for user `72763a52df364a4a8a660ec1be4aba79`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:56:51.959899 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-3cd05126-7c89-4080-9c07-2c45bc06d381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:52.052679 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 690/1372] 10.222.0.65 () {58 vars in 1061 bytes} [Wed Jul 27 08:56:51 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:56:52.060686 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbc1f7-f2ea-4c41-9cb4-895b447b8b23 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:56:52.063368 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-03bbc1f7-f2ea-4c41-9cb4-895b447b8b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:52.097903 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:52.200250 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbc1f7-f2ea-4c41-9cb4-895b447b8b23 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:56:52.321613 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb2f89-c414-4564-907e-47eb64270fbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:56:52.322270 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb2f89-c414-4564-907e-47eb64270fbc service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:52.322581 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb2f89-c414-4564-907e-47eb64270fbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:52.322978 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb2f89-c414-4564-907e-47eb64270fbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:52.324840 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-eacb2f89-c414-4564-907e-47eb64270fbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:52.429149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:52.470130 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb2f89-c414-4564-907e-47eb64270fbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:56:52.471632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb2f89-c414-4564-907e-47eb64270fbc service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:56:52.495728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 683/1373] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:56:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:56:53.787521 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad084a4-56fb-4835-b313-af8823ee0036 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:53.788126 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad084a4-56fb-4835-b313-af8823ee0036 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:53.788126 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad084a4-56fb-4835-b313-af8823ee0036 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:53.789552 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 691/1374] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:56:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:56:53.795692 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc970ea-2c1d-4484-b541-3ff280f14efa None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:53.796263 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc970ea-2c1d-4484-b541-3ff280f14efa None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:53.796263 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc970ea-2c1d-4484-b541-3ff280f14efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:53.879295 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-ccc970ea-2c1d-4484-b541-3ff280f14efa None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:56:53.880545 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-ccc970ea-2c1d-4484-b541-3ff280f14efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:53.996676 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 684/1375] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:56:54.042871 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad084a4-56fb-4835-b313-af8823ee0036 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:56:54.044387 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-3ad084a4-56fb-4835-b313-af8823ee0036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:54.167224 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:54.247183 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad084a4-56fb-4835-b313-af8823ee0036 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:56:54.386346 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097bc79-e2cc-41cf-91ef-31b36ddefb22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:56:54.387123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097bc79-e2cc-41cf-91ef-31b36ddefb22 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:54.387509 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097bc79-e2cc-41cf-91ef-31b36ddefb22 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:54.387925 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097bc79-e2cc-41cf-91ef-31b36ddefb22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:54.390396 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-2097bc79-e2cc-41cf-91ef-31b36ddefb22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:54.452562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:54.503912 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097bc79-e2cc-41cf-91ef-31b36ddefb22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:56:54.505465 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097bc79-e2cc-41cf-91ef-31b36ddefb22 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:56:54.526186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 692/1376] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:56:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:56:56.655938 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236413b2-6e9e-4d39-bb51-1c62b31bd91b None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:56.657328 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236413b2-6e9e-4d39-bb51-1c62b31bd91b None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:56.657328 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236413b2-6e9e-4d39-bb51-1c62b31bd91b None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:56.660149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 685/1377] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:56:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:56:56.664141 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec8ca6-e13e-4261-bd68-a289056aaafb None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:56.664940 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec8ca6-e13e-4261-bd68-a289056aaafb None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:56.664940 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec8ca6-e13e-4261-bd68-a289056aaafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:56.748774 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-8dec8ca6-e13e-4261-bd68-a289056aaafb None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:56:56.750029 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-8dec8ca6-e13e-4261-bd68-a289056aaafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:56.862060 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 693/1378] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:56:56.908384 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236413b2-6e9e-4d39-bb51-1c62b31bd91b None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:56:56.909812 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-236413b2-6e9e-4d39-bb51-1c62b31bd91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:56.951825 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:57.105434 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236413b2-6e9e-4d39-bb51-1c62b31bd91b None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:56:57.329136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:56:57.342240 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f11320-cf6d-4b2b-81ea-2ef34cb704d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:56:57.343648 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f11320-cf6d-4b2b-81ea-2ef34cb704d2 service nova] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:57.344961 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f11320-cf6d-4b2b-81ea-2ef34cb704d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:57.345613 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f11320-cf6d-4b2b-81ea-2ef34cb704d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:57.349090 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-11f11320-cf6d-4b2b-81ea-2ef34cb704d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:56:57.513466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f11320-cf6d-4b2b-81ea-2ef34cb704d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:56:57.515303 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f11320-cf6d-4b2b-81ea-2ef34cb704d2 service nova] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:56:57.549990 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 686/1379] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:56:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:56:59.981613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b9e86-b21b-498e-8f82-d432cfffa8c0 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:59.982486 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b9e86-b21b-498e-8f82-d432cfffa8c0 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:59.982486 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b9e86-b21b-498e-8f82-d432cfffa8c0 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:59.990036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac11181-b98a-404d-8727-a59915bc228f None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:56:59.990826 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac11181-b98a-404d-8727-a59915bc228f None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:56:59.990826 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac11181-b98a-404d-8727-a59915bc228f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:56:59.992769 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 694/1380] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:56:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:57:00.079884 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-aac11181-b98a-404d-8727-a59915bc228f None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:57:00.081121 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-aac11181-b98a-404d-8727-a59915bc228f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:00.186518 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:00.227819 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 687/1381] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:57:00.316684 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b9e86-b21b-498e-8f82-d432cfffa8c0 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:57:00.319564 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a74b9e86-b21b-498e-8f82-d432cfffa8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:00.391759 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:00.589382 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b9e86-b21b-498e-8f82-d432cfffa8c0 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:57:00.760870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:00.800232 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04809c4c-e01f-4362-a79b-d6fb2807274d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:57:00.801160 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04809c4c-e01f-4362-a79b-d6fb2807274d service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:00.801732 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04809c4c-e01f-4362-a79b-d6fb2807274d service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:00.802202 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04809c4c-e01f-4362-a79b-d6fb2807274d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:00.805158 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-04809c4c-e01f-4362-a79b-d6fb2807274d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:00.983803 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04809c4c-e01f-4362-a79b-d6fb2807274d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:57:00.991162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04809c4c-e01f-4362-a79b-d6fb2807274d service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:57:01.020397 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 695/1382] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:57:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:57:03.213539 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae37e59-825b-4512-aa2b-2cfd9d5ba598 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:03.214394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae37e59-825b-4512-aa2b-2cfd9d5ba598 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:03.214394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae37e59-825b-4512-aa2b-2cfd9d5ba598 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:03.215810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 688/1383] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:57:03.222869 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d56dd-3b70-4441-99f1-3ff51add351a None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:03.223747 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d56dd-3b70-4441-99f1-3ff51add351a None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:03.224001 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d56dd-3b70-4441-99f1-3ff51add351a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:03.347843 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-586d56dd-3b70-4441-99f1-3ff51add351a None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:57:03.349615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-586d56dd-3b70-4441-99f1-3ff51add351a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:03.420878 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:03.475394 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 696/1384] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:57:03.523987 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae37e59-825b-4512-aa2b-2cfd9d5ba598 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:57:03.528117 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-bae37e59-825b-4512-aa2b-2cfd9d5ba598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:03.801114 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae37e59-825b-4512-aa2b-2cfd9d5ba598 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:57:03.882304 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:03.993937 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be817f1-5e6d-4573-bfad-d7609a4f8a86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:57:03.994980 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be817f1-5e6d-4573-bfad-d7609a4f8a86 service nova] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:03.995470 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be817f1-5e6d-4573-bfad-d7609a4f8a86 service nova] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:03.995935 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be817f1-5e6d-4573-bfad-d7609a4f8a86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:03.999041 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-6be817f1-5e6d-4573-bfad-d7609a4f8a86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:04.158003 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be817f1-5e6d-4573-bfad-d7609a4f8a86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:57:04.161279 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be817f1-5e6d-4573-bfad-d7609a4f8a86 service nova] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:57:04.194566 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 689/1385] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:57:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:57:06.523837 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566e292-8914-4dcf-85c3-3112085123dd None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:06.524523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566e292-8914-4dcf-85c3-3112085123dd None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:06.524523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566e292-8914-4dcf-85c3-3112085123dd None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:06.525894 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 697/1386] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:57:06.532770 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a729ea-63bc-4f2f-8045-2422e26454ee None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:06.533584 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a729ea-63bc-4f2f-8045-2422e26454ee None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:06.533584 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a729ea-63bc-4f2f-8045-2422e26454ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:06.629238 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-77a729ea-63bc-4f2f-8045-2422e26454ee None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:57:06.631129 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-77a729ea-63bc-4f2f-8045-2422e26454ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:06.651082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:06.765921 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 690/1387] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:57:06.815773 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566e292-8914-4dcf-85c3-3112085123dd None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:57:06.818019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e566e292-8914-4dcf-85c3-3112085123dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:07.029654 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566e292-8914-4dcf-85c3-3112085123dd None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:57:07.097724 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:07.194156 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef67c1-4049-4b37-b082-6af06693f7a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:57:07.195466 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef67c1-4049-4b37-b082-6af06693f7a9 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:07.196007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef67c1-4049-4b37-b082-6af06693f7a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:07.196505 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef67c1-4049-4b37-b082-6af06693f7a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:07.199761 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e0ef67c1-4049-4b37-b082-6af06693f7a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:07.351876 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef67c1-4049-4b37-b082-6af06693f7a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:57:07.353704 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef67c1-4049-4b37-b082-6af06693f7a9 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:57:07.376171 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 698/1388] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:57:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:57:09.394416 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ff230-fc86-4b89-a9f8-80f1871194e4 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:09.394958 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ff230-fc86-4b89-a9f8-80f1871194e4 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:09.395300 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ff230-fc86-4b89-a9f8-80f1871194e4 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:09.397844 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 691/1389] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:57:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:57:09.407136 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fab08d-856d-468a-ae93-d720bf2f1309 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:09.407915 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fab08d-856d-468a-ae93-d720bf2f1309 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:09.408091 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fab08d-856d-468a-ae93-d720bf2f1309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:09.493979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:09.499011 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-d7fab08d-856d-468a-ae93-d720bf2f1309 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:57:09.500791 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d7fab08d-856d-468a-ae93-d720bf2f1309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:09.627867 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 699/1390] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:57:09.694714 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f23710-66e1-4a98-91fa-6b8f3679ab76 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:09.694997 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f23710-66e1-4a98-91fa-6b8f3679ab76 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:09.695313 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f23710-66e1-4a98-91fa-6b8f3679ab76 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:09.696727 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 692/1391] 10.222.0.65 () {54 vars in 966 bytes} [Wed Jul 27 08:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:57:09.702490 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5044759-a3a2-4156-8ef4-781a7d76c57a None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:09.702787 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5044759-a3a2-4156-8ef4-781a7d76c57a None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:09.703068 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5044759-a3a2-4156-8ef4-781a7d76c57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:09.787357 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-a5044759-a3a2-4156-8ef4-781a7d76c57a None None] MFA Rules not processed for user `713805e0f1174a01987014319075ec03`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:57:09.788634 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a5044759-a3a2-4156-8ef4-781a7d76c57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:09.872418 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:09.879944 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 700/1392] 10.222.0.65 () {58 vars in 1063 bytes} [Wed Jul 27 08:57:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:57:09.887568 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f23710-66e1-4a98-91fa-6b8f3679ab76 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:57:09.889089 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-39f23710-66e1-4a98-91fa-6b8f3679ab76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:10.067434 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f23710-66e1-4a98-91fa-6b8f3679ab76 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:57:10.114388 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:10.186486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813d8fc-0748-4d9f-a255-7bae214eaf0f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713805e0f1174a01987014319075ec03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:57:10.187112 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813d8fc-0748-4d9f-a255-7bae214eaf0f service glance] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:10.187396 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813d8fc-0748-4d9f-a255-7bae214eaf0f service glance] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:10.188310 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813d8fc-0748-4d9f-a255-7bae214eaf0f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:10.190266 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-0813d8fc-0748-4d9f-a255-7bae214eaf0f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:10.233774 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b83cc6-7c83-44ef-ae67-efa75b2d4a0c None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:10.233994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b83cc6-7c83-44ef-ae67-efa75b2d4a0c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:10.234236 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b83cc6-7c83-44ef-ae67-efa75b2d4a0c None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:10.236025 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 701/1393] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:57:10.242221 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcc223-5a66-4d85-a8f1-d3074e832aa6 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:10.242552 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcc223-5a66-4d85-a8f1-d3074e832aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:10.242833 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcc223-5a66-4d85-a8f1-d3074e832aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:10.319817 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-8dbcc223-5a66-4d85-a8f1-d3074e832aa6 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:57:10.321037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-8dbcc223-5a66-4d85-a8f1-d3074e832aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:10.342428 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813d8fc-0748-4d9f-a255-7bae214eaf0f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:57:10.344084 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813d8fc-0748-4d9f-a255-7bae214eaf0f service glance] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:57:10.366392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 693/1394] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:57:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:57:10.439490 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 702/1395] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:57:10.487922 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813d8fc-0748-4d9f-a255-7bae214eaf0f service glance] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:57:10.489041 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-0813d8fc-0748-4d9f-a255-7bae214eaf0f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:10.570791 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:10.610557 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813d8fc-0748-4d9f-a255-7bae214eaf0f service glance] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:57:10.769201 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e71474-f7ce-48d9-a270-447995af6dcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:57:10.769836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e71474-f7ce-48d9-a270-447995af6dcc service nova] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:10.770116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e71474-f7ce-48d9-a270-447995af6dcc service nova] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:10.770439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e71474-f7ce-48d9-a270-447995af6dcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:10.772212 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-36e71474-f7ce-48d9-a270-447995af6dcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:10.871960 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:10.888230 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e71474-f7ce-48d9-a270-447995af6dcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:57:10.889873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e71474-f7ce-48d9-a270-447995af6dcc service nova] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:57:10.911188 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 694/1396] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:57:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:57:11.224135 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad873c60-563f-49cd-8cd3-1438a2dbc89c None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:11.224508 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad873c60-563f-49cd-8cd3-1438a2dbc89c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:11.224851 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad873c60-563f-49cd-8cd3-1438a2dbc89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:11.305202 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-ad873c60-563f-49cd-8cd3-1438a2dbc89c None None] MFA Rules not processed for user `c607472800fc49d5a75c5e6acb33f2a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:57:11.306523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ad873c60-563f-49cd-8cd3-1438a2dbc89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:11.338688 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:11.416086 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 703/1397] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 08:57:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:57:11.472666 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f77ec1-be7c-4361-9584-48b5728b615e None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:11.473047 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f77ec1-be7c-4361-9584-48b5728b615e None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:11.473395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f77ec1-be7c-4361-9584-48b5728b615e None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:11.475027 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 695/1398] 10.222.0.65 () {54 vars in 943 bytes} [Wed Jul 27 08:57:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:57:11.482825 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0f600-77b4-409c-aeae-1cb2c3e146f0 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:11.483389 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0f600-77b4-409c-aeae-1cb2c3e146f0 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:11.483793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0f600-77b4-409c-aeae-1cb2c3e146f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:11.574890 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-76c0f600-77b4-409c-aeae-1cb2c3e146f0 None None] MFA Rules not processed for user `158ea5c9dd5142eebd903d5f732997ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:57:11.576685 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-76c0f600-77b4-409c-aeae-1cb2c3e146f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:11.698692 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:11.705430 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 704/1399] 10.222.0.65 () {58 vars in 1040 bytes} [Wed Jul 27 08:57:11 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:57:11.715482 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f77ec1-be7c-4361-9584-48b5728b615e None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:57:11.717023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-21f77ec1-be7c-4361-9584-48b5728b615e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:11.870112 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f77ec1-be7c-4361-9584-48b5728b615e None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:57:11.942784 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:11.993280 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d77aa-1ee9-443d-bec8-d5eac54d9380 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158ea5c9dd5142eebd903d5f732997ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:57:11.993799 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d77aa-1ee9-443d-bec8-d5eac54d9380 service swift] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:11.994085 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d77aa-1ee9-443d-bec8-d5eac54d9380 service swift] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:11.994393 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d77aa-1ee9-443d-bec8-d5eac54d9380 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:11.996137 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-1e1d77aa-1ee9-443d-bec8-d5eac54d9380 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:12.089178 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d77aa-1ee9-443d-bec8-d5eac54d9380 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:57:12.094586 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d77aa-1ee9-443d-bec8-d5eac54d9380 service swift] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:57:12.100313 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 696/1400] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 08:57:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 08:57:13.113934 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885091c3-2b7f-4eda-b579-db0ec7c557db None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:13.114717 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885091c3-2b7f-4eda-b579-db0ec7c557db None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:13.114717 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885091c3-2b7f-4eda-b579-db0ec7c557db None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:13.116267 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 705/1401] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:57:13.124389 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c482e2-aa47-4f2e-b2b7-ee9b5d013775 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:13.125106 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c482e2-aa47-4f2e-b2b7-ee9b5d013775 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:13.126170 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c482e2-aa47-4f2e-b2b7-ee9b5d013775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:13.257146 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-94c482e2-aa47-4f2e-b2b7-ee9b5d013775 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:57:13.259429 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-94c482e2-aa47-4f2e-b2b7-ee9b5d013775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:13.344464 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:13.412126 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 697/1402] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:57:13.464354 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885091c3-2b7f-4eda-b579-db0ec7c557db None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:57:13.467537 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-885091c3-2b7f-4eda-b579-db0ec7c557db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:13.707405 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885091c3-2b7f-4eda-b579-db0ec7c557db None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:57:13.865317 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:13.995824 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ea1b5-a3a0-466a-a21f-bcd3574bca8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:57:13.996892 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ea1b5-a3a0-466a-a21f-bcd3574bca8a service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:13.998718 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ea1b5-a3a0-466a-a21f-bcd3574bca8a service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:13.999176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ea1b5-a3a0-466a-a21f-bcd3574bca8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:14.003170 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9d9ea1b5-a3a0-466a-a21f-bcd3574bca8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:14.150532 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ea1b5-a3a0-466a-a21f-bcd3574bca8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:57:14.152607 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ea1b5-a3a0-466a-a21f-bcd3574bca8a service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:57:14.180331 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 706/1403] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:57:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 717 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:57:16.574243 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed3eee-75c0-433a-b686-ce08b1d53946 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:16.574884 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed3eee-75c0-433a-b686-ce08b1d53946 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:16.575278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed3eee-75c0-433a-b686-ce08b1d53946 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:16.577791 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 698/1404] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:57:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:57:16.583914 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced9891-cc4e-4e02-abf5-a30290b7cbd6 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:16.584440 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced9891-cc4e-4e02-abf5-a30290b7cbd6 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:16.584440 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced9891-cc4e-4e02-abf5-a30290b7cbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:16.668041 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-eced9891-cc4e-4e02-abf5-a30290b7cbd6 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:57:16.669265 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-eced9891-cc4e-4e02-abf5-a30290b7cbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:16.711111 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:16.792587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 707/1405] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:57:16.839891 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed3eee-75c0-433a-b686-ce08b1d53946 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:57:16.841434 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-02ed3eee-75c0-433a-b686-ce08b1d53946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:17.103796 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed3eee-75c0-433a-b686-ce08b1d53946 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:57:17.156406 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:17.321621 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2737e-2116-4dac-b163-1ca9db016736 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:57:17.322640 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2737e-2116-4dac-b163-1ca9db016736 service nova] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:17.323105 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2737e-2116-4dac-b163-1ca9db016736 service nova] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:17.323554 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2737e-2116-4dac-b163-1ca9db016736 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:17.326640 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-0ff2737e-2116-4dac-b163-1ca9db016736 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:17.500028 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2737e-2116-4dac-b163-1ca9db016736 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:57:17.501955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2737e-2116-4dac-b163-1ca9db016736 service nova] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:57:17.535442 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 699/1406] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:57:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 692 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:57:20.014992 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9499e-5946-42a6-8e41-a3eb7b5e3d19 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:20.016195 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9499e-5946-42a6-8e41-a3eb7b5e3d19 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:20.017064 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9499e-5946-42a6-8e41-a3eb7b5e3d19 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:20.019910 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 708/1407] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:57:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:57:20.027776 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856f13f-a9b8-4a38-9720-387bd8bcd255 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:20.028446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856f13f-a9b8-4a38-9720-387bd8bcd255 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:20.028831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856f13f-a9b8-4a38-9720-387bd8bcd255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:20.119103 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:20.159196 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-e856f13f-a9b8-4a38-9720-387bd8bcd255 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:57:20.160630 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-e856f13f-a9b8-4a38-9720-387bd8bcd255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:20.338347 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 700/1408] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:57:20.377274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9499e-5946-42a6-8e41-a3eb7b5e3d19 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:57:20.379156 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b5e9499e-5946-42a6-8e41-a3eb7b5e3d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:20.562793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9499e-5946-42a6-8e41-a3eb7b5e3d19 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:57:20.583503 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:20.732300 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d5560-3dc1-4a3a-88ab-79cfac2cf492 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:57:20.733192 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d5560-3dc1-4a3a-88ab-79cfac2cf492 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:20.733666 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d5560-3dc1-4a3a-88ab-79cfac2cf492 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:20.736749 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d5560-3dc1-4a3a-88ab-79cfac2cf492 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:20.738359 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-566d5560-3dc1-4a3a-88ab-79cfac2cf492 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:20.884798 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d5560-3dc1-4a3a-88ab-79cfac2cf492 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:57:20.886920 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d5560-3dc1-4a3a-88ab-79cfac2cf492 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:57:20.917157 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 709/1409] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:57:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:57:30.326514 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=47 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:30.912136 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=90 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:36.001763 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015bd863-8896-4138-adad-63167c24f786 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:36.002582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015bd863-8896-4138-adad-63167c24f786 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:36.002582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015bd863-8896-4138-adad-63167c24f786 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:36.003735 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 701/1410] 10.222.0.65 () {54 vars in 918 bytes} [Wed Jul 27 08:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:57:36.009345 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403eeb36-79c0-439d-9abd-095dd46480cb None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:36.009825 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403eeb36-79c0-439d-9abd-095dd46480cb None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:36.009934 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403eeb36-79c0-439d-9abd-095dd46480cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:36.095962 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-403eeb36-79c0-439d-9abd-095dd46480cb None None] MFA Rules not processed for user `3d69004d02f9426b86e07907a553e523`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:57:36.097244 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-403eeb36-79c0-439d-9abd-095dd46480cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:36.217638 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 710/1411] 10.222.0.65 () {58 vars in 1015 bytes} [Wed Jul 27 08:57:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:57:36.233452 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df47070-a080-4d90-a2f9-97a31b263de9 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:36.233734 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df47070-a080-4d90-a2f9-97a31b263de9 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:36.234009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df47070-a080-4d90-a2f9-97a31b263de9 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:36.236103 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 702/1412] 10.222.0.65 () {54 vars in 918 bytes} [Wed Jul 27 08:57:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:57:36.241377 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd4be6-f7f5-4083-a999-067513276ceb None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:36.241665 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd4be6-f7f5-4083-a999-067513276ceb None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:36.241946 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd4be6-f7f5-4083-a999-067513276ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:36.321010 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:36.324038 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-3dfd4be6-f7f5-4083-a999-067513276ceb None None] MFA Rules not processed for user `c30bc55c6a1348bb961f0d010422da87`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:57:36.325791 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-3dfd4be6-f7f5-4083-a999-067513276ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:36.448524 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 711/1413] 10.222.0.65 () {58 vars in 1015 bytes} [Wed Jul 27 08:57:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:57:38.987251 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03026d1b-4fd3-4b17-8fe0-2e23534429a0 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:38.987822 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03026d1b-4fd3-4b17-8fe0-2e23534429a0 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:38.987822 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03026d1b-4fd3-4b17-8fe0-2e23534429a0 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:38.989162 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 08:57:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:57:38.994613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade12107-ae0e-4d2f-986e-d2a1d3b3e03b None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:38.995040 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade12107-ae0e-4d2f-986e-d2a1d3b3e03b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:38.995177 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade12107-ae0e-4d2f-986e-d2a1d3b3e03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:39.069370 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-ade12107-ae0e-4d2f-986e-d2a1d3b3e03b None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:57:39.070545 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ade12107-ae0e-4d2f-986e-d2a1d3b3e03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:39.131080 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:39.184568 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 08:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:57:39.229241 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03026d1b-4fd3-4b17-8fe0-2e23534429a0 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:57:39.230827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-03026d1b-4fd3-4b17-8fe0-2e23534429a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:39.396363 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03026d1b-4fd3-4b17-8fe0-2e23534429a0 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:57:39.476953 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:39.521377 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeff306-36aa-4f4e-8975-6f31da926d2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:57:39.522134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeff306-36aa-4f4e-8975-6f31da926d2a service nova] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:39.522547 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeff306-36aa-4f4e-8975-6f31da926d2a service nova] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:39.522929 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeff306-36aa-4f4e-8975-6f31da926d2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:39.524657 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-efeff306-36aa-4f4e-8975-6f31da926d2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:39.626388 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeff306-36aa-4f4e-8975-6f31da926d2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:57:39.628038 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeff306-36aa-4f4e-8975-6f31da926d2a service nova] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:57:39.647824 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 704/1416] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:57:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 08:57:40.608119 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45f91d-f879-46c5-8496-591d77666b0c None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:40.608958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45f91d-f879-46c5-8496-591d77666b0c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:40.609124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45f91d-f879-46c5-8496-591d77666b0c None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:40.611227 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 08:57:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:57:40.618182 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a2d63-55b3-4c72-83c5-099574bdb347 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:40.618793 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a2d63-55b3-4c72-83c5-099574bdb347 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:40.618793 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a2d63-55b3-4c72-83c5-099574bdb347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:40.712073 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-a82a2d63-55b3-4c72-83c5-099574bdb347 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:57:40.713285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-a82a2d63-55b3-4c72-83c5-099574bdb347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:40.749296 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:40.849820 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 08:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:57:41.000046 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45f91d-f879-46c5-8496-591d77666b0c None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:57:41.001829 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fd45f91d-f879-46c5-8496-591d77666b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:41.162799 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45f91d-f879-46c5-8496-591d77666b0c None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:57:41.206085 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:41.316538 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e4a72-25e1-4fb1-9229-8b4efe5eef78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:57:41.317170 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e4a72-25e1-4fb1-9229-8b4efe5eef78 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:41.317450 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e4a72-25e1-4fb1-9229-8b4efe5eef78 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:41.317729 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e4a72-25e1-4fb1-9229-8b4efe5eef78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:41.319438 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-eb5e4a72-25e1-4fb1-9229-8b4efe5eef78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:41.416708 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e4a72-25e1-4fb1-9229-8b4efe5eef78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:57:41.418345 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e4a72-25e1-4fb1-9229-8b4efe5eef78 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:57:41.436917 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 714/1419] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:57:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:57:42.363626 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56ada7-6bd9-410d-ba60-c2673059a32f None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:42.364209 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56ada7-6bd9-410d-ba60-c2673059a32f None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:42.364209 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56ada7-6bd9-410d-ba60-c2673059a32f None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:42.365523 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 08:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:57:42.371300 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75299f8e-178f-4c1c-9326-2dd56fbcee2e None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:42.371848 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75299f8e-178f-4c1c-9326-2dd56fbcee2e None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:42.372103 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75299f8e-178f-4c1c-9326-2dd56fbcee2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:42.454474 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:42.482861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-75299f8e-178f-4c1c-9326-2dd56fbcee2e None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:57:42.484069 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-75299f8e-178f-4c1c-9326-2dd56fbcee2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:42.588661 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 08:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:57:42.747639 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56ada7-6bd9-410d-ba60-c2673059a32f None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:57:42.749947 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-5a56ada7-6bd9-410d-ba60-c2673059a32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:43.004526 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56ada7-6bd9-410d-ba60-c2673059a32f None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:57:43.022124 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:43.171760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a18a1-cc87-4c40-9161-8aa3df972f16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:57:43.172851 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a18a1-cc87-4c40-9161-8aa3df972f16 service nova] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:43.173369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a18a1-cc87-4c40-9161-8aa3df972f16 service nova] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:43.173875 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a18a1-cc87-4c40-9161-8aa3df972f16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:43.177476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-c79a18a1-cc87-4c40-9161-8aa3df972f16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:43.305949 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a18a1-cc87-4c40-9161-8aa3df972f16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:57:43.307647 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a18a1-cc87-4c40-9161-8aa3df972f16 service nova] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:57:43.332224 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 707/1422] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:57:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:57:44.227965 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029910e3-aee9-43f7-a3cf-b2476a39dc08 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:44.228566 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029910e3-aee9-43f7-a3cf-b2476a39dc08 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:44.228566 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029910e3-aee9-43f7-a3cf-b2476a39dc08 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:44.229936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 08:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:57:44.236826 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4b5e9-45f2-45d7-86f1-027a8aa39be5 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:44.237398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4b5e9-45f2-45d7-86f1-027a8aa39be5 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:44.237576 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4b5e9-45f2-45d7-86f1-027a8aa39be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:44.260403 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:44.328507 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-91c4b5e9-45f2-45d7-86f1-027a8aa39be5 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:57:44.329844 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-91c4b5e9-45f2-45d7-86f1-027a8aa39be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:44.441851 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 08:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:57:44.596179 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029910e3-aee9-43f7-a3cf-b2476a39dc08 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:57:44.597726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-029910e3-aee9-43f7-a3cf-b2476a39dc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:44.721639 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:44.765424 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029910e3-aee9-43f7-a3cf-b2476a39dc08 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:57:44.893805 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13961430-f613-4573-b0c7-02c4c686ff56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:57:44.894377 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13961430-f613-4573-b0c7-02c4c686ff56 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:44.894668 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13961430-f613-4573-b0c7-02c4c686ff56 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:44.895194 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13961430-f613-4573-b0c7-02c4c686ff56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:44.896909 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-13961430-f613-4573-b0c7-02c4c686ff56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:44.983290 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:44.998034 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13961430-f613-4573-b0c7-02c4c686ff56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:57:44.999704 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13961430-f613-4573-b0c7-02c4c686ff56 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:57:45.019295 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 717/1425] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:57:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:57:45.906844 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18cfb0-63d3-44c5-bcf7-833024d32861 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:45.907685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18cfb0-63d3-44c5-bcf7-833024d32861 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:45.907685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18cfb0-63d3-44c5-bcf7-833024d32861 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:45.908853 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 08:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:57:45.914239 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae931780-c4fc-48c4-bec1-14120f3c3577 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:45.914800 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae931780-c4fc-48c4-bec1-14120f3c3577 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:45.914800 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae931780-c4fc-48c4-bec1-14120f3c3577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:45.998578 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-ae931780-c4fc-48c4-bec1-14120f3c3577 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:57:45.999827 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ae931780-c4fc-48c4-bec1-14120f3c3577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:46.103397 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 08:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:57:46.265163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18cfb0-63d3-44c5-bcf7-833024d32861 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:57:46.267211 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-8e18cfb0-63d3-44c5-bcf7-833024d32861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:46.355480 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:46.417256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18cfb0-63d3-44c5-bcf7-833024d32861 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:57:46.533306 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d60603-74eb-4a8c-b3ba-d4311885d2f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:57:46.533926 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d60603-74eb-4a8c-b3ba-d4311885d2f6 service nova] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:46.534205 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d60603-74eb-4a8c-b3ba-d4311885d2f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:46.534509 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d60603-74eb-4a8c-b3ba-d4311885d2f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:46.536156 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-c9d60603-74eb-4a8c-b3ba-d4311885d2f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:46.586611 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:46.628758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d60603-74eb-4a8c-b3ba-d4311885d2f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:57:46.630422 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d60603-74eb-4a8c-b3ba-d4311885d2f6 service nova] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:57:46.649346 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 710/1428] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:57:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:57:47.474183 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243763aa-889c-4dde-8cdb-be3a27d4d9ba None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:47.474764 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243763aa-889c-4dde-8cdb-be3a27d4d9ba None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:47.474764 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243763aa-889c-4dde-8cdb-be3a27d4d9ba None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:47.476062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 08:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:57:47.481735 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ff925-d058-41dd-9f06-e64fbcd3fa93 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:47.482288 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ff925-d058-41dd-9f06-e64fbcd3fa93 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:47.482288 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ff925-d058-41dd-9f06-e64fbcd3fa93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:47.566292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-687ff925-d058-41dd-9f06-e64fbcd3fa93 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:57:47.567539 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-687ff925-d058-41dd-9f06-e64fbcd3fa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:47.797393 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 08:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:57:47.951520 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243763aa-889c-4dde-8cdb-be3a27d4d9ba None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:57:47.953082 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-243763aa-889c-4dde-8cdb-be3a27d4d9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:48.004315 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:48.105493 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243763aa-889c-4dde-8cdb-be3a27d4d9ba None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:57:48.231021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab661be1-4dab-4924-9bda-31f8a0d8a6a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:57:48.231643 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab661be1-4dab-4924-9bda-31f8a0d8a6a0 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:48.231932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab661be1-4dab-4924-9bda-31f8a0d8a6a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:48.232201 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab661be1-4dab-4924-9bda-31f8a0d8a6a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:48.233859 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ab661be1-4dab-4924-9bda-31f8a0d8a6a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:48.241948 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:48.337916 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab661be1-4dab-4924-9bda-31f8a0d8a6a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:57:48.339619 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab661be1-4dab-4924-9bda-31f8a0d8a6a0 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:57:48.358667 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 720/1431] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:57:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:57:49.193496 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd9196-e087-4a7b-bf13-1ae5334bcc06 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:49.194059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd9196-e087-4a7b-bf13-1ae5334bcc06 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:49.194179 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd9196-e087-4a7b-bf13-1ae5334bcc06 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:49.195578 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 08:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:57:49.200908 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149205b4-a938-4caa-932e-ca58dfef6926 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:49.201370 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149205b4-a938-4caa-932e-ca58dfef6926 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:49.201464 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149205b4-a938-4caa-932e-ca58dfef6926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:49.287978 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-149205b4-a938-4caa-932e-ca58dfef6926 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:57:49.289200 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-149205b4-a938-4caa-932e-ca58dfef6926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:49.367752 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:49.398351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 08:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:57:49.550522 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd9196-e087-4a7b-bf13-1ae5334bcc06 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:57:49.552417 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-4bfd9196-e087-4a7b-bf13-1ae5334bcc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:49.570707 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:49.703906 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd9196-e087-4a7b-bf13-1ae5334bcc06 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:57:49.792106 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:49.819362 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49267ef-5bc8-4e92-8d63-97d285869232 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:57:49.819979 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49267ef-5bc8-4e92-8d63-97d285869232 service nova] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:49.820258 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49267ef-5bc8-4e92-8d63-97d285869232 service nova] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:49.820532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49267ef-5bc8-4e92-8d63-97d285869232 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:49.822163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-a49267ef-5bc8-4e92-8d63-97d285869232 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:49.912924 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49267ef-5bc8-4e92-8d63-97d285869232 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:57:49.914592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49267ef-5bc8-4e92-8d63-97d285869232 service nova] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:57:49.933333 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 713/1434] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:57:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:57:50.752783 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939dfdd-4c88-4efa-b2df-483af9d49e07 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:50.753369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939dfdd-4c88-4efa-b2df-483af9d49e07 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:50.753369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939dfdd-4c88-4efa-b2df-483af9d49e07 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:50.754756 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 08:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:57:50.759781 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df011a18-2c31-4b50-80ed-b8b9e7f18929 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:50.760210 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df011a18-2c31-4b50-80ed-b8b9e7f18929 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:50.760334 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df011a18-2c31-4b50-80ed-b8b9e7f18929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:50.838407 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-df011a18-2c31-4b50-80ed-b8b9e7f18929 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:57:50.839630 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-df011a18-2c31-4b50-80ed-b8b9e7f18929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:50.882641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:50.939058 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 08:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:57:51.091923 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939dfdd-4c88-4efa-b2df-483af9d49e07 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:57:51.093452 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-7939dfdd-4c88-4efa-b2df-483af9d49e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:51.253493 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939dfdd-4c88-4efa-b2df-483af9d49e07 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:57:51.310876 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:51.371670 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e62790-31d6-468a-a29e-c57f119a9694 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:57:51.372202 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e62790-31d6-468a-a29e-c57f119a9694 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:51.372483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e62790-31d6-468a-a29e-c57f119a9694 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:51.372763 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e62790-31d6-468a-a29e-c57f119a9694 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:51.374412 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d8e62790-31d6-468a-a29e-c57f119a9694 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:51.463642 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e62790-31d6-468a-a29e-c57f119a9694 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:57:51.465246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e62790-31d6-468a-a29e-c57f119a9694 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:57:51.483111 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 723/1437] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:57:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:57:52.302903 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587825ff-ff02-4246-9034-9f8f3a13e147 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:52.303562 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587825ff-ff02-4246-9034-9f8f3a13e147 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:52.303562 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587825ff-ff02-4246-9034-9f8f3a13e147 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:52.304801 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 08:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:57:52.310083 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a304f9-84c3-4f0d-852d-054c5445aa9d None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:52.310535 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a304f9-84c3-4f0d-852d-054c5445aa9d None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:52.310651 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a304f9-84c3-4f0d-852d-054c5445aa9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:52.399455 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-23a304f9-84c3-4f0d-852d-054c5445aa9d None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:57:52.400688 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-23a304f9-84c3-4f0d-852d-054c5445aa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:52.402924 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:52.501389 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 08:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:57:52.655081 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587825ff-ff02-4246-9034-9f8f3a13e147 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:57:52.656603 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-587825ff-ff02-4246-9034-9f8f3a13e147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:52.810085 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587825ff-ff02-4246-9034-9f8f3a13e147 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:57:52.837279 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:52.932723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68fae7-f43f-48e4-bb3c-5ac4a0798d2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:57:52.933261 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68fae7-f43f-48e4-bb3c-5ac4a0798d2a service nova] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:52.933541 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68fae7-f43f-48e4-bb3c-5ac4a0798d2a service nova] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:52.933827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68fae7-f43f-48e4-bb3c-5ac4a0798d2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:52.935947 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-0c68fae7-f43f-48e4-bb3c-5ac4a0798d2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:53.032477 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68fae7-f43f-48e4-bb3c-5ac4a0798d2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:57:53.034509 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68fae7-f43f-48e4-bb3c-5ac4a0798d2a service nova] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:57:53.054051 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 716/1440] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:57:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:57:54.995402 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662672e-d309-4b12-b494-70a1003df2c8 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:54.995989 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662672e-d309-4b12-b494-70a1003df2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:54.995989 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662672e-d309-4b12-b494-70a1003df2c8 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:54.997345 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 08:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:57:55.003096 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035bf43-c3e6-4126-8f40-8f21670732c7 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:55.003574 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035bf43-c3e6-4126-8f40-8f21670732c7 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:55.003672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035bf43-c3e6-4126-8f40-8f21670732c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:55.054480 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:55.083289 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-4035bf43-c3e6-4126-8f40-8f21670732c7 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:57:55.084514 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-4035bf43-c3e6-4126-8f40-8f21670732c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:55.183700 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 08:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:57:55.223352 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662672e-d309-4b12-b494-70a1003df2c8 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:57:55.224885 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-8662672e-d309-4b12-b494-70a1003df2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:55.330613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662672e-d309-4b12-b494-70a1003df2c8 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:57:55.362698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:55.404919 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8334f5e-6f12-4387-85e9-fdaa34300d38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:57:55.405539 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8334f5e-6f12-4387-85e9-fdaa34300d38 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:55.405823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8334f5e-6f12-4387-85e9-fdaa34300d38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:55.406100 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8334f5e-6f12-4387-85e9-fdaa34300d38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:55.408309 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a8334f5e-6f12-4387-85e9-fdaa34300d38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:55.520734 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8334f5e-6f12-4387-85e9-fdaa34300d38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:57:55.522224 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8334f5e-6f12-4387-85e9-fdaa34300d38 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:57:55.540867 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 726/1443] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:57:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:57:57.714291 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dfdf2-9b3f-4fef-8d5b-0df0074fc5f8 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:57.715021 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dfdf2-9b3f-4fef-8d5b-0df0074fc5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:57.715021 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dfdf2-9b3f-4fef-8d5b-0df0074fc5f8 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:57.716204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 08:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:57:57.725110 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e09d9e-0ef3-4f57-aca9-dd28df78a4fe None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:57.725663 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e09d9e-0ef3-4f57-aca9-dd28df78a4fe None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:57.725663 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e09d9e-0ef3-4f57-aca9-dd28df78a4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:57.792479 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-64e09d9e-0ef3-4f57-aca9-dd28df78a4fe None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:57:57.793693 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-64e09d9e-0ef3-4f57-aca9-dd28df78a4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:57.807492 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:57.896361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 08:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 08:57:57.934919 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265dfdf2-9b3f-4fef-8d5b-0df0074fc5f8 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:57:57.936454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-265dfdf2-9b3f-4fef-8d5b-0df0074fc5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:58.046280 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265dfdf2-9b3f-4fef-8d5b-0df0074fc5f8 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:57:58.059838 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:57:58.130689 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e44baf-0926-41e6-aeb2-863b23032285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:57:58.131311 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e44baf-0926-41e6-aeb2-863b23032285 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:57:58.131589 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e44baf-0926-41e6-aeb2-863b23032285 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:57:58.131862 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e44baf-0926-41e6-aeb2-863b23032285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:57:58.133510 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-c0e44baf-0926-41e6-aeb2-863b23032285 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:57:58.248255 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e44baf-0926-41e6-aeb2-863b23032285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:57:58.249877 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e44baf-0926-41e6-aeb2-863b23032285 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:57:58.268528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 719/1446] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:57:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:58:00.667393 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b61ced-2dcb-4c08-9a24-283d338c64b0 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:00.667960 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b61ced-2dcb-4c08-9a24-283d338c64b0 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:00.667960 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b61ced-2dcb-4c08-9a24-283d338c64b0 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:00.669328 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 08:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:58:00.674902 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f270a2-6555-47e7-bf38-7a51706d51a0 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:00.675411 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f270a2-6555-47e7-bf38-7a51706d51a0 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:00.675548 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f270a2-6555-47e7-bf38-7a51706d51a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:00.725755 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:00.744471 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-80f270a2-6555-47e7-bf38-7a51706d51a0 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:58:00.745691 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-80f270a2-6555-47e7-bf38-7a51706d51a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:00.843555 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 08:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:58:00.884453 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b61ced-2dcb-4c08-9a24-283d338c64b0 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:58:00.886020 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-03b61ced-2dcb-4c08-9a24-283d338c64b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:00.994518 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b61ced-2dcb-4c08-9a24-283d338c64b0 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:58:01.038829 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:01.076408 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64803e8f-9e0c-4848-a250-aff11047b630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:58:01.077035 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64803e8f-9e0c-4848-a250-aff11047b630 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:01.077316 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64803e8f-9e0c-4848-a250-aff11047b630 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:01.077588 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64803e8f-9e0c-4848-a250-aff11047b630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:01.079264 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-64803e8f-9e0c-4848-a250-aff11047b630 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:01.190853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64803e8f-9e0c-4848-a250-aff11047b630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:58:01.192309 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64803e8f-9e0c-4848-a250-aff11047b630 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:58:01.217318 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 729/1449] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:58:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:58:03.453944 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3045278-7ffe-4d57-9cb1-27ca3f57783e None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:03.454525 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3045278-7ffe-4d57-9cb1-27ca3f57783e None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:03.454525 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3045278-7ffe-4d57-9cb1-27ca3f57783e None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:03.456265 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 08:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:58:03.461596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9590cb4-8e05-4d3b-9495-b714831c69e4 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:03.462057 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9590cb4-8e05-4d3b-9495-b714831c69e4 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:03.462182 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9590cb4-8e05-4d3b-9495-b714831c69e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:03.528670 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-b9590cb4-8e05-4d3b-9495-b714831c69e4 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:58:03.529867 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b9590cb4-8e05-4d3b-9495-b714831c69e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:03.551836 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:03.630391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 08:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:58:03.670250 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3045278-7ffe-4d57-9cb1-27ca3f57783e None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:58:03.671905 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-e3045278-7ffe-4d57-9cb1-27ca3f57783e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:03.784619 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3045278-7ffe-4d57-9cb1-27ca3f57783e None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:58:03.804754 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:03.861252 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8f414-0ee4-435e-99eb-0c60f4d4b11e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:58:03.861872 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8f414-0ee4-435e-99eb-0c60f4d4b11e service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:03.862159 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8f414-0ee4-435e-99eb-0c60f4d4b11e service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:03.862461 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8f414-0ee4-435e-99eb-0c60f4d4b11e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:03.864088 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-15d8f414-0ee4-435e-99eb-0c60f4d4b11e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:03.974122 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8f414-0ee4-435e-99eb-0c60f4d4b11e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:58:03.975628 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8f414-0ee4-435e-99eb-0c60f4d4b11e service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:58:03.993735 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 722/1452] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:58:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:58:06.104215 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e7ad2-4690-4e9a-b73e-07207e7022d5 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:06.104832 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e7ad2-4690-4e9a-b73e-07207e7022d5 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:06.105123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e7ad2-4690-4e9a-b73e-07207e7022d5 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:06.106559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 08:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:58:06.112785 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf902ba-7c7f-4480-a034-3bb558362dc0 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:06.113326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf902ba-7c7f-4480-a034-3bb558362dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:06.113433 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf902ba-7c7f-4480-a034-3bb558362dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:06.182307 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:06.185454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-2bf902ba-7c7f-4480-a034-3bb558362dc0 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:58:06.187379 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-2bf902ba-7c7f-4480-a034-3bb558362dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:06.289241 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 08:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:58:06.328613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e7ad2-4690-4e9a-b73e-07207e7022d5 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:58:06.330402 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-615e7ad2-4690-4e9a-b73e-07207e7022d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:06.443249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e7ad2-4690-4e9a-b73e-07207e7022d5 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:58:06.493418 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:06.518560 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4897d-2ba3-4a2a-bac6-3fb2ae5aa832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:58:06.519166 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4897d-2ba3-4a2a-bac6-3fb2ae5aa832 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:06.519449 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4897d-2ba3-4a2a-bac6-3fb2ae5aa832 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:06.519724 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4897d-2ba3-4a2a-bac6-3fb2ae5aa832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:06.521361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4eb4897d-2ba3-4a2a-bac6-3fb2ae5aa832 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:06.631120 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4897d-2ba3-4a2a-bac6-3fb2ae5aa832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:58:06.632471 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4897d-2ba3-4a2a-bac6-3fb2ae5aa832 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:58:06.650523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 732/1455] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:58:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:58:08.758846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d995f4-ff3c-4667-ac87-cebf37a41ddd None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:08.759398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d995f4-ff3c-4667-ac87-cebf37a41ddd None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:08.759398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d995f4-ff3c-4667-ac87-cebf37a41ddd None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:08.760814 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 08:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:58:08.766429 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae8143-d1e9-44d8-8ff4-98d74a50453b None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:08.766900 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae8143-d1e9-44d8-8ff4-98d74a50453b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:08.767019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae8143-d1e9-44d8-8ff4-98d74a50453b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:08.836914 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-6dae8143-d1e9-44d8-8ff4-98d74a50453b None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:58:08.838197 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6dae8143-d1e9-44d8-8ff4-98d74a50453b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:08.872256 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:08.943051 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 08:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:58:08.981422 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d995f4-ff3c-4667-ac87-cebf37a41ddd None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:58:08.982982 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-81d995f4-ff3c-4667-ac87-cebf37a41ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:09.091448 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d995f4-ff3c-4667-ac87-cebf37a41ddd None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:58:09.124003 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:09.173174 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb43f5d-61f1-468f-a835-9f2f479c70b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:58:09.174102 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb43f5d-61f1-468f-a835-9f2f479c70b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:09.174430 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb43f5d-61f1-468f-a835-9f2f479c70b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:09.174708 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb43f5d-61f1-468f-a835-9f2f479c70b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:09.176396 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-aeb43f5d-61f1-468f-a835-9f2f479c70b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:09.295634 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb43f5d-61f1-468f-a835-9f2f479c70b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:58:09.297102 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb43f5d-61f1-468f-a835-9f2f479c70b9 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:58:09.316387 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 725/1458] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:58:11.389868 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa11881-0f53-46c8-a291-ebeb692a22b8 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:11.390424 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa11881-0f53-46c8-a291-ebeb692a22b8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:11.390424 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa11881-0f53-46c8-a291-ebeb692a22b8 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:11.391755 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 08:58:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:58:11.397867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f204104-227d-4fb6-99b9-b2ca2fbec7d4 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:11.398374 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f204104-227d-4fb6-99b9-b2ca2fbec7d4 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:11.398474 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f204104-227d-4fb6-99b9-b2ca2fbec7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:11.469779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-3f204104-227d-4fb6-99b9-b2ca2fbec7d4 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:58:11.471885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-3f204104-227d-4fb6-99b9-b2ca2fbec7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:11.480510 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:11.570695 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 08:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:58:11.609401 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa11881-0f53-46c8-a291-ebeb692a22b8 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:58:11.611017 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-5fa11881-0f53-46c8-a291-ebeb692a22b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:11.721723 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa11881-0f53-46c8-a291-ebeb692a22b8 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:58:11.780616 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:11.801213 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab658de-393e-4f7a-b086-3d07f29dd428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:58:11.801832 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab658de-393e-4f7a-b086-3d07f29dd428 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:11.802106 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab658de-393e-4f7a-b086-3d07f29dd428 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:11.802403 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab658de-393e-4f7a-b086-3d07f29dd428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:11.804307 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4ab658de-393e-4f7a-b086-3d07f29dd428 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:12.040794 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab658de-393e-4f7a-b086-3d07f29dd428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:58:12.042244 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab658de-393e-4f7a-b086-3d07f29dd428 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:58:12.061003 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 735/1461] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:58:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:58:14.214733 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0186d46-504d-4334-8146-4f15ae637f2c None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:14.215311 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0186d46-504d-4334-8146-4f15ae637f2c None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:14.215311 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0186d46-504d-4334-8146-4f15ae637f2c None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:14.216659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 08:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:58:14.222794 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b1408-5cf0-4128-a1b3-9d0059d22dfd None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:14.223323 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b1408-5cf0-4128-a1b3-9d0059d22dfd None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:14.223323 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b1408-5cf0-4128-a1b3-9d0059d22dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:14.292340 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-4e7b1408-5cf0-4128-a1b3-9d0059d22dfd None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:58:14.293727 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4e7b1408-5cf0-4128-a1b3-9d0059d22dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:14.333636 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:14.394416 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 08:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:58:14.432753 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0186d46-504d-4334-8146-4f15ae637f2c None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:58:14.434272 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-a0186d46-504d-4334-8146-4f15ae637f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:14.541094 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0186d46-504d-4334-8146-4f15ae637f2c None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:58:14.581608 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:14.618902 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d0718-487c-499b-a399-0525985ee565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:58:14.619556 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d0718-487c-499b-a399-0525985ee565 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:14.619904 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d0718-487c-499b-a399-0525985ee565 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:14.620245 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d0718-487c-499b-a399-0525985ee565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:14.621879 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-f11d0718-487c-499b-a399-0525985ee565 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:14.735985 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d0718-487c-499b-a399-0525985ee565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:58:14.737464 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d0718-487c-499b-a399-0525985ee565 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:58:14.756842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 728/1464] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:58:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:58:16.826779 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688af214-2f4e-4040-b297-7bf1b9d697e8 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:16.827397 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688af214-2f4e-4040-b297-7bf1b9d697e8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:16.827397 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688af214-2f4e-4040-b297-7bf1b9d697e8 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:16.828662 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 08:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:58:16.834658 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a97f2-68bf-4eea-a878-4e987f86179a None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:16.835120 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a97f2-68bf-4eea-a878-4e987f86179a None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:16.835222 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a97f2-68bf-4eea-a878-4e987f86179a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:16.903862 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-949a97f2-68bf-4eea-a878-4e987f86179a None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:58:16.905081 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-949a97f2-68bf-4eea-a878-4e987f86179a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:16.931499 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:17.021006 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 08:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:58:17.058828 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688af214-2f4e-4040-b297-7bf1b9d697e8 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:58:17.060416 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-688af214-2f4e-4040-b297-7bf1b9d697e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:17.181427 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688af214-2f4e-4040-b297-7bf1b9d697e8 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:58:17.259344 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:17.266667 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0012d-84c5-401b-9a4f-aeb6e5508231 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:58:17.267330 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0012d-84c5-401b-9a4f-aeb6e5508231 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:17.267620 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0012d-84c5-401b-9a4f-aeb6e5508231 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:17.267884 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0012d-84c5-401b-9a4f-aeb6e5508231 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:17.269567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6ad0012d-84c5-401b-9a4f-aeb6e5508231 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:17.403105 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0012d-84c5-401b-9a4f-aeb6e5508231 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:58:17.404448 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0012d-84c5-401b-9a4f-aeb6e5508231 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:58:17.423172 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 738/1467] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:58:19.496407 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b47c4-08f5-4dc1-996e-dac3a916b2ee None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:19.496989 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b47c4-08f5-4dc1-996e-dac3a916b2ee None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:19.496989 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b47c4-08f5-4dc1-996e-dac3a916b2ee None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:19.498340 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 08:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:58:19.504245 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c71a8-542f-4def-bc2d-e287873e1e3c None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:19.504752 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c71a8-542f-4def-bc2d-e287873e1e3c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:19.504883 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c71a8-542f-4def-bc2d-e287873e1e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:19.570851 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-258c71a8-542f-4def-bc2d-e287873e1e3c None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:58:19.572060 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-258c71a8-542f-4def-bc2d-e287873e1e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:19.621954 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:19.671895 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 08:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:58:19.709942 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b47c4-08f5-4dc1-996e-dac3a916b2ee None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:58:19.711514 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-2b2b47c4-08f5-4dc1-996e-dac3a916b2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:19.816894 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b47c4-08f5-4dc1-996e-dac3a916b2ee None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:58:19.866471 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:19.894378 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9598f07-738e-4b12-a767-eba791fd9a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:58:19.894952 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9598f07-738e-4b12-a767-eba791fd9a65 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:19.895233 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9598f07-738e-4b12-a767-eba791fd9a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:19.895507 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9598f07-738e-4b12-a767-eba791fd9a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:19.897144 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-d9598f07-738e-4b12-a767-eba791fd9a65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:20.012955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9598f07-738e-4b12-a767-eba791fd9a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:58:20.014357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9598f07-738e-4b12-a767-eba791fd9a65 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:58:20.033999 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 731/1470] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:58:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:58:29.669951 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=22 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:30.031444 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=66 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:40.039373 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0fe8d-1db9-43c6-bc7c-9d1ce5809237 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:40.039912 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0fe8d-1db9-43c6-bc7c-9d1ce5809237 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:40.039912 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0fe8d-1db9-43c6-bc7c-9d1ce5809237 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:40.041282 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 740/1471] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:58:40.046756 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87b86e-6ab7-4668-b0c5-f7f998fda627 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:40.047254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87b86e-6ab7-4668-b0c5-f7f998fda627 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:40.047364 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87b86e-6ab7-4668-b0c5-f7f998fda627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:40.120643 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-da87b86e-6ab7-4668-b0c5-f7f998fda627 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:58:40.121856 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-da87b86e-6ab7-4668-b0c5-f7f998fda627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:40.220859 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 732/1472] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:58:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:58:40.309317 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5241b-00b7-47e8-9624-47e65f62bac5 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:40.309594 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5241b-00b7-47e8-9624-47e65f62bac5 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:40.309861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5241b-00b7-47e8-9624-47e65f62bac5 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:40.311236 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 741/1473] 10.222.0.65 () {54 vars in 966 bytes} [Wed Jul 27 08:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:58:40.316065 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c7017-21e3-4f20-8283-cfe1f9605eb3 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:40.316353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c7017-21e3-4f20-8283-cfe1f9605eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:40.316633 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c7017-21e3-4f20-8283-cfe1f9605eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:40.391724 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-713c7017-21e3-4f20-8283-cfe1f9605eb3 None None] MFA Rules not processed for user `713805e0f1174a01987014319075ec03`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:58:40.392940 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-713c7017-21e3-4f20-8283-cfe1f9605eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:40.413958 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:40.469139 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 733/1474] 10.222.0.65 () {58 vars in 1063 bytes} [Wed Jul 27 08:58:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:58:40.477390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5241b-00b7-47e8-9624-47e65f62bac5 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:58:40.478995 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-48c5241b-00b7-47e8-9624-47e65f62bac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:40.587092 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5241b-00b7-47e8-9624-47e65f62bac5 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:58:40.666612 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161f5c0-5d97-4bc6-a561-5165f1ceda30 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713805e0f1174a01987014319075ec03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:58:40.667233 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161f5c0-5d97-4bc6-a561-5165f1ceda30 service glance] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:40.667511 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161f5c0-5d97-4bc6-a561-5165f1ceda30 service glance] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:40.667779 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161f5c0-5d97-4bc6-a561-5165f1ceda30 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:40.669391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9161f5c0-5d97-4bc6-a561-5165f1ceda30 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:40.727044 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:40.793651 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161f5c0-5d97-4bc6-a561-5165f1ceda30 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:58:40.795144 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161f5c0-5d97-4bc6-a561-5165f1ceda30 service glance] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:58:40.816379 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 742/1475] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:58:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:58:42.960060 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80a7e6-4191-4596-aeae-cc48aca0db65 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:42.960641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80a7e6-4191-4596-aeae-cc48aca0db65 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:42.960641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80a7e6-4191-4596-aeae-cc48aca0db65 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:42.961992 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 734/1476] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:58:42.967726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40d116-4d08-48ee-8ada-19b7b9a0596b None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:42.968271 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40d116-4d08-48ee-8ada-19b7b9a0596b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:42.968271 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40d116-4d08-48ee-8ada-19b7b9a0596b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:43.040369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-5b40d116-4d08-48ee-8ada-19b7b9a0596b None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:58:43.041608 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-5b40d116-4d08-48ee-8ada-19b7b9a0596b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:43.151083 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 743/1477] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:58:43.174692 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80a7e6-4191-4596-aeae-cc48aca0db65 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:58:43.176301 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-ee80a7e6-4191-4596-aeae-cc48aca0db65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:43.303863 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80a7e6-4191-4596-aeae-cc48aca0db65 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:58:43.353832 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:43.400451 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f46c6b-0880-49cf-bcbb-9d3cacd83bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:58:43.401129 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f46c6b-0880-49cf-bcbb-9d3cacd83bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:43.401410 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f46c6b-0880-49cf-bcbb-9d3cacd83bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:43.401685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f46c6b-0880-49cf-bcbb-9d3cacd83bf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:43.402409 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f46c6b-0880-49cf-bcbb-9d3cacd83bf9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:58:43.404149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: WARNING py.warnings [None req-41f46c6b-0880-49cf-bcbb-9d3cacd83bf9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 08:58:43.404149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: warnings.warn(msg) Jul 27 08:58:43.404149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: Jul 27 08:58:43.405285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f46c6b-0880-49cf-bcbb-9d3cacd83bf9 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:58:43.423959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 735/1478] 10.222.0.65 () {56 vars in 1108 bytes} [Wed Jul 27 08:58:43 2022] GET /identity/v3/projects => generated 2553 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 08:58:45.455457 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ba46a-2bd8-4e8f-9807-1bd3172873ab None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:45.456484 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ba46a-2bd8-4e8f-9807-1bd3172873ab None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:45.456638 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ba46a-2bd8-4e8f-9807-1bd3172873ab None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:45.458009 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 744/1479] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:58:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 08:58:45.463271 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f33a48-968b-470b-825a-11b8c181d1ef None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:45.463733 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f33a48-968b-470b-825a-11b8c181d1ef None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:45.463836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f33a48-968b-470b-825a-11b8c181d1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:45.529555 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-28f33a48-968b-470b-825a-11b8c181d1ef None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:58:45.530806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-28f33a48-968b-470b-825a-11b8c181d1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:45.626808 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 736/1480] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:58:45.672326 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ba46a-2bd8-4e8f-9807-1bd3172873ab None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:58:45.674277 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-214ba46a-2bd8-4e8f-9807-1bd3172873ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:45.684995 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:45.821235 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ba46a-2bd8-4e8f-9807-1bd3172873ab None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:58:45.900776 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:45.934151 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c57fa3-7020-48a9-998d-5e7b0901dc19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:58:45.934790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c57fa3-7020-48a9-998d-5e7b0901dc19 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:45.935069 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c57fa3-7020-48a9-998d-5e7b0901dc19 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:45.935341 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c57fa3-7020-48a9-998d-5e7b0901dc19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:45.936965 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-97c57fa3-7020-48a9-998d-5e7b0901dc19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:46.030988 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c57fa3-7020-48a9-998d-5e7b0901dc19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:58:46.033256 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c57fa3-7020-48a9-998d-5e7b0901dc19 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:58:46.052593 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 745/1481] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:58:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:58:48.301485 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd141c-47ec-49bd-a3c6-2a3ba7bea95c None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:48.302051 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd141c-47ec-49bd-a3c6-2a3ba7bea95c None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:48.302051 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd141c-47ec-49bd-a3c6-2a3ba7bea95c None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:48.303720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 737/1482] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:58:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:58:48.309634 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394bbfe-e7b6-4bc6-943f-2d01888c885d None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:48.310073 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394bbfe-e7b6-4bc6-943f-2d01888c885d None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:48.310181 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394bbfe-e7b6-4bc6-943f-2d01888c885d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:48.375603 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-d394bbfe-e7b6-4bc6-943f-2d01888c885d None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:58:48.376796 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d394bbfe-e7b6-4bc6-943f-2d01888c885d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:48.422327 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:48.474707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 746/1483] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:58:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:58:48.511664 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd141c-47ec-49bd-a3c6-2a3ba7bea95c None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:58:48.513220 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-56fd141c-47ec-49bd-a3c6-2a3ba7bea95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:48.537448 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:48.636903 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd141c-47ec-49bd-a3c6-2a3ba7bea95c None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:58:48.713464 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e28528-7c81-49c0-a34e-0c9b7d28b74c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:58:48.714078 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e28528-7c81-49c0-a34e-0c9b7d28b74c service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:48.714382 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e28528-7c81-49c0-a34e-0c9b7d28b74c service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:48.714662 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e28528-7c81-49c0-a34e-0c9b7d28b74c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:48.716290 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-41e28528-7c81-49c0-a34e-0c9b7d28b74c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:48.793774 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:48.830173 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e28528-7c81-49c0-a34e-0c9b7d28b74c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:58:48.831725 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e28528-7c81-49c0-a34e-0c9b7d28b74c service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:58:48.852878 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 738/1484] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:58:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:58:50.947955 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cb222-dafe-40cd-b5c2-d7dfa1130516 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:50.948518 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cb222-dafe-40cd-b5c2-d7dfa1130516 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:50.948518 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cb222-dafe-40cd-b5c2-d7dfa1130516 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:50.949878 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 747/1485] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:58:50.955392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe221c5-d80b-4fdf-931c-78d73743a66c None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:50.955880 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe221c5-d80b-4fdf-931c-78d73743a66c None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:50.956123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe221c5-d80b-4fdf-931c-78d73743a66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:51.024699 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-bfe221c5-d80b-4fdf-931c-78d73743a66c None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:58:51.025920 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-bfe221c5-d80b-4fdf-931c-78d73743a66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:51.125589 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 739/1486] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:58:51.165384 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cb222-dafe-40cd-b5c2-d7dfa1130516 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:58:51.166942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a76cb222-dafe-40cd-b5c2-d7dfa1130516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:51.274794 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cb222-dafe-40cd-b5c2-d7dfa1130516 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:58:51.349884 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:51.351936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6976d-e312-401b-8cc7-661569114920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:58:51.352604 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6976d-e312-401b-8cc7-661569114920 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:51.352897 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6976d-e312-401b-8cc7-661569114920 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:51.353370 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6976d-e312-401b-8cc7-661569114920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:51.355404 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-abd6976d-e312-401b-8cc7-661569114920 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:51.466381 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd6976d-e312-401b-8cc7-661569114920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:58:51.467879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd6976d-e312-401b-8cc7-661569114920 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:58:51.486109 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 748/1487] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:58:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:58:53.678063 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dd5a7-f0ad-4a04-a769-6b407c80d04c None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:53.678669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dd5a7-f0ad-4a04-a769-6b407c80d04c None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:53.678669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dd5a7-f0ad-4a04-a769-6b407c80d04c None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:53.680053 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 740/1488] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:58:53.686601 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0b654-5096-409f-992d-a44f4c601afc None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:53.687143 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0b654-5096-409f-992d-a44f4c601afc None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:53.687143 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0b654-5096-409f-992d-a44f4c601afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:53.759708 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-dad0b654-5096-409f-992d-a44f4c601afc None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:58:53.760927 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-dad0b654-5096-409f-992d-a44f4c601afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:53.813747 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:53.857491 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 749/1489] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:58:53.898621 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dd5a7-f0ad-4a04-a769-6b407c80d04c None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:58:53.900155 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-1b0dd5a7-f0ad-4a04-a769-6b407c80d04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:53.939654 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:54.012618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dd5a7-f0ad-4a04-a769-6b407c80d04c None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:58:54.088513 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f308d-b01d-4ebf-9de7-35bb2a33f469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:58:54.089123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f308d-b01d-4ebf-9de7-35bb2a33f469 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:54.089403 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f308d-b01d-4ebf-9de7-35bb2a33f469 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:54.089675 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f308d-b01d-4ebf-9de7-35bb2a33f469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:54.091353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-e29f308d-b01d-4ebf-9de7-35bb2a33f469 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:54.182484 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:54.215536 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f308d-b01d-4ebf-9de7-35bb2a33f469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:58:54.216958 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f308d-b01d-4ebf-9de7-35bb2a33f469 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:58:54.239420 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 741/1490] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:58:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:58:56.458378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead90ed-acbb-410b-8711-c55c55bc719e None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:56.459076 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead90ed-acbb-410b-8711-c55c55bc719e None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:56.459076 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead90ed-acbb-410b-8711-c55c55bc719e None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:56.460249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 750/1491] 10.222.0.65 () {54 vars in 926 bytes} [Wed Jul 27 08:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 08:58:56.465767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c71e8d-f832-49a5-a60a-9a2d63338125 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:56.466187 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c71e8d-f832-49a5-a60a-9a2d63338125 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:56.466296 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c71e8d-f832-49a5-a60a-9a2d63338125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:56.537904 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-95c71e8d-f832-49a5-a60a-9a2d63338125 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 08:58:56.539161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-95c71e8d-f832-49a5-a60a-9a2d63338125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:56.644694 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 742/1492] 10.222.0.65 () {58 vars in 1023 bytes} [Wed Jul 27 08:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 08:58:56.685667 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead90ed-acbb-410b-8711-c55c55bc719e None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 08:58:56.687231 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fead90ed-acbb-410b-8711-c55c55bc719e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:56.795201 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead90ed-acbb-410b-8711-c55c55bc719e None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 08:58:56.872524 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6eb86f-93e3-490f-a0ca-1ed232a1205c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 08:58:56.873147 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6eb86f-93e3-490f-a0ca-1ed232a1205c service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 08:58:56.873434 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6eb86f-93e3-490f-a0ca-1ed232a1205c service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 08:58:56.873704 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6eb86f-93e3-490f-a0ca-1ed232a1205c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 08:58:56.875456 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-5f6eb86f-93e3-490f-a0ca-1ed232a1205c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 08:58:56.885553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:58:56.991628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6eb86f-93e3-490f-a0ca-1ed232a1205c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 08:58:56.993195 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6eb86f-93e3-490f-a0ca-1ed232a1205c service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 08:58:57.011635 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 751/1493] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 08:58:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 08:59:06.642782 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=82 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 08:59:07.009268 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=50 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:00:25.874278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5ef4c-b9bb-4808-9740-1f9f88783ee4 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:00:25.874917 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5ef4c-b9bb-4808-9740-1f9f88783ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:00:25.874917 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5ef4c-b9bb-4808-9740-1f9f88783ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:00:25.954773 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-87b5ef4c-b9bb-4808-9740-1f9f88783ee4 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:00:25.955996 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-87b5ef4c-b9bb-4808-9740-1f9f88783ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:00:26.066262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 743/1494] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:00:26.075298 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb890437-fa97-4310-aceb-af13f1604d85 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:00:26.075865 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb890437-fa97-4310-aceb-af13f1604d85 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:00:26.075968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb890437-fa97-4310-aceb-af13f1604d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:00:26.163453 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-cb890437-fa97-4310-aceb-af13f1604d85 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:00:26.164596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-cb890437-fa97-4310-aceb-af13f1604d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:00:26.281200 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 752/1495] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:00:26.286052 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5ef4c-b9bb-4808-9740-1f9f88783ee4 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:00:26.287312 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-87b5ef4c-b9bb-4808-9740-1f9f88783ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:00:26.298691 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5ef4c-b9bb-4808-9740-1f9f88783ee4 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:00:26.360826 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:00:26.396714 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019830c-8e6b-4447-98b2-991371452c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:00:26.397332 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019830c-8e6b-4447-98b2-991371452c82 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:00:26.397614 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019830c-8e6b-4447-98b2-991371452c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:00:26.397886 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019830c-8e6b-4447-98b2-991371452c82 admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:00:26.398624 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019830c-8e6b-4447-98b2-991371452c82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:00:26.398930 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019830c-8e6b-4447-98b2-991371452c82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:00:26.399941 dv-cinder-797608-64-smb devstack@keystone.service[80153]: WARNING py.warnings [None req-d019830c-8e6b-4447-98b2-991371452c82 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 09:00:26.399941 dv-cinder-797608-64-smb devstack@keystone.service[80153]: warnings.warn(msg) Jul 27 09:00:26.399941 dv-cinder-797608-64-smb devstack@keystone.service[80153]: Jul 27 09:00:26.400839 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019830c-8e6b-4447-98b2-991371452c82 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:00:26.412230 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 744/1496] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:00:26.420653 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb890437-fa97-4310-aceb-af13f1604d85 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:00:26.430296 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb890437-fa97-4310-aceb-af13f1604d85 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:00:26.496048 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:00:26.537873 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da48ff-7f70-46b9-93cc-a48475119e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:00:26.538513 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da48ff-7f70-46b9-93cc-a48475119e5d admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:00:26.538788 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da48ff-7f70-46b9-93cc-a48475119e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:00:26.539053 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da48ff-7f70-46b9-93cc-a48475119e5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:00:26.539710 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da48ff-7f70-46b9-93cc-a48475119e5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:00:26.541436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: WARNING py.warnings [None req-f6da48ff-7f70-46b9-93cc-a48475119e5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 09:00:26.541436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: warnings.warn(msg) Jul 27 09:00:26.541436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: Jul 27 09:00:26.542645 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da48ff-7f70-46b9-93cc-a48475119e5d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:00:26.598838 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 753/1497] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:00:26 2022] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:00:26.603041 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019830c-8e6b-4447-98b2-991371452c82 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:00:26.604547 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-d019830c-8e6b-4447-98b2-991371452c82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:00:26.639640 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019830c-8e6b-4447-98b2-991371452c82 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:00:26.741678 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e96cc2-a22b-4577-8dc7-ee6e17b07b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:00:26.742216 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e96cc2-a22b-4577-8dc7-ee6e17b07b14 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:00:26.742525 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e96cc2-a22b-4577-8dc7-ee6e17b07b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:00:26.742800 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e96cc2-a22b-4577-8dc7-ee6e17b07b14 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:00:26.743498 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e96cc2-a22b-4577-8dc7-ee6e17b07b14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:00:26.744550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: WARNING py.warnings [None req-18e96cc2-a22b-4577-8dc7-ee6e17b07b14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 09:00:26.744550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: warnings.warn(msg) Jul 27 09:00:26.744550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: Jul 27 09:00:26.745802 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e96cc2-a22b-4577-8dc7-ee6e17b07b14 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:00:26.789169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 745/1498] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:00:26 2022] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:00:26.793366 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da48ff-7f70-46b9-93cc-a48475119e5d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:00:26.795236 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f6da48ff-7f70-46b9-93cc-a48475119e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:00:26.857716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da48ff-7f70-46b9-93cc-a48475119e5d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:00:26.943272 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:00:26.955281 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5939cef-d568-4783-a69b-d233e57e73b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:00:26.955900 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5939cef-d568-4783-a69b-d233e57e73b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:00:26.956177 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5939cef-d568-4783-a69b-d233e57e73b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:00:26.956503 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5939cef-d568-4783-a69b-d233e57e73b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:00:26.957144 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5939cef-d568-4783-a69b-d233e57e73b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:00:26.958308 dv-cinder-797608-64-smb devstack@keystone.service[80152]: WARNING py.warnings [None req-f5939cef-d568-4783-a69b-d233e57e73b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 09:00:26.958308 dv-cinder-797608-64-smb devstack@keystone.service[80152]: warnings.warn(msg) Jul 27 09:00:26.958308 dv-cinder-797608-64-smb devstack@keystone.service[80152]: Jul 27 09:00:26.959234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5939cef-d568-4783-a69b-d233e57e73b1 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:00:26.971780 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 754/1499] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:00:26.976358 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e96cc2-a22b-4577-8dc7-ee6e17b07b14 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:00:26.977870 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-18e96cc2-a22b-4577-8dc7-ee6e17b07b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:00:26.989791 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e96cc2-a22b-4577-8dc7-ee6e17b07b14 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:00:27.017437 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:00:27.086965 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ee0cd-ee4f-4d1f-b67e-ff899123d092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:00:27.087575 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ee0cd-ee4f-4d1f-b67e-ff899123d092 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:00:27.087851 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ee0cd-ee4f-4d1f-b67e-ff899123d092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:00:27.088118 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ee0cd-ee4f-4d1f-b67e-ff899123d092 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:00:27.088811 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ee0cd-ee4f-4d1f-b67e-ff899123d092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:00:27.089815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: WARNING py.warnings [None req-284ee0cd-ee4f-4d1f-b67e-ff899123d092 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 09:00:27.089815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: warnings.warn(msg) Jul 27 09:00:27.089815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: Jul 27 09:00:27.090725 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ee0cd-ee4f-4d1f-b67e-ff899123d092 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:00:27.104204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 746/1500] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:00:27.108701 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5939cef-d568-4783-a69b-d233e57e73b1 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:00:27.110235 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f5939cef-d568-4783-a69b-d233e57e73b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:00:27.144322 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5939cef-d568-4783-a69b-d233e57e73b1 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:00:27.255836 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2777b85-3f98-4baf-a333-b5e2ee31927c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:00:27.256200 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2777b85-3f98-4baf-a333-b5e2ee31927c admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:00:27.256476 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2777b85-3f98-4baf-a333-b5e2ee31927c admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:00:27.256750 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2777b85-3f98-4baf-a333-b5e2ee31927c admin admin] PATH_INFO: `/v3/projects/db20c89a432c42b698c5b989e89952e6/users/3702adc2d4194c7ab789f90788b78b7d/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:00:27.279465 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2777b85-3f98-4baf-a333-b5e2ee31927c admin admin] RBAC: Authorizing `identity:create_grant(project_id=db20c89a432c42b698c5b989e89952e6, user_id=3702adc2d4194c7ab789f90788b78b7d, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:00:27.280421 dv-cinder-797608-64-smb devstack@keystone.service[80152]: WARNING py.warnings [None req-c2777b85-3f98-4baf-a333-b5e2ee31927c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 09:00:27.280421 dv-cinder-797608-64-smb devstack@keystone.service[80152]: warnings.warn(msg) Jul 27 09:00:27.280421 dv-cinder-797608-64-smb devstack@keystone.service[80152]: Jul 27 09:00:27.282384 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2777b85-3f98-4baf-a333-b5e2ee31927c admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:00:27.308476 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 755/1501] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:00:27 2022] PUT /identity/v3/projects/db20c89a432c42b698c5b989e89952e6/users/3702adc2d4194c7ab789f90788b78b7d/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:00:27.321539 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a764c99-2235-412c-8217-a08e3ff78576 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:00:27.321833 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a764c99-2235-412c-8217-a08e3ff78576 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:00:27.322116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a764c99-2235-412c-8217-a08e3ff78576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:00:27.380273 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-9a764c99-2235-412c-8217-a08e3ff78576 None None] MFA Rules not processed for user `3702adc2d4194c7ab789f90788b78b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:00:27.381499 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-9a764c99-2235-412c-8217-a08e3ff78576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:00:27.460914 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 747/1502] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:00:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:00:27.474260 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ee34f-213f-4433-b47c-3f3119514197 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:00:27.474580 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ee34f-213f-4433-b47c-3f3119514197 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:00:27.474857 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ee34f-213f-4433-b47c-3f3119514197 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:00:27.476288 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 756/1503] 10.222.0.65 () {54 vars in 964 bytes} [Wed Jul 27 09:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 09:00:27.481303 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31836c25-78c0-4875-a569-9091cf55b4dd None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:00:27.481620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31836c25-78c0-4875-a569-9091cf55b4dd None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:00:27.481900 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31836c25-78c0-4875-a569-9091cf55b4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:00:27.513511 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:00:27.558807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-31836c25-78c0-4875-a569-9091cf55b4dd None None] MFA Rules not processed for user `72763a52df364a4a8a660ec1be4aba79`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:00:27.559937 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-31836c25-78c0-4875-a569-9091cf55b4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:00:27.637845 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 748/1504] 10.222.0.65 () {58 vars in 1061 bytes} [Wed Jul 27 09:00:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:00:27.646739 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ee34f-213f-4433-b47c-3f3119514197 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:00:27.648268 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c07ee34f-213f-4433-b47c-3f3119514197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:00:27.701095 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:00:27.759146 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ee34f-213f-4433-b47c-3f3119514197 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:00:27.833675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40824810-1dd4-4f99-9618-9ed9fc565b5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:00:27.834201 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40824810-1dd4-4f99-9618-9ed9fc565b5b service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:00:27.834516 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40824810-1dd4-4f99-9618-9ed9fc565b5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:00:27.834792 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40824810-1dd4-4f99-9618-9ed9fc565b5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:00:27.836426 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-40824810-1dd4-4f99-9618-9ed9fc565b5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:00:27.935434 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40824810-1dd4-4f99-9618-9ed9fc565b5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:00:27.937134 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40824810-1dd4-4f99-9618-9ed9fc565b5b service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:00:27.940677 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:00:27.956597 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 757/1505] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:00:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:00:28.003204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c9a27-2d30-4f97-846a-e96c8ef9592f None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:00:28.003676 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c9a27-2d30-4f97-846a-e96c8ef9592f None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:00:28.003796 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c9a27-2d30-4f97-846a-e96c8ef9592f None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:00:28.005886 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 749/1506] 10.222.0.65 () {52 vars in 830 bytes} [Wed Jul 27 09:00:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 09:00:28.010022 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40824810-1dd4-4f99-9618-9ed9fc565b5b service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:00:28.011299 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-40824810-1dd4-4f99-9618-9ed9fc565b5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:00:28.114784 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40824810-1dd4-4f99-9618-9ed9fc565b5b service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:00:28.209546 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b070553-48dd-4aca-aefc-dbabf8e9a009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:00:28.210190 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b070553-48dd-4aca-aefc-dbabf8e9a009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:00:28.210497 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b070553-48dd-4aca-aefc-dbabf8e9a009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:00:28.210772 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b070553-48dd-4aca-aefc-dbabf8e9a009 admin admin] PATH_INFO: `/v3/users/3702adc2d4194c7ab789f90788b78b7d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:00:28.223264 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b070553-48dd-4aca-aefc-dbabf8e9a009 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3702adc2d4194c7ab789f90788b78b7d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:00:28.225000 dv-cinder-797608-64-smb devstack@keystone.service[80152]: WARNING py.warnings [None req-0b070553-48dd-4aca-aefc-dbabf8e9a009 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 09:00:28.225000 dv-cinder-797608-64-smb devstack@keystone.service[80152]: warnings.warn(msg) Jul 27 09:00:28.225000 dv-cinder-797608-64-smb devstack@keystone.service[80152]: Jul 27 09:00:28.226225 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b070553-48dd-4aca-aefc-dbabf8e9a009 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:00:28.236284 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:00:28.292685 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0b070553-48dd-4aca-aefc-dbabf8e9a009 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3702adc2d4194c7ab789f90788b78b7d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:00:28.305593 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0b070553-48dd-4aca-aefc-dbabf8e9a009 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3702adc2d4194c7ab789f90788b78b7d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:00:28.306198 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0b070553-48dd-4aca-aefc-dbabf8e9a009 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3702adc2d4194c7ab789f90788b78b7d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:00:28.325295 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0b070553-48dd-4aca-aefc-dbabf8e9a009 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3702adc2d4194c7ab789f90788b78b7d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:00:28.325738 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0b070553-48dd-4aca-aefc-dbabf8e9a009 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3702adc2d4194c7ab789f90788b78b7d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:00:28.341465 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 758/1507] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:00:28 2022] DELETE /identity/v3/users/3702adc2d4194c7ab789f90788b78b7d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:00:28.345873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1fae9-3c07-48df-bf2a-4883033e9d90 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:00:28.346157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1fae9-3c07-48df-bf2a-4883033e9d90 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:00:28.346479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1fae9-3c07-48df-bf2a-4883033e9d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:00:28.405868 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-b9b1fae9-3c07-48df-bf2a-4883033e9d90 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:00:28.407114 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-b9b1fae9-3c07-48df-bf2a-4883033e9d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:00:28.489003 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:00:28.503010 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 750/1508] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:00:28.513320 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b070553-48dd-4aca-aefc-dbabf8e9a009 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:00:28.514594 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-0b070553-48dd-4aca-aefc-dbabf8e9a009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:00:28.613792 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b070553-48dd-4aca-aefc-dbabf8e9a009 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:00:28.668853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:00:28.692089 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc118944-29b4-442b-83d8-5f2c91a666fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:00:28.693590 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc118944-29b4-442b-83d8-5f2c91a666fa service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:00:28.693886 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc118944-29b4-442b-83d8-5f2c91a666fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:00:28.694166 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc118944-29b4-442b-83d8-5f2c91a666fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:00:28.695855 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-cc118944-29b4-442b-83d8-5f2c91a666fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:00:28.814564 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc118944-29b4-442b-83d8-5f2c91a666fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:00:28.816025 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc118944-29b4-442b-83d8-5f2c91a666fa service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:00:28.837173 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 759/1509] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:00:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:00:29.207362 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1fae9-3c07-48df-bf2a-4883033e9d90 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:00:29.208893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-b9b1fae9-3c07-48df-bf2a-4883033e9d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:00:29.221875 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1fae9-3c07-48df-bf2a-4883033e9d90 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:00:29.326013 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67aa2c-c20f-434d-8cbc-209f4eb55fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:00:29.326671 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67aa2c-c20f-434d-8cbc-209f4eb55fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:00:29.326951 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67aa2c-c20f-434d-8cbc-209f4eb55fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:00:29.327224 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67aa2c-c20f-434d-8cbc-209f4eb55fe2 admin admin] PATH_INFO: `/v3/projects/db20c89a432c42b698c5b989e89952e6` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:00:29.337873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67aa2c-c20f-434d-8cbc-209f4eb55fe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db20c89a432c42b698c5b989e89952e6)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:00:29.338932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: WARNING py.warnings [None req-ef67aa2c-c20f-434d-8cbc-209f4eb55fe2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 09:00:29.338932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: warnings.warn(msg) Jul 27 09:00:29.338932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: Jul 27 09:00:29.340237 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67aa2c-c20f-434d-8cbc-209f4eb55fe2 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:00:29.401106 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-ef67aa2c-c20f-434d-8cbc-209f4eb55fe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db20c89a432c42b698c5b989e89952e6', 'request_id': 'req-ef67aa2c-c20f-434d-8cbc-209f4eb55fe2'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:00:29.407353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-ef67aa2c-c20f-434d-8cbc-209f4eb55fe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db20c89a432c42b698c5b989e89952e6', 'request_id': 'req-ef67aa2c-c20f-434d-8cbc-209f4eb55fe2'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:00:29.418179 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-ef67aa2c-c20f-434d-8cbc-209f4eb55fe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db20c89a432c42b698c5b989e89952e6', 'request_id': 'req-ef67aa2c-c20f-434d-8cbc-209f4eb55fe2'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:00:29.448519 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-ef67aa2c-c20f-434d-8cbc-209f4eb55fe2 admin admin] The token cache is being invalidate because project db20c89a432c42b698c5b989e89952e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:00:29.448810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-ef67aa2c-c20f-434d-8cbc-209f4eb55fe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:00:29.449324 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-ef67aa2c-c20f-434d-8cbc-209f4eb55fe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:00:29.450845 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 751/1510] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:00:29 2022] DELETE /identity/v3/projects/db20c89a432c42b698c5b989e89952e6 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:00:38.834786 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=62 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:00:39.446524 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:02:15.380247 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3adb94-5339-4e2c-bf9a-b598afbb9c5c None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:02:15.380811 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3adb94-5339-4e2c-bf9a-b598afbb9c5c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:02:15.380811 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3adb94-5339-4e2c-bf9a-b598afbb9c5c None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:02:15.382091 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 760/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 09:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 09:02:15.386815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e90e6a-0742-4d02-8beb-ade0dd6c567e None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:02:15.387258 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e90e6a-0742-4d02-8beb-ade0dd6c567e None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:02:15.387400 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e90e6a-0742-4d02-8beb-ade0dd6c567e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:02:15.469632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-66e90e6a-0742-4d02-8beb-ade0dd6c567e None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:02:15.470855 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-66e90e6a-0742-4d02-8beb-ade0dd6c567e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:02:15.574451 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 752/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 09:02:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:02:15.730002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3adb94-5339-4e2c-bf9a-b598afbb9c5c None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:02:15.732200 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-cc3adb94-5339-4e2c-bf9a-b598afbb9c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:02:15.851073 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3adb94-5339-4e2c-bf9a-b598afbb9c5c None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:02:15.856559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03de8ed-76e6-4ad8-a703-42f7fc50501c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:02:15.857291 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03de8ed-76e6-4ad8-a703-42f7fc50501c service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:02:15.857576 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03de8ed-76e6-4ad8-a703-42f7fc50501c service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:02:15.857852 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03de8ed-76e6-4ad8-a703-42f7fc50501c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:02:15.866031 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03de8ed-76e6-4ad8-a703-42f7fc50501c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:02:15.867635 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03de8ed-76e6-4ad8-a703-42f7fc50501c service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:02:15.877721 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 761/1513] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:02:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:02:16.721367 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f92f5-616e-417b-8f56-fad4f974d916 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:02:16.721901 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f92f5-616e-417b-8f56-fad4f974d916 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:02:16.721901 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f92f5-616e-417b-8f56-fad4f974d916 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:02:16.723283 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 753/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 09:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 09:02:16.728041 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649b53f-132e-43bd-9def-00a5e063435e None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:02:16.728479 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649b53f-132e-43bd-9def-00a5e063435e None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:02:16.728579 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649b53f-132e-43bd-9def-00a5e063435e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:02:16.748872 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-e649b53f-132e-43bd-9def-00a5e063435e None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:02:16.750074 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e649b53f-132e-43bd-9def-00a5e063435e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:02:16.758149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 762/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 09:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:02:16.910920 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f92f5-616e-417b-8f56-fad4f974d916 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:02:16.925814 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f92f5-616e-417b-8f56-fad4f974d916 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:02:16.931384 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41feee-ffbf-40df-b43f-4937e476a7cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:02:16.931980 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41feee-ffbf-40df-b43f-4937e476a7cb service nova] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:02:16.932258 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41feee-ffbf-40df-b43f-4937e476a7cb service nova] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:02:16.932533 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41feee-ffbf-40df-b43f-4937e476a7cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:02:16.941388 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41feee-ffbf-40df-b43f-4937e476a7cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:02:16.943031 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41feee-ffbf-40df-b43f-4937e476a7cb service nova] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:02:16.952945 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 754/1516] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:02:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:02:17.950485 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157ad00-c881-4f8a-84ff-a7d39d06aaf8 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:02:17.951050 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157ad00-c881-4f8a-84ff-a7d39d06aaf8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:02:17.951235 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157ad00-c881-4f8a-84ff-a7d39d06aaf8 None None] PATH_INFO: `/v3` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:02:17.952507 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 763/1517] 10.222.0.69 () {54 vars in 925 bytes} [Wed Jul 27 09:02:17 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:02:17.958727 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a68ea8-36ac-4bc8-8588-964c6a8f2219 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:02:17.959177 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a68ea8-36ac-4bc8-8588-964c6a8f2219 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:02:17.959285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a68ea8-36ac-4bc8-8588-964c6a8f2219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:02:18.022238 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-35a68ea8-36ac-4bc8-8588-964c6a8f2219 None None] MFA Rules not processed for user `3d69004d02f9426b86e07907a553e523`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:02:18.023472 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-35a68ea8-36ac-4bc8-8588-964c6a8f2219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:02:18.040519 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:02:18.105028 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 755/1518] 10.222.0.69 () {58 vars in 1015 bytes} [Wed Jul 27 09:02:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:02:22.100702 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff736da-d593-4199-b65c-17e569b54c0f None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:02:22.101278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff736da-d593-4199-b65c-17e569b54c0f None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:02:22.101278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff736da-d593-4199-b65c-17e569b54c0f None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:02:22.102553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 764/1519] 10.222.0.65 () {54 vars in 961 bytes} [Wed Jul 27 09:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 09:02:22.107797 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c45fe-d5df-456b-8fec-f8679d60d2fe None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:02:22.108290 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c45fe-d5df-456b-8fec-f8679d60d2fe None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:02:22.108402 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c45fe-d5df-456b-8fec-f8679d60d2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:02:22.128156 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-c78c45fe-d5df-456b-8fec-f8679d60d2fe None None] MFA Rules not processed for user `3d69004d02f9426b86e07907a553e523`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:02:22.129366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-c78c45fe-d5df-456b-8fec-f8679d60d2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:02:22.137940 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 756/1520] 10.222.0.65 () {58 vars in 1058 bytes} [Wed Jul 27 09:02:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:02:22.147170 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff736da-d593-4199-b65c-17e569b54c0f None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:02:22.161296 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff736da-d593-4199-b65c-17e569b54c0f None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:02:22.166216 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85fccd-d48d-40a6-983a-ef5df1c24511 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d69004d02f9426b86e07907a553e523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:02:22.166854 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85fccd-d48d-40a6-983a-ef5df1c24511 service placement] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:02:22.167137 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85fccd-d48d-40a6-983a-ef5df1c24511 service placement] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:02:22.167412 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85fccd-d48d-40a6-983a-ef5df1c24511 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:02:22.176093 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85fccd-d48d-40a6-983a-ef5df1c24511 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:02:22.177670 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85fccd-d48d-40a6-983a-ef5df1c24511 service placement] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:02:22.187294 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 765/1521] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:02:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:02:28.167130 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165526f-46e3-4444-9317-a547e33494c1 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:02:28.167634 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165526f-46e3-4444-9317-a547e33494c1 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:02:28.167752 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165526f-46e3-4444-9317-a547e33494c1 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:02:28.169050 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 757/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 09:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 09:02:28.174012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184332e7-586a-4030-8937-51ff70218d88 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:02:28.174504 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184332e7-586a-4030-8937-51ff70218d88 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:02:28.174614 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184332e7-586a-4030-8937-51ff70218d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:02:28.194928 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-184332e7-586a-4030-8937-51ff70218d88 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:02:28.196137 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-184332e7-586a-4030-8937-51ff70218d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:02:28.204645 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 766/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 09:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:02:28.359601 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165526f-46e3-4444-9317-a547e33494c1 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:02:28.374486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165526f-46e3-4444-9317-a547e33494c1 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:02:28.379899 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c662a5c-245f-4fcc-b391-827ac58ac340 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:02:28.380508 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c662a5c-245f-4fcc-b391-827ac58ac340 service nova] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:02:28.380791 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c662a5c-245f-4fcc-b391-827ac58ac340 service nova] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:02:28.381069 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c662a5c-245f-4fcc-b391-827ac58ac340 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:02:28.389754 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c662a5c-245f-4fcc-b391-827ac58ac340 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:02:28.391459 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c662a5c-245f-4fcc-b391-827ac58ac340 service nova] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:02:28.401074 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 758/1524] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:02:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:02:29.228156 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b2f85-b871-4aff-820b-51d3e2b8486f None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:02:29.228726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b2f85-b871-4aff-820b-51d3e2b8486f None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:02:29.228726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b2f85-b871-4aff-820b-51d3e2b8486f None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:02:29.230052 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 767/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 09:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 09:02:29.235154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69fe67-6cc6-44c8-ac79-9dd35c238a16 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:02:29.235636 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69fe67-6cc6-44c8-ac79-9dd35c238a16 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:02:29.235740 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69fe67-6cc6-44c8-ac79-9dd35c238a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:02:29.255654 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-eb69fe67-6cc6-44c8-ac79-9dd35c238a16 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:02:29.256868 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-eb69fe67-6cc6-44c8-ac79-9dd35c238a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:02:29.265765 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 759/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 09:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:02:29.418145 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b2f85-b871-4aff-820b-51d3e2b8486f None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:02:29.432332 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b2f85-b871-4aff-820b-51d3e2b8486f None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:02:29.438367 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af921a-d9cd-4a87-96c2-7b587a9e3385 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:02:29.438979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af921a-d9cd-4a87-96c2-7b587a9e3385 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:02:29.439263 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af921a-d9cd-4a87-96c2-7b587a9e3385 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:02:29.439541 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af921a-d9cd-4a87-96c2-7b587a9e3385 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:02:29.447913 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af921a-d9cd-4a87-96c2-7b587a9e3385 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:02:29.449510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af921a-d9cd-4a87-96c2-7b587a9e3385 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:02:29.459429 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 768/1527] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:02:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:02:33.599896 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6125932-79d2-4057-86b2-9781f3e224c4 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:02:33.600463 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6125932-79d2-4057-86b2-9781f3e224c4 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:02:33.600580 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6125932-79d2-4057-86b2-9781f3e224c4 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:02:33.601920 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 760/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 09:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 09:02:33.607113 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79ba59-dbce-44b8-bda0-6497b598ca75 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:02:33.607611 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79ba59-dbce-44b8-bda0-6497b598ca75 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:02:33.607897 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79ba59-dbce-44b8-bda0-6497b598ca75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:02:33.627503 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-3f79ba59-dbce-44b8-bda0-6497b598ca75 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:02:33.628702 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-3f79ba59-dbce-44b8-bda0-6497b598ca75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:02:33.636388 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 769/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 09:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:02:33.712991 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6125932-79d2-4057-86b2-9781f3e224c4 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:02:33.714763 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-f6125932-79d2-4057-86b2-9781f3e224c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:02:33.795537 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6125932-79d2-4057-86b2-9781f3e224c4 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:02:33.799093 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbcaf7-eb01-4ae0-920b-6b7bdcb96f0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:02:33.799703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbcaf7-eb01-4ae0-920b-6b7bdcb96f0d service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:02:33.799977 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbcaf7-eb01-4ae0-920b-6b7bdcb96f0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:02:33.800248 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbcaf7-eb01-4ae0-920b-6b7bdcb96f0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:02:33.809083 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dbcaf7-eb01-4ae0-920b-6b7bdcb96f0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:02:33.810572 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dbcaf7-eb01-4ae0-920b-6b7bdcb96f0d service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:02:33.820352 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 761/1530] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:02:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:02:35.808641 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e894f-2b31-41a3-96a5-13a71900d269 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:02:35.809251 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e894f-2b31-41a3-96a5-13a71900d269 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:02:35.809251 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e894f-2b31-41a3-96a5-13a71900d269 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:02:35.810813 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 770/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 09:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 09:02:35.816238 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e213476-c1d3-49d3-8b9d-94834640807c None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:02:35.816739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e213476-c1d3-49d3-8b9d-94834640807c None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:02:35.816859 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e213476-c1d3-49d3-8b9d-94834640807c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:02:35.836939 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-0e213476-c1d3-49d3-8b9d-94834640807c None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:02:35.838150 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-0e213476-c1d3-49d3-8b9d-94834640807c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:02:35.846725 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 762/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 09:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:02:35.883285 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e894f-2b31-41a3-96a5-13a71900d269 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:02:35.894895 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e894f-2b31-41a3-96a5-13a71900d269 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:02:35.899345 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e3330-24d0-4be7-8a19-ee7c5eb36c0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:02:35.899988 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e3330-24d0-4be7-8a19-ee7c5eb36c0e service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:02:35.900267 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e3330-24d0-4be7-8a19-ee7c5eb36c0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:02:35.900541 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e3330-24d0-4be7-8a19-ee7c5eb36c0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:02:35.910028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e3330-24d0-4be7-8a19-ee7c5eb36c0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:02:35.911493 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e3330-24d0-4be7-8a19-ee7c5eb36c0e service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:02:35.921008 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 771/1533] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:02:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:02:39.548907 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bed7a-e9b8-4d39-bec6-a2c937f9218e None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:02:39.549481 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bed7a-e9b8-4d39-bec6-a2c937f9218e None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:02:39.549481 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bed7a-e9b8-4d39-bec6-a2c937f9218e None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:02:39.550856 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 763/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 09:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 09:02:39.556145 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14c0e6-2829-41ea-88f1-5b1eb0ac5d7d None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:02:39.556558 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14c0e6-2829-41ea-88f1-5b1eb0ac5d7d None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:02:39.556703 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14c0e6-2829-41ea-88f1-5b1eb0ac5d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:02:39.565148 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=81 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:02:39.578078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-ff14c0e6-2829-41ea-88f1-5b1eb0ac5d7d None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:02:39.579317 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ff14c0e6-2829-41ea-88f1-5b1eb0ac5d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:02:39.587193 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 772/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 09:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:02:39.895978 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bed7a-e9b8-4d39-bec6-a2c937f9218e None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:02:39.897791 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-969bed7a-e9b8-4d39-bec6-a2c937f9218e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:02:39.964167 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:02:39.978371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bed7a-e9b8-4d39-bec6-a2c937f9218e None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:02:39.981927 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162380cd-b713-4c4d-a551-24f71749bfc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:02:39.983154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162380cd-b713-4c4d-a551-24f71749bfc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:02:39.983468 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162380cd-b713-4c4d-a551-24f71749bfc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:02:39.983741 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162380cd-b713-4c4d-a551-24f71749bfc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:02:39.993185 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162380cd-b713-4c4d-a551-24f71749bfc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:02:39.994662 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162380cd-b713-4c4d-a551-24f71749bfc1 service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:02:40.004058 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 764/1536] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:02:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:02:42.161844 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416cc4d-2af8-4c34-aa1d-463a5afdffb3 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:02:42.162300 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416cc4d-2af8-4c34-aa1d-463a5afdffb3 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:02:42.162444 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416cc4d-2af8-4c34-aa1d-463a5afdffb3 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:02:42.163800 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 773/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 09:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 09:02:42.168993 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36add0b-c87c-4d89-a91b-f4948016b6bf None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:02:42.169427 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36add0b-c87c-4d89-a91b-f4948016b6bf None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:02:42.169557 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36add0b-c87c-4d89-a91b-f4948016b6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:02:42.189352 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-f36add0b-c87c-4d89-a91b-f4948016b6bf None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:02:42.190590 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-f36add0b-c87c-4d89-a91b-f4948016b6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:02:42.198594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 765/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 09:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:02:42.502990 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416cc4d-2af8-4c34-aa1d-463a5afdffb3 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:02:42.504668 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-0416cc4d-2af8-4c34-aa1d-463a5afdffb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:02:42.517658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416cc4d-2af8-4c34-aa1d-463a5afdffb3 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:02:42.521128 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca53ac-0193-485d-9295-8c94d6033f97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:02:42.521734 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca53ac-0193-485d-9295-8c94d6033f97 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:02:42.522019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca53ac-0193-485d-9295-8c94d6033f97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:02:42.522293 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca53ac-0193-485d-9295-8c94d6033f97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:02:42.531145 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca53ac-0193-485d-9295-8c94d6033f97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:02:42.532556 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca53ac-0193-485d-9295-8c94d6033f97 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:02:42.541877 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 774/1539] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:02:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:02:52.184085 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=11 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:02:52.537776 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=8 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:22.887917 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d78db-3a0f-4be9-b485-9937a4ea21ca None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:22.888624 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d78db-3a0f-4be9-b485-9937a4ea21ca None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:22.888624 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d78db-3a0f-4be9-b485-9937a4ea21ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:22.919920 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-e90d78db-3a0f-4be9-b485-9937a4ea21ca None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:22.921091 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-e90d78db-3a0f-4be9-b485-9937a4ea21ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:22.932009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 766/1540] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:22.940708 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a327f-6e5f-4584-ad3f-3bd3032878e8 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:22.941307 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a327f-6e5f-4584-ad3f-3bd3032878e8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:22.941307 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a327f-6e5f-4584-ad3f-3bd3032878e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:22.972421 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-b79a327f-6e5f-4584-ad3f-3bd3032878e8 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:22.974434 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b79a327f-6e5f-4584-ad3f-3bd3032878e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:22.986126 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 775/1541] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:22.991822 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d78db-3a0f-4be9-b485-9937a4ea21ca None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:23.000219 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b28fea-0df1-48e5-bee5-01bd3acfcf2a None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:23.000649 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b28fea-0df1-48e5-bee5-01bd3acfcf2a None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:23.000935 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b28fea-0df1-48e5-bee5-01bd3acfcf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:23.004233 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d78db-3a0f-4be9-b485-9937a4ea21ca None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:23.011327 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5d8e3-dfaa-4338-896d-5f15e5a3ddff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:23.011954 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5d8e3-dfaa-4338-896d-5f15e5a3ddff admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:23.012233 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5d8e3-dfaa-4338-896d-5f15e5a3ddff admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:23.012505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5d8e3-dfaa-4338-896d-5f15e5a3ddff admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:23.013194 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5d8e3-dfaa-4338-896d-5f15e5a3ddff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:04:23.013640 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5d8e3-dfaa-4338-896d-5f15e5a3ddff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:23.015447 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5d8e3-dfaa-4338-896d-5f15e5a3ddff admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:23.037764 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-31b28fea-0df1-48e5-bee5-01bd3acfcf2a None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:23.039024 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-31b28fea-0df1-48e5-bee5-01bd3acfcf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:23.040774 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 767/1542] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:04:23.050542 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5d8e3-dfaa-4338-896d-5f15e5a3ddff admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:23.064867 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 776/1543] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:04:23.068854 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5d8e3-dfaa-4338-896d-5f15e5a3ddff admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:23.074619 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11309fff-cda7-4ba0-80b7-b10ea41d70c4 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:23.074911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11309fff-cda7-4ba0-80b7-b10ea41d70c4 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:23.075193 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11309fff-cda7-4ba0-80b7-b10ea41d70c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:23.079084 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344168b-0a89-431a-a0d6-60eb242888eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:23.080288 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344168b-0a89-431a-a0d6-60eb242888eb admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:23.080570 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344168b-0a89-431a-a0d6-60eb242888eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:23.080841 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344168b-0a89-431a-a0d6-60eb242888eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:23.081508 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344168b-0a89-431a-a0d6-60eb242888eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:23.082562 dv-cinder-797608-64-smb devstack@keystone.service[80153]: WARNING py.warnings [None req-8344168b-0a89-431a-a0d6-60eb242888eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 09:04:23.082562 dv-cinder-797608-64-smb devstack@keystone.service[80153]: warnings.warn(msg) Jul 27 09:04:23.082562 dv-cinder-797608-64-smb devstack@keystone.service[80153]: Jul 27 09:04:23.084561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344168b-0a89-431a-a0d6-60eb242888eb admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:23.123397 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-11309fff-cda7-4ba0-80b7-b10ea41d70c4 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:23.124632 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-11309fff-cda7-4ba0-80b7-b10ea41d70c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:23.156118 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 768/1544] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:04:23 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:23.158111 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 777/1545] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:23.162842 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11309fff-cda7-4ba0-80b7-b10ea41d70c4 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:23.163198 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344168b-0a89-431a-a0d6-60eb242888eb admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:23.177553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11309fff-cda7-4ba0-80b7-b10ea41d70c4 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:23.291766 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344168b-0a89-431a-a0d6-60eb242888eb admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:23.309814 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03168ec0-e84d-4e36-9ada-c1212e652318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:23.310502 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03168ec0-e84d-4e36-9ada-c1212e652318 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:23.310788 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03168ec0-e84d-4e36-9ada-c1212e652318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:23.311119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03168ec0-e84d-4e36-9ada-c1212e652318 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:23.311839 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03168ec0-e84d-4e36-9ada-c1212e652318 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:23.312500 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4f46d-f2ca-4ba7-b383-a1ff68765547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:23.313136 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4f46d-f2ca-4ba7-b383-a1ff68765547 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:23.313422 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4f46d-f2ca-4ba7-b383-a1ff68765547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:23.313700 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4f46d-f2ca-4ba7-b383-a1ff68765547 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:23.313817 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03168ec0-e84d-4e36-9ada-c1212e652318 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:23.314449 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a4f46d-f2ca-4ba7-b383-a1ff68765547 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:04:23.314765 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a4f46d-f2ca-4ba7-b383-a1ff68765547 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:23.315793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: WARNING py.warnings [None req-04a4f46d-f2ca-4ba7-b383-a1ff68765547 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 09:04:23.315793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: warnings.warn(msg) Jul 27 09:04:23.315793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: Jul 27 09:04:23.316694 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a4f46d-f2ca-4ba7-b383-a1ff68765547 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:23.332543 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 778/1546] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:04:23.333985 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386cc82-a131-4e6c-8e33-32e14399c04b None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:23.334348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386cc82-a131-4e6c-8e33-32e14399c04b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:23.339514 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386cc82-a131-4e6c-8e33-32e14399c04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:23.360183 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 769/1547] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:04:23 2022] POST /identity/v3/users => generated 292 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:23.365363 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313aba0-7a20-4e90-9a7c-e61315614299 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:23.365363 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313aba0-7a20-4e90-9a7c-e61315614299 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:23.365363 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313aba0-7a20-4e90-9a7c-e61315614299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:23.365709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-4386cc82-a131-4e6c-8e33-32e14399c04b None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:23.366033 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4386cc82-a131-4e6c-8e33-32e14399c04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:23.378703 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 779/1548] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:23.379961 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a009f5-b30e-47db-8992-95bbf42c6e6e None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:23.380415 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a009f5-b30e-47db-8992-95bbf42c6e6e None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:23.380946 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a009f5-b30e-47db-8992-95bbf42c6e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:23.397391 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-e313aba0-7a20-4e90-9a7c-e61315614299 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:23.398658 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-e313aba0-7a20-4e90-9a7c-e61315614299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:23.404580 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-a4a009f5-b30e-47db-8992-95bbf42c6e6e None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:23.405877 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a4a009f5-b30e-47db-8992-95bbf42c6e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:23.406911 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 770/1549] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:23.407681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313aba0-7a20-4e90-9a7c-e61315614299 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:23.415012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 780/1550] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:23.422488 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313aba0-7a20-4e90-9a7c-e61315614299 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:23.423720 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a009f5-b30e-47db-8992-95bbf42c6e6e None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:23.427854 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9b3a0-05a2-4b8b-ba60-872ebbd32987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:23.428419 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9b3a0-05a2-4b8b-ba60-872ebbd32987 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:23.428698 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9b3a0-05a2-4b8b-ba60-872ebbd32987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:23.428973 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9b3a0-05a2-4b8b-ba60-872ebbd32987 admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:23.429640 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9b3a0-05a2-4b8b-ba60-872ebbd32987 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:23.432162 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9b3a0-05a2-4b8b-ba60-872ebbd32987 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:23.436114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a009f5-b30e-47db-8992-95bbf42c6e6e None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:23.441380 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7740062-48f8-41de-9d48-5f292b1e0c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:23.442769 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7740062-48f8-41de-9d48-5f292b1e0c38 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:23.443060 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7740062-48f8-41de-9d48-5f292b1e0c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:23.443338 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7740062-48f8-41de-9d48-5f292b1e0c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:23.444450 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7740062-48f8-41de-9d48-5f292b1e0c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:23.446364 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7740062-48f8-41de-9d48-5f292b1e0c38 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:23.459370 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 781/1551] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:23.460448 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927324e-7e49-4478-82f2-c2f5ce8e8e32 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:23.460738 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927324e-7e49-4478-82f2-c2f5ce8e8e32 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:23.461017 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927324e-7e49-4478-82f2-c2f5ce8e8e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:23.468221 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 771/1552] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:04:23 2022] POST /identity/v3/projects => generated 389 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:23.469870 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c12e3-8e45-4ed3-b28a-8ab50329b502 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:23.470455 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c12e3-8e45-4ed3-b28a-8ab50329b502 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:23.470960 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c12e3-8e45-4ed3-b28a-8ab50329b502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:23.488303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-1927324e-7e49-4478-82f2-c2f5ce8e8e32 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:23.489559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1927324e-7e49-4478-82f2-c2f5ce8e8e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:23.494819 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-607c12e3-8e45-4ed3-b28a-8ab50329b502 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:23.496010 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-607c12e3-8e45-4ed3-b28a-8ab50329b502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:23.551063 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 782/1553] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:23.552372 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591018f4-535c-4a2e-bcf8-c4594f6b78ea None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:23.552701 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591018f4-535c-4a2e-bcf8-c4594f6b78ea None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:23.552980 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591018f4-535c-4a2e-bcf8-c4594f6b78ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:23.562642 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 772/1554] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:23.565047 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40c2a5-e159-4c8f-a572-3f0d8fd3e01b None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:23.565335 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40c2a5-e159-4c8f-a572-3f0d8fd3e01b None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:23.565608 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40c2a5-e159-4c8f-a572-3f0d8fd3e01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:23.575670 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-591018f4-535c-4a2e-bcf8-c4594f6b78ea None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:23.577158 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-591018f4-535c-4a2e-bcf8-c4594f6b78ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:23.585488 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-bb40c2a5-e159-4c8f-a572-3f0d8fd3e01b None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:23.586085 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 783/1555] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:23.586691 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-bb40c2a5-e159-4c8f-a572-3f0d8fd3e01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:23.587135 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8b47b-be10-410b-a739-df10ee37eda6 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:23.587427 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8b47b-be10-410b-a739-df10ee37eda6 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:23.587707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8b47b-be10-410b-a739-df10ee37eda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:23.595302 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 773/1556] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:23.600233 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40c2a5-e159-4c8f-a572-3f0d8fd3e01b None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:23.606115 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:23.607846 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-e6b8b47b-be10-410b-a739-df10ee37eda6 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:23.609162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e6b8b47b-be10-410b-a739-df10ee37eda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:23.610476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40c2a5-e159-4c8f-a572-3f0d8fd3e01b None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:23.616269 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fce60a-a99d-4989-8bdb-7215115c4993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:23.616904 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fce60a-a99d-4989-8bdb-7215115c4993 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:23.617188 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fce60a-a99d-4989-8bdb-7215115c4993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:23.617461 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fce60a-a99d-4989-8bdb-7215115c4993 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:23.617926 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 784/1557] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:23.618193 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fce60a-a99d-4989-8bdb-7215115c4993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:23.618743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8b47b-be10-410b-a739-df10ee37eda6 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:23.619845 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fce60a-a99d-4989-8bdb-7215115c4993 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:23.628196 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8b47b-be10-410b-a739-df10ee37eda6 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:23.631045 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 774/1558] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:23.632238 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905ed78-3a04-475c-8d9e-c3161a34755c None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:23.632533 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905ed78-3a04-475c-8d9e-c3161a34755c None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:23.632805 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905ed78-3a04-475c-8d9e-c3161a34755c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:23.636097 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581eead-e2b3-49ad-94fb-887aab55a78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:23.636725 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581eead-e2b3-49ad-94fb-887aab55a78d admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:23.637012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581eead-e2b3-49ad-94fb-887aab55a78d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:23.637284 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581eead-e2b3-49ad-94fb-887aab55a78d admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:23.637949 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581eead-e2b3-49ad-94fb-887aab55a78d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:23.639013 dv-cinder-797608-64-smb devstack@keystone.service[80152]: WARNING py.warnings [None req-5581eead-e2b3-49ad-94fb-887aab55a78d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 09:04:23.639013 dv-cinder-797608-64-smb devstack@keystone.service[80152]: warnings.warn(msg) Jul 27 09:04:23.639013 dv-cinder-797608-64-smb devstack@keystone.service[80152]: Jul 27 09:04:23.640216 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581eead-e2b3-49ad-94fb-887aab55a78d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:23.656620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-6905ed78-3a04-475c-8d9e-c3161a34755c None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:23.658510 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-6905ed78-3a04-475c-8d9e-c3161a34755c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:23.666255 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 785/1559] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:04:23 2022] POST /identity/v3/users => generated 295 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:23.667544 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cb472-875b-484e-ad0c-ad46bbe3be62 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:23.667893 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cb472-875b-484e-ad0c-ad46bbe3be62 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:23.670458 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cb472-875b-484e-ad0c-ad46bbe3be62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:23.670641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 775/1560] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:23.670641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905ed78-3a04-475c-8d9e-c3161a34755c None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:23.680897 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905ed78-3a04-475c-8d9e-c3161a34755c None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:23.685538 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8ba48-fa4c-4207-995a-5a9207dd3a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:23.686161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8ba48-fa4c-4207-995a-5a9207dd3a93 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:23.686577 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8ba48-fa4c-4207-995a-5a9207dd3a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:23.686852 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8ba48-fa4c-4207-995a-5a9207dd3a93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:23.687553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8ba48-fa4c-4207-995a-5a9207dd3a93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:04:23.687860 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8ba48-fa4c-4207-995a-5a9207dd3a93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:23.689483 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8ba48-fa4c-4207-995a-5a9207dd3a93 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:23.691620 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-448cb472-875b-484e-ad0c-ad46bbe3be62 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:23.693199 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-448cb472-875b-484e-ad0c-ad46bbe3be62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:23.702046 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 786/1561] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:23.703355 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156a96b-ae5f-4756-81ad-0fd5448ac9bc None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:23.703645 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156a96b-ae5f-4756-81ad-0fd5448ac9bc None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:23.704026 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156a96b-ae5f-4756-81ad-0fd5448ac9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:23.706487 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 776/1562] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:04:23.707605 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8ba48-fa4c-4207-995a-5a9207dd3a93 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:23.718413 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8ba48-fa4c-4207-995a-5a9207dd3a93 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:23.724671 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e429e7a-0e2f-48ef-8b9f-4cd8ae50f246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:23.725376 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e429e7a-0e2f-48ef-8b9f-4cd8ae50f246 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:23.725826 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e429e7a-0e2f-48ef-8b9f-4cd8ae50f246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:23.726102 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e429e7a-0e2f-48ef-8b9f-4cd8ae50f246 admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:23.727209 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e429e7a-0e2f-48ef-8b9f-4cd8ae50f246 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:04:23.727517 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e429e7a-0e2f-48ef-8b9f-4cd8ae50f246 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:23.729583 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e429e7a-0e2f-48ef-8b9f-4cd8ae50f246 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:23.731517 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-1156a96b-ae5f-4756-81ad-0fd5448ac9bc None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:23.733270 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1156a96b-ae5f-4756-81ad-0fd5448ac9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:23.742126 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 787/1563] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:23.742870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156a96b-ae5f-4756-81ad-0fd5448ac9bc None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:23.754484 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 777/1564] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:04:23.754484 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e429e7a-0e2f-48ef-8b9f-4cd8ae50f246 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:23.759575 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e429e7a-0e2f-48ef-8b9f-4cd8ae50f246 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:23.759740 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156a96b-ae5f-4756-81ad-0fd5448ac9bc None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:23.764194 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3c689-3a4a-4902-aa62-e2c67450a171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:23.764435 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720481c7-5a1f-4154-8f7e-8dd961a69392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:23.764861 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3c689-3a4a-4902-aa62-e2c67450a171 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:23.765071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720481c7-5a1f-4154-8f7e-8dd961a69392 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:23.765183 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3c689-3a4a-4902-aa62-e2c67450a171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:23.765437 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3c689-3a4a-4902-aa62-e2c67450a171 admin admin] PATH_INFO: `/v3/projects/4b722d8bdc984cec993b6eea60da7ac1/users/ae3fe5b4d9344c3bb7ae21b030377313/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:23.765661 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720481c7-5a1f-4154-8f7e-8dd961a69392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:23.765940 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720481c7-5a1f-4154-8f7e-8dd961a69392 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:23.766795 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720481c7-5a1f-4154-8f7e-8dd961a69392 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:04:23.767101 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720481c7-5a1f-4154-8f7e-8dd961a69392 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:23.768707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720481c7-5a1f-4154-8f7e-8dd961a69392 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:23.770968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:23.782442 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3c689-3a4a-4902-aa62-e2c67450a171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b722d8bdc984cec993b6eea60da7ac1, user_id=ae3fe5b4d9344c3bb7ae21b030377313, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:23.783492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: WARNING py.warnings [None req-2ea3c689-3a4a-4902-aa62-e2c67450a171 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 09:04:23.783492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: warnings.warn(msg) Jul 27 09:04:23.783492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: Jul 27 09:04:23.784074 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 788/1565] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:04:23.784906 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720481c7-5a1f-4154-8f7e-8dd961a69392 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:23.785543 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3c689-3a4a-4902-aa62-e2c67450a171 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:23.796333 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720481c7-5a1f-4154-8f7e-8dd961a69392 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:23.803583 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 778/1566] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:04:23 2022] PUT /identity/v3/projects/4b722d8bdc984cec993b6eea60da7ac1/users/ae3fe5b4d9344c3bb7ae21b030377313/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:23.804949 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9e1f0-f2cc-4852-8c69-7e79aa99bd86 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:23.805235 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9e1f0-f2cc-4852-8c69-7e79aa99bd86 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:23.805516 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9e1f0-f2cc-4852-8c69-7e79aa99bd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:23.825836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-17a9e1f0-f2cc-4852-8c69-7e79aa99bd86 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:23.827374 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-17a9e1f0-f2cc-4852-8c69-7e79aa99bd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:23.855544 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab853c-18d5-4873-bfce-65ef20b373e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:23.856135 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab853c-18d5-4873-bfce-65ef20b373e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:23.856416 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab853c-18d5-4873-bfce-65ef20b373e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:23.856691 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab853c-18d5-4873-bfce-65ef20b373e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:23.857407 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab853c-18d5-4873-bfce-65ef20b373e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:23.859170 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab853c-18d5-4873-bfce-65ef20b373e7 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:23.869255 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 789/1567] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:23.873033 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab853c-18d5-4873-bfce-65ef20b373e7 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:23.883185 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab853c-18d5-4873-bfce-65ef20b373e7 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:23.887920 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3386f-bc09-49c4-9d4c-b29c4b388733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:23.888816 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3386f-bc09-49c4-9d4c-b29c4b388733 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:23.889280 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3386f-bc09-49c4-9d4c-b29c4b388733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:23.889634 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3386f-bc09-49c4-9d4c-b29c4b388733 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:23.890432 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3386f-bc09-49c4-9d4c-b29c4b388733 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:04:23.890815 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3386f-bc09-49c4-9d4c-b29c4b388733 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:23.892499 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3386f-bc09-49c4-9d4c-b29c4b388733 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:23.894144 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 779/1568] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:23.894852 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9e1f0-f2cc-4852-8c69-7e79aa99bd86 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:23.905009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9e1f0-f2cc-4852-8c69-7e79aa99bd86 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:23.909611 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 790/1569] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:04:23.909749 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7c3dc-c8a9-4820-bbb4-c5d7bdea5ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:23.910607 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3386f-bc09-49c4-9d4c-b29c4b388733 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:23.914991 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7c3dc-c8a9-4820-bbb4-c5d7bdea5ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:23.915381 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7c3dc-c8a9-4820-bbb4-c5d7bdea5ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:23.915935 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7c3dc-c8a9-4820-bbb4-c5d7bdea5ef3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:23.916983 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7c3dc-c8a9-4820-bbb4-c5d7bdea5ef3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:23.919428 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7c3dc-c8a9-4820-bbb4-c5d7bdea5ef3 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:23.920808 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3386f-bc09-49c4-9d4c-b29c4b388733 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:23.925429 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f715c34-15c7-431d-abf5-1ed76f863111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:23.926038 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f715c34-15c7-431d-abf5-1ed76f863111 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:23.926340 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f715c34-15c7-431d-abf5-1ed76f863111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:23.926683 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f715c34-15c7-431d-abf5-1ed76f863111 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:23.927586 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f715c34-15c7-431d-abf5-1ed76f863111 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:04:23.927894 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f715c34-15c7-431d-abf5-1ed76f863111 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:23.929496 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f715c34-15c7-431d-abf5-1ed76f863111 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:23.942775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 791/1570] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:04:23.943915 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f715c34-15c7-431d-abf5-1ed76f863111 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:23.954347 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f715c34-15c7-431d-abf5-1ed76f863111 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:23.958679 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 780/1571] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:04:23 2022] POST /identity/v3/projects => generated 393 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:23.958679 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7c3dc-c8a9-4820-bbb4-c5d7bdea5ef3 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:24.014562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce862a-acc4-4f49-9f0b-fdcf3764a3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:24.015189 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce862a-acc4-4f49-9f0b-fdcf3764a3fb admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:24.015472 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce862a-acc4-4f49-9f0b-fdcf3764a3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:24.015750 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce862a-acc4-4f49-9f0b-fdcf3764a3fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:24.016467 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce862a-acc4-4f49-9f0b-fdcf3764a3fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:24.018346 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce862a-acc4-4f49-9f0b-fdcf3764a3fb admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:24.023706 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7c3dc-c8a9-4820-bbb4-c5d7bdea5ef3 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:24.028862 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725c335-965b-4406-9b22-a09ed0143fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:24.029967 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725c335-965b-4406-9b22-a09ed0143fbd admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:24.030251 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725c335-965b-4406-9b22-a09ed0143fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:24.030558 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725c335-965b-4406-9b22-a09ed0143fbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:24.031222 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725c335-965b-4406-9b22-a09ed0143fbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:24.033536 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725c335-965b-4406-9b22-a09ed0143fbd admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:24.047879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 792/1572] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:04:23 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:24.049226 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1a06d-4bc8-48a1-a3c0-22005b5e8f13 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:24.049517 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1a06d-4bc8-48a1-a3c0-22005b5e8f13 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:24.049800 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1a06d-4bc8-48a1-a3c0-22005b5e8f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:24.058997 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:24.070026 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-d1a1a06d-4bc8-48a1-a3c0-22005b5e8f13 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:24.070244 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 781/1573] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:04:23 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:24.071188 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725c335-965b-4406-9b22-a09ed0143fbd admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:24.071313 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d1a1a06d-4bc8-48a1-a3c0-22005b5e8f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:24.122778 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:24.140800 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725c335-965b-4406-9b22-a09ed0143fbd admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:24.142633 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 793/1574] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:24.143752 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1a06d-4bc8-48a1-a3c0-22005b5e8f13 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:24.148901 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef565a-9605-4c9d-b34c-6ef85d37859b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:24.149620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef565a-9605-4c9d-b34c-6ef85d37859b admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:24.150248 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef565a-9605-4c9d-b34c-6ef85d37859b admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:24.151288 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef565a-9605-4c9d-b34c-6ef85d37859b admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:24.151945 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef565a-9605-4c9d-b34c-6ef85d37859b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:24.153280 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef565a-9605-4c9d-b34c-6ef85d37859b admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:24.157637 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1a06d-4bc8-48a1-a3c0-22005b5e8f13 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:24.162901 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ac030-1b7d-4971-9036-7b9c1b4e4b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:24.163537 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ac030-1b7d-4971-9036-7b9c1b4e4b08 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:24.163819 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ac030-1b7d-4971-9036-7b9c1b4e4b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:24.164094 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ac030-1b7d-4971-9036-7b9c1b4e4b08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:24.164716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 782/1575] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:24.164833 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ac030-1b7d-4971-9036-7b9c1b4e4b08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:04:24.165204 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ac030-1b7d-4971-9036-7b9c1b4e4b08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:24.165622 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef565a-9605-4c9d-b34c-6ef85d37859b admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:24.166896 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ac030-1b7d-4971-9036-7b9c1b4e4b08 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:24.178988 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef565a-9605-4c9d-b34c-6ef85d37859b admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:24.180890 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 794/1576] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:04:24.183346 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ac030-1b7d-4971-9036-7b9c1b4e4b08 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:24.184565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddc848-294c-4c8d-9641-12f6857b7edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:24.185202 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddc848-294c-4c8d-9641-12f6857b7edf admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:24.185480 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddc848-294c-4c8d-9641-12f6857b7edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:24.185755 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddc848-294c-4c8d-9641-12f6857b7edf admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:24.186463 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ddc848-294c-4c8d-9641-12f6857b7edf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:24.188407 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ddc848-294c-4c8d-9641-12f6857b7edf admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:24.195321 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ac030-1b7d-4971-9036-7b9c1b4e4b08 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:24.200393 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884f15d-4a62-415f-944d-8c27d7154d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:24.201022 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884f15d-4a62-415f-944d-8c27d7154d6d admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:24.201570 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884f15d-4a62-415f-944d-8c27d7154d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:24.201907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884f15d-4a62-415f-944d-8c27d7154d6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:24.202543 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884f15d-4a62-415f-944d-8c27d7154d6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:24.204494 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884f15d-4a62-415f-944d-8c27d7154d6d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:24.217383 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 783/1577] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:04:24 2022] POST /identity/v3/projects => generated 363 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:24.218211 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddc848-294c-4c8d-9641-12f6857b7edf admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:24.234223 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 795/1578] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:04:24 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:24.236778 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884f15d-4a62-415f-944d-8c27d7154d6d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:24.293448 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddc848-294c-4c8d-9641-12f6857b7edf admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:24.298551 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68e1a7-d1d5-46de-a522-1f55a002c21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:24.299173 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68e1a7-d1d5-46de-a522-1f55a002c21c admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:24.299455 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68e1a7-d1d5-46de-a522-1f55a002c21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:24.299728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68e1a7-d1d5-46de-a522-1f55a002c21c admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:24.300389 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68e1a7-d1d5-46de-a522-1f55a002c21c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:24.302371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68e1a7-d1d5-46de-a522-1f55a002c21c admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:24.302525 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884f15d-4a62-415f-944d-8c27d7154d6d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:24.307445 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be6999-4250-43e0-971f-4a2e03218667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:24.308058 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be6999-4250-43e0-971f-4a2e03218667 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:24.308365 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be6999-4250-43e0-971f-4a2e03218667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:24.308619 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be6999-4250-43e0-971f-4a2e03218667 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:24.309286 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be6999-4250-43e0-971f-4a2e03218667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:24.311254 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be6999-4250-43e0-971f-4a2e03218667 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:24.327371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 784/1579] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:04:24 2022] POST /identity/v3/users => generated 297 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:24.327371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68e1a7-d1d5-46de-a522-1f55a002c21c admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:24.335528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68e1a7-d1d5-46de-a522-1f55a002c21c admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:24.337583 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 796/1580] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:04:24 2022] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:24.338518 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be6999-4250-43e0-971f-4a2e03218667 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:24.343045 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013d75b-43d3-4550-864c-acbbad1f6aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:24.343663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013d75b-43d3-4550-864c-acbbad1f6aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:24.343945 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013d75b-43d3-4550-864c-acbbad1f6aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:24.344227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013d75b-43d3-4550-864c-acbbad1f6aa9 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:24.344890 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013d75b-43d3-4550-864c-acbbad1f6aa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:24.346914 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013d75b-43d3-4550-864c-acbbad1f6aa9 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:24.368957 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 785/1581] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:04:24 2022] POST /identity/v3/users => generated 288 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:24.370223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013d75b-43d3-4550-864c-acbbad1f6aa9 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:24.379536 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013d75b-43d3-4550-864c-acbbad1f6aa9 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:24.384224 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b392e1-2506-404c-a8e1-21bcac4c8e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:24.384874 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b392e1-2506-404c-a8e1-21bcac4c8e8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:24.385153 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b392e1-2506-404c-a8e1-21bcac4c8e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:24.385433 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b392e1-2506-404c-a8e1-21bcac4c8e8b admin admin] PATH_INFO: `/v3/projects/fe158cc8c3114b8dac893a9d408414d2/users/f67b7dc78caf4da490739ff96f436764/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:24.398586 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be6999-4250-43e0-971f-4a2e03218667 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:24.400611 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b392e1-2506-404c-a8e1-21bcac4c8e8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe158cc8c3114b8dac893a9d408414d2, user_id=f67b7dc78caf4da490739ff96f436764, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:24.402209 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e283630-eaf3-45c6-82cb-8049e1727c3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:24.402865 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e283630-eaf3-45c6-82cb-8049e1727c3b service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:24.403145 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e283630-eaf3-45c6-82cb-8049e1727c3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:24.403323 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b392e1-2506-404c-a8e1-21bcac4c8e8b admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:24.403454 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e283630-eaf3-45c6-82cb-8049e1727c3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:24.412921 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e283630-eaf3-45c6-82cb-8049e1727c3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:24.414428 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e283630-eaf3-45c6-82cb-8049e1727c3b service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:24.416511 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 786/1582] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:04:24 2022] PUT /identity/v3/projects/fe158cc8c3114b8dac893a9d408414d2/users/f67b7dc78caf4da490739ff96f436764/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:24.417365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b392e1-2506-404c-a8e1-21bcac4c8e8b admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:24.424398 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 797/1583] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:04:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:04:24.425191 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e283630-eaf3-45c6-82cb-8049e1727c3b service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:24.434714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e283630-eaf3-45c6-82cb-8049e1727c3b service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:24.447763 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:24.488581 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:24.503651 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b392e1-2506-404c-a8e1-21bcac4c8e8b admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:24.505489 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6299b0-842b-4a57-8482-f079ebcd042d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:24.506145 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6299b0-842b-4a57-8482-f079ebcd042d admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:24.506456 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6299b0-842b-4a57-8482-f079ebcd042d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:24.506730 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6299b0-842b-4a57-8482-f079ebcd042d admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:24.507399 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6299b0-842b-4a57-8482-f079ebcd042d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:24.509343 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6299b0-842b-4a57-8482-f079ebcd042d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:24.509870 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08612911-4d03-49cd-a4f8-38bed0d0ad2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:24.510628 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08612911-4d03-49cd-a4f8-38bed0d0ad2c admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:24.511002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08612911-4d03-49cd-a4f8-38bed0d0ad2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:24.511368 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08612911-4d03-49cd-a4f8-38bed0d0ad2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:24.512124 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08612911-4d03-49cd-a4f8-38bed0d0ad2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:24.514312 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08612911-4d03-49cd-a4f8-38bed0d0ad2c admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:24.534371 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 798/1584] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:04:24 2022] POST /identity/v3/users => generated 282 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:24.535903 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6299b0-842b-4a57-8482-f079ebcd042d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:24.547585 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6299b0-842b-4a57-8482-f079ebcd042d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:24.553249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3921edc-bb67-44d2-ae94-f2e55544356c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:24.553726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3921edc-bb67-44d2-ae94-f2e55544356c admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:24.554006 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3921edc-bb67-44d2-ae94-f2e55544356c admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:24.554279 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3921edc-bb67-44d2-ae94-f2e55544356c admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:24.554981 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3921edc-bb67-44d2-ae94-f2e55544356c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:24.559217 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 787/1585] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:04:24 2022] POST /identity/v3/projects => generated 405 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:24.559365 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3921edc-bb67-44d2-ae94-f2e55544356c admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:24.559462 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08612911-4d03-49cd-a4f8-38bed0d0ad2c admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:24.583403 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 799/1586] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:04:24 2022] POST /identity/v3/users => generated 290 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:24.583403 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3921edc-bb67-44d2-ae94-f2e55544356c admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:24.594643 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3921edc-bb67-44d2-ae94-f2e55544356c admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:24.629281 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08612911-4d03-49cd-a4f8-38bed0d0ad2c admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:24.636055 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c05c6-920b-4af5-99e1-4b1c0e590fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:24.636955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c05c6-920b-4af5-99e1-4b1c0e590fce admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:24.637096 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c05c6-920b-4af5-99e1-4b1c0e590fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:24.637545 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c05c6-920b-4af5-99e1-4b1c0e590fce admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:24.638200 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c05c6-920b-4af5-99e1-4b1c0e590fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:24.641796 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c05c6-920b-4af5-99e1-4b1c0e590fce admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:24.667298 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d82c4-be5c-4c55-8cb6-e2fd3d2c7e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:24.668198 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d82c4-be5c-4c55-8cb6-e2fd3d2c7e6b admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:24.671528 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d82c4-be5c-4c55-8cb6-e2fd3d2c7e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:24.671644 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 788/1587] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:24.671731 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d82c4-be5c-4c55-8cb6-e2fd3d2c7e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:24.671807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c05c6-920b-4af5-99e1-4b1c0e590fce admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:24.671881 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d82c4-be5c-4c55-8cb6-e2fd3d2c7e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:24.671881 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d82c4-be5c-4c55-8cb6-e2fd3d2c7e6b admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:24.682645 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 800/1588] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:24.686087 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c05c6-920b-4af5-99e1-4b1c0e590fce admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:24.686942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa794e-15e9-4755-abaf-1ef6d7c99660 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:24.687375 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa794e-15e9-4755-abaf-1ef6d7c99660 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:24.687841 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa794e-15e9-4755-abaf-1ef6d7c99660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:24.691690 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71512f-f7e7-493d-9fb8-0393e43c9fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:24.693281 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71512f-f7e7-493d-9fb8-0393e43c9fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:24.693760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71512f-f7e7-493d-9fb8-0393e43c9fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:24.693987 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71512f-f7e7-493d-9fb8-0393e43c9fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:24.694822 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71512f-f7e7-493d-9fb8-0393e43c9fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:24.697070 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71512f-f7e7-493d-9fb8-0393e43c9fd1 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:24.711407 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 789/1589] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:24.712180 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71512f-f7e7-493d-9fb8-0393e43c9fd1 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:24.714885 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-fdfa794e-15e9-4755-abaf-1ef6d7c99660 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:24.716106 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fdfa794e-15e9-4755-abaf-1ef6d7c99660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:24.724779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71512f-f7e7-493d-9fb8-0393e43c9fd1 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:24.728933 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 801/1590] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:24.728933 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa794e-15e9-4755-abaf-1ef6d7c99660 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:24.737096 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa794e-15e9-4755-abaf-1ef6d7c99660 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:24.742216 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834646c1-38e0-4a1f-92f0-1f5bca2eca3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:24.742626 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff9d66-9e75-4817-bd0e-6f6ee9c7f4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:24.742879 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834646c1-38e0-4a1f-92f0-1f5bca2eca3d admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:24.743163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834646c1-38e0-4a1f-92f0-1f5bca2eca3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:24.743283 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff9d66-9e75-4817-bd0e-6f6ee9c7f4a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:24.743461 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834646c1-38e0-4a1f-92f0-1f5bca2eca3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:24.743570 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff9d66-9e75-4817-bd0e-6f6ee9c7f4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:24.743767 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff9d66-9e75-4817-bd0e-6f6ee9c7f4a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:24.744140 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834646c1-38e0-4a1f-92f0-1f5bca2eca3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:24.744489 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff9d66-9e75-4817-bd0e-6f6ee9c7f4a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:24.745734 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834646c1-38e0-4a1f-92f0-1f5bca2eca3d admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:24.746988 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff9d66-9e75-4817-bd0e-6f6ee9c7f4a3 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:24.757493 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 790/1591] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:24.758705 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834646c1-38e0-4a1f-92f0-1f5bca2eca3d admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:24.768705 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834646c1-38e0-4a1f-92f0-1f5bca2eca3d admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:24.771868 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 802/1592] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:04:24 2022] POST /identity/v3/users => generated 303 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:24.772805 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff9d66-9e75-4817-bd0e-6f6ee9c7f4a3 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:24.776932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168b6fc-6476-4bf1-ba73-70efab188f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:24.777811 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168b6fc-6476-4bf1-ba73-70efab188f79 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:24.778262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168b6fc-6476-4bf1-ba73-70efab188f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:24.780103 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168b6fc-6476-4bf1-ba73-70efab188f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:24.780103 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168b6fc-6476-4bf1-ba73-70efab188f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:24.780879 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168b6fc-6476-4bf1-ba73-70efab188f79 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:24.787086 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff9d66-9e75-4817-bd0e-6f6ee9c7f4a3 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:24.791894 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1fe31-d235-43f1-8000-2c5ffc229444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:24.792774 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1fe31-d235-43f1-8000-2c5ffc229444 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:24.792920 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 791/1593] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:24.793623 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168b6fc-6476-4bf1-ba73-70efab188f79 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:24.796104 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1fe31-d235-43f1-8000-2c5ffc229444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:24.796468 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1fe31-d235-43f1-8000-2c5ffc229444 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:24.797274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1fe31-d235-43f1-8000-2c5ffc229444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:24.799013 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1fe31-d235-43f1-8000-2c5ffc229444 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:24.804314 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168b6fc-6476-4bf1-ba73-70efab188f79 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:24.809407 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350903b-da25-4437-8099-e4ad830f4da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:24.810021 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350903b-da25-4437-8099-e4ad830f4da0 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:24.810300 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350903b-da25-4437-8099-e4ad830f4da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:24.810676 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350903b-da25-4437-8099-e4ad830f4da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:24.811377 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350903b-da25-4437-8099-e4ad830f4da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:24.811798 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 803/1594] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:24.812979 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350903b-da25-4437-8099-e4ad830f4da0 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:24.815229 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1fe31-d235-43f1-8000-2c5ffc229444 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:24.826705 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1fe31-d235-43f1-8000-2c5ffc229444 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:24.827484 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 792/1595] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:24.831411 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350903b-da25-4437-8099-e4ad830f4da0 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:24.832443 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701a2ee-479f-493e-bb5b-75a32c948b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:24.833656 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-8350903b-da25-4437-8099-e4ad830f4da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:24.833849 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701a2ee-479f-493e-bb5b-75a32c948b5d admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:24.834420 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701a2ee-479f-493e-bb5b-75a32c948b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:24.834836 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701a2ee-479f-493e-bb5b-75a32c948b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:24.835605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3701a2ee-479f-493e-bb5b-75a32c948b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:24.837309 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3701a2ee-479f-493e-bb5b-75a32c948b5d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:24.858750 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 804/1596] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:24.859510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701a2ee-479f-493e-bb5b-75a32c948b5d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:24.875346 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701a2ee-479f-493e-bb5b-75a32c948b5d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:24.886494 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69eea36-2a4d-411f-aa3f-fe1b776db952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:24.888175 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69eea36-2a4d-411f-aa3f-fe1b776db952 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:24.888462 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69eea36-2a4d-411f-aa3f-fe1b776db952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:24.888733 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69eea36-2a4d-411f-aa3f-fe1b776db952 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:24.891418 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69eea36-2a4d-411f-aa3f-fe1b776db952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:24.894732 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69eea36-2a4d-411f-aa3f-fe1b776db952 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:24.906615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 805/1597] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:24.907010 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350903b-da25-4437-8099-e4ad830f4da0 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:24.907605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69eea36-2a4d-411f-aa3f-fe1b776db952 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:24.912784 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a960d-d7ad-4e95-aa17-fbd62a73963f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:24.913605 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a960d-d7ad-4e95-aa17-fbd62a73963f service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:24.913890 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a960d-d7ad-4e95-aa17-fbd62a73963f service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:24.914167 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a960d-d7ad-4e95-aa17-fbd62a73963f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:24.922383 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69eea36-2a4d-411f-aa3f-fe1b776db952 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:24.925548 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a960d-d7ad-4e95-aa17-fbd62a73963f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:24.928434 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a960d-d7ad-4e95-aa17-fbd62a73963f service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:24.929396 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcff09-f0d0-44e7-bd03-bcc456e5a504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:24.930171 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcff09-f0d0-44e7-bd03-bcc456e5a504 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:24.930541 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcff09-f0d0-44e7-bd03-bcc456e5a504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:24.931007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcff09-f0d0-44e7-bd03-bcc456e5a504 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:24.931786 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bcff09-f0d0-44e7-bd03-bcc456e5a504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:24.933701 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bcff09-f0d0-44e7-bd03-bcc456e5a504 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:24.940317 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 793/1598] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:04:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:04:24.941255 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a960d-d7ad-4e95-aa17-fbd62a73963f service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:24.948373 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:24.952987 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 806/1599] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:24.953979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcff09-f0d0-44e7-bd03-bcc456e5a504 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:24.954945 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a960d-d7ad-4e95-aa17-fbd62a73963f service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:24.963281 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c225c95-46f3-4b52-90c8-6f28be5929ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:24.963912 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c225c95-46f3-4b52-90c8-6f28be5929ab admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:24.964389 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c225c95-46f3-4b52-90c8-6f28be5929ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:24.964730 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcff09-f0d0-44e7-bd03-bcc456e5a504 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:24.964856 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c225c95-46f3-4b52-90c8-6f28be5929ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:24.965550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c225c95-46f3-4b52-90c8-6f28be5929ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:24.967759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c225c95-46f3-4b52-90c8-6f28be5929ab admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:24.971145 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcba18-15be-4c71-ba17-391b2970954d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:24.971810 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcba18-15be-4c71-ba17-391b2970954d admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:24.972092 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcba18-15be-4c71-ba17-391b2970954d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:24.972846 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcba18-15be-4c71-ba17-391b2970954d admin admin] PATH_INFO: `/v3/projects/126eab441c494c56893817343530eff8/users/5f1dfc498c1f4ccfa214d8c4777a2b1a/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:24.980799 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 794/1600] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:24.985565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c225c95-46f3-4b52-90c8-6f28be5929ab admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:24.992820 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcba18-15be-4c71-ba17-391b2970954d admin admin] RBAC: Authorizing `identity:create_grant(project_id=126eab441c494c56893817343530eff8, user_id=5f1dfc498c1f4ccfa214d8c4777a2b1a, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:24.995989 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcba18-15be-4c71-ba17-391b2970954d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:24.996578 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c225c95-46f3-4b52-90c8-6f28be5929ab admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:25.001011 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02eabe-e6c4-4e54-8fb1-13c7ba03ec12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:25.001697 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02eabe-e6c4-4e54-8fb1-13c7ba03ec12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:25.002019 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02eabe-e6c4-4e54-8fb1-13c7ba03ec12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:25.002261 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02eabe-e6c4-4e54-8fb1-13c7ba03ec12 admin admin] PATH_INFO: `/v3/projects/b6bc49b952ca42f7a51a15035ce4e81b/users/ec8b9371831a4ebab41ebcee9f2a6d12/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:25.012769 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 807/1601] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:04:24 2022] PUT /identity/v3/projects/126eab441c494c56893817343530eff8/users/5f1dfc498c1f4ccfa214d8c4777a2b1a/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:25.013674 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcba18-15be-4c71-ba17-391b2970954d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:25.028532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02eabe-e6c4-4e54-8fb1-13c7ba03ec12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6bc49b952ca42f7a51a15035ce4e81b, user_id=ec8b9371831a4ebab41ebcee9f2a6d12, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:25.031947 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02eabe-e6c4-4e54-8fb1-13c7ba03ec12 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:25.048467 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:25.060653 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 795/1602] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:04:24 2022] PUT /identity/v3/projects/b6bc49b952ca42f7a51a15035ce4e81b/users/ec8b9371831a4ebab41ebcee9f2a6d12/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:25.060653 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02eabe-e6c4-4e54-8fb1-13c7ba03ec12 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:25.124421 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcba18-15be-4c71-ba17-391b2970954d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:25.140343 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02eabe-e6c4-4e54-8fb1-13c7ba03ec12 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:25.145731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977118b-29b7-426f-81b9-aa792484a055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:25.146917 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977118b-29b7-426f-81b9-aa792484a055 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:25.147582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977118b-29b7-426f-81b9-aa792484a055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:25.147582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977118b-29b7-426f-81b9-aa792484a055 admin admin] PATH_INFO: `/v3/projects/c9a812e588bd4416886b8c548c78e6cf/users/e6b18be5761c4038b7db3e45da14a3ba/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:25.164608 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977118b-29b7-426f-81b9-aa792484a055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9a812e588bd4416886b8c548c78e6cf, user_id=e6b18be5761c4038b7db3e45da14a3ba, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:25.167481 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977118b-29b7-426f-81b9-aa792484a055 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:25.186847 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 796/1603] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:04:25 2022] PUT /identity/v3/projects/c9a812e588bd4416886b8c548c78e6cf/users/e6b18be5761c4038b7db3e45da14a3ba/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:25.187909 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977118b-29b7-426f-81b9-aa792484a055 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:25.196920 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f2b0c-e5be-4fcb-83e0-1582a8e8d640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:25.197626 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f2b0c-e5be-4fcb-83e0-1582a8e8d640 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:25.197905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f2b0c-e5be-4fcb-83e0-1582a8e8d640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:25.198188 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f2b0c-e5be-4fcb-83e0-1582a8e8d640 admin admin] PATH_INFO: `/v3/projects/7ea24cd3c1954982bcf018d3946e9c08/users/1d586ea72a1a4865941b30fa77103a52/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:25.219233 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f2b0c-e5be-4fcb-83e0-1582a8e8d640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ea24cd3c1954982bcf018d3946e9c08, user_id=1d586ea72a1a4865941b30fa77103a52, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:25.222048 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f2b0c-e5be-4fcb-83e0-1582a8e8d640 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:25.239815 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 808/1604] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:04:25 2022] PUT /identity/v3/projects/7ea24cd3c1954982bcf018d3946e9c08/users/1d586ea72a1a4865941b30fa77103a52/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:25.240587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f2b0c-e5be-4fcb-83e0-1582a8e8d640 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:25.272101 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977118b-29b7-426f-81b9-aa792484a055 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:25.326177 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f2b0c-e5be-4fcb-83e0-1582a8e8d640 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:25.333245 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:25.333539 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff32265-9454-4d5c-a28c-4e7113e60786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:25.334184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff32265-9454-4d5c-a28c-4e7113e60786 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:25.334505 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff32265-9454-4d5c-a28c-4e7113e60786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:25.334787 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff32265-9454-4d5c-a28c-4e7113e60786 admin admin] PATH_INFO: `/v3/projects/d06dfb97c48740cfbc2f4bedc4e0bac0/users/78116abe231f4e8fa7f62e8764fb5857/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:25.343422 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66344f7-fff9-4466-85f7-d58095b780d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:25.344537 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66344f7-fff9-4466-85f7-d58095b780d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:25.344825 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66344f7-fff9-4466-85f7-d58095b780d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:25.345125 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66344f7-fff9-4466-85f7-d58095b780d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:25.346004 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66344f7-fff9-4466-85f7-d58095b780d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:25.347966 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66344f7-fff9-4466-85f7-d58095b780d4 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:25.351839 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff32265-9454-4d5c-a28c-4e7113e60786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d06dfb97c48740cfbc2f4bedc4e0bac0, user_id=78116abe231f4e8fa7f62e8764fb5857, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:25.354626 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff32265-9454-4d5c-a28c-4e7113e60786 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:25.360356 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 797/1605] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:25.361504 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb9439-12f4-4f86-9ce6-1bb0abcf7ab1 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:25.361792 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb9439-12f4-4f86-9ce6-1bb0abcf7ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:25.362136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb9439-12f4-4f86-9ce6-1bb0abcf7ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:25.381865 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 809/1606] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:04:25 2022] PUT /identity/v3/projects/d06dfb97c48740cfbc2f4bedc4e0bac0/users/78116abe231f4e8fa7f62e8764fb5857/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:25.383179 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c32ca5-f284-47c1-b758-b1cc7aa8747c None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:25.383468 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c32ca5-f284-47c1-b758-b1cc7aa8747c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:25.383739 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c32ca5-f284-47c1-b758-b1cc7aa8747c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:25.386565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-1ccb9439-12f4-4f86-9ce6-1bb0abcf7ab1 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:25.389133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-1ccb9439-12f4-4f86-9ce6-1bb0abcf7ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:25.415628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-b1c32ca5-f284-47c1-b758-b1cc7aa8747c None None] MFA Rules not processed for user `ec8b9371831a4ebab41ebcee9f2a6d12`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:25.416900 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b1c32ca5-f284-47c1-b758-b1cc7aa8747c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:25.446042 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:25.478656 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 798/1607] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:25.481522 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f553917-329e-41b2-9950-bc7399734fac None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:25.481816 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f553917-329e-41b2-9950-bc7399734fac None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:25.482102 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f553917-329e-41b2-9950-bc7399734fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:25.504355 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 810/1608] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:25.504355 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15095ba-3741-4fa0-8e2e-89145f2d2b83 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:25.504355 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15095ba-3741-4fa0-8e2e-89145f2d2b83 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:25.504355 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15095ba-3741-4fa0-8e2e-89145f2d2b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:25.527637 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-6f553917-329e-41b2-9950-bc7399734fac None None] MFA Rules not processed for user `e6b18be5761c4038b7db3e45da14a3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:25.529477 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-6f553917-329e-41b2-9950-bc7399734fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:25.530199 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f15095ba-3741-4fa0-8e2e-89145f2d2b83 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:25.532401 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f15095ba-3741-4fa0-8e2e-89145f2d2b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:25.559756 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 811/1609] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:25.562536 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15095ba-3741-4fa0-8e2e-89145f2d2b83 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:25.590556 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15095ba-3741-4fa0-8e2e-89145f2d2b83 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:25.601861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f15dc6-de45-46f4-bc3c-573571f682d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:25.602790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f15dc6-de45-46f4-bc3c-573571f682d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:25.603074 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f15dc6-de45-46f4-bc3c-573571f682d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:25.603353 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f15dc6-de45-46f4-bc3c-573571f682d0 admin admin] PATH_INFO: `/v3/projects/09126a8ed6374cbe81c35695d034c0e7/users/317e4a8a116f4fc1aea4487ed1515c05/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:25.648785 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f15dc6-de45-46f4-bc3c-573571f682d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09126a8ed6374cbe81c35695d034c0e7, user_id=317e4a8a116f4fc1aea4487ed1515c05, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:25.654666 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f15dc6-de45-46f4-bc3c-573571f682d0 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:25.674223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 799/1610] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:25 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:25.676608 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c1ab0-8bf5-4bdb-9f03-f913e1960310 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:25.679820 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c1ab0-8bf5-4bdb-9f03-f913e1960310 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:25.680174 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c1ab0-8bf5-4bdb-9f03-f913e1960310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:25.686703 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 812/1611] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:04:25 2022] PUT /identity/v3/projects/09126a8ed6374cbe81c35695d034c0e7/users/317e4a8a116f4fc1aea4487ed1515c05/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:25.687820 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f15dc6-de45-46f4-bc3c-573571f682d0 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:25.719526 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-6c6c1ab0-8bf5-4bdb-9f03-f913e1960310 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:25.724516 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-6c6c1ab0-8bf5-4bdb-9f03-f913e1960310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:25.799967 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f15dc6-de45-46f4-bc3c-573571f682d0 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:25.805905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6a80f-108f-4e18-92f5-4ffe48a31e93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:25.807269 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6a80f-108f-4e18-92f5-4ffe48a31e93 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:25.807770 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6a80f-108f-4e18-92f5-4ffe48a31e93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:25.808278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6a80f-108f-4e18-92f5-4ffe48a31e93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:25.888562 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 800/1612] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:25.889337 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c1ab0-8bf5-4bdb-9f03-f913e1960310 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:25.902715 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c1ab0-8bf5-4bdb-9f03-f913e1960310 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:25.908083 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85def577-48c2-4415-9438-4463a59b0676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:25.908968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85def577-48c2-4415-9438-4463a59b0676 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:25.909253 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85def577-48c2-4415-9438-4463a59b0676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:25.909523 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85def577-48c2-4415-9438-4463a59b0676 admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:25.910188 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85def577-48c2-4415-9438-4463a59b0676 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:25.913347 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85def577-48c2-4415-9438-4463a59b0676 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:25.923796 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a6a80f-108f-4e18-92f5-4ffe48a31e93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:25.925499 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a6a80f-108f-4e18-92f5-4ffe48a31e93 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:25.942767 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 813/1613] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:04:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:04:25.944548 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6a80f-108f-4e18-92f5-4ffe48a31e93 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:25.955571 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6a80f-108f-4e18-92f5-4ffe48a31e93 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:25.960596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9a3da-f57e-4424-a007-1c40d1e898cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:25.961883 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9a3da-f57e-4424-a007-1c40d1e898cc service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:25.962249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9a3da-f57e-4424-a007-1c40d1e898cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:25.962915 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9a3da-f57e-4424-a007-1c40d1e898cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:25.967440 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 801/1614] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:04:25 2022] POST /identity/v3/projects => generated 371 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:25.968464 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85def577-48c2-4415-9438-4463a59b0676 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:25.974458 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:25.980096 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9a3da-f57e-4424-a007-1c40d1e898cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:25.983389 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9a3da-f57e-4424-a007-1c40d1e898cc service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:25.997862 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 814/1615] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:04:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:04:25.999348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eaa674-cdd0-4a44-a47b-cdd5e92fe6b6 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:26.000189 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eaa674-cdd0-4a44-a47b-cdd5e92fe6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:26.000800 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eaa674-cdd0-4a44-a47b-cdd5e92fe6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:26.031095 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-e9eaa674-cdd0-4a44-a47b-cdd5e92fe6b6 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:26.034753 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e9eaa674-cdd0-4a44-a47b-cdd5e92fe6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:26.063503 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85def577-48c2-4415-9438-4463a59b0676 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:26.069876 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c35cfa-bfaa-4f70-b679-fe55a1664f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:26.071264 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c35cfa-bfaa-4f70-b679-fe55a1664f36 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:26.071623 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c35cfa-bfaa-4f70-b679-fe55a1664f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:26.072404 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c35cfa-bfaa-4f70-b679-fe55a1664f36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:26.073330 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c35cfa-bfaa-4f70-b679-fe55a1664f36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:26.075767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c35cfa-bfaa-4f70-b679-fe55a1664f36 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:26.102602 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:26.131827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 802/1616] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:04:25 2022] POST /identity/v3/projects => generated 365 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:26.132967 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c35cfa-bfaa-4f70-b679-fe55a1664f36 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:26.194432 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 815/1617] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:26.200170 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eaa674-cdd0-4a44-a47b-cdd5e92fe6b6 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:26.228269 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eaa674-cdd0-4a44-a47b-cdd5e92fe6b6 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:26.289114 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c35cfa-bfaa-4f70-b679-fe55a1664f36 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:26.302458 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ecfa3-6ee5-4ba2-9e89-4dd8e2d51695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:26.303818 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ecfa3-6ee5-4ba2-9e89-4dd8e2d51695 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:26.304351 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ecfa3-6ee5-4ba2-9e89-4dd8e2d51695 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:26.304843 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ecfa3-6ee5-4ba2-9e89-4dd8e2d51695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:26.371285 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08466a-9ac6-47d9-ae61-ae118690ba17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:26.371976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08466a-9ac6-47d9-ae61-ae118690ba17 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:26.372532 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08466a-9ac6-47d9-ae61-ae118690ba17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:26.374369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08466a-9ac6-47d9-ae61-ae118690ba17 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:26.375281 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08466a-9ac6-47d9-ae61-ae118690ba17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:26.378368 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08466a-9ac6-47d9-ae61-ae118690ba17 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:26.399935 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ecfa3-6ee5-4ba2-9e89-4dd8e2d51695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:26.403161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ecfa3-6ee5-4ba2-9e89-4dd8e2d51695 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:26.408671 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 816/1618] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:04:26 2022] POST /identity/v3/users => generated 292 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:26.413900 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08466a-9ac6-47d9-ae61-ae118690ba17 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:26.423070 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 803/1619] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:04:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:04:26.425177 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ecfa3-6ee5-4ba2-9e89-4dd8e2d51695 service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:26.432229 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08466a-9ac6-47d9-ae61-ae118690ba17 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:26.437723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ecfa3-6ee5-4ba2-9e89-4dd8e2d51695 service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:26.443278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd63f7-0de3-4869-aa53-566ba10d19a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:26.444739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd63f7-0de3-4869-aa53-566ba10d19a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:26.445689 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd63f7-0de3-4869-aa53-566ba10d19a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:26.446041 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd63f7-0de3-4869-aa53-566ba10d19a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:26.448022 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b7ca2-6375-4f3b-8690-efae578fdaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:26.450084 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b7ca2-6375-4f3b-8690-efae578fdaa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:26.451740 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b7ca2-6375-4f3b-8690-efae578fdaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:26.452712 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b7ca2-6375-4f3b-8690-efae578fdaa8 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:26.454692 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b7ca2-6375-4f3b-8690-efae578fdaa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:26.460684 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b7ca2-6375-4f3b-8690-efae578fdaa8 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:26.462155 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd63f7-0de3-4869-aa53-566ba10d19a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:26.464085 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd63f7-0de3-4869-aa53-566ba10d19a8 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:26.482147 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 804/1620] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:04:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:04:26.483483 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd63f7-0de3-4869-aa53-566ba10d19a8 service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:26.497931 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 817/1621] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:04:26 2022] POST /identity/v3/users => generated 289 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:26.498163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd63f7-0de3-4869-aa53-566ba10d19a8 service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:26.499755 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b7ca2-6375-4f3b-8690-efae578fdaa8 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:26.502907 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ab442-aed3-4f51-a231-f1b1a7709cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:26.503807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ab442-aed3-4f51-a231-f1b1a7709cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:26.504106 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ab442-aed3-4f51-a231-f1b1a7709cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:26.504379 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ab442-aed3-4f51-a231-f1b1a7709cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:26.506370 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ab442-aed3-4f51-a231-f1b1a7709cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:26.508212 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ab442-aed3-4f51-a231-f1b1a7709cb3 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:26.514273 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b7ca2-6375-4f3b-8690-efae578fdaa8 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:26.520527 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f036d6-ea1d-4eb3-9068-fd2f2affae14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:26.521425 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f036d6-ea1d-4eb3-9068-fd2f2affae14 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:26.521774 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f036d6-ea1d-4eb3-9068-fd2f2affae14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:26.522111 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f036d6-ea1d-4eb3-9068-fd2f2affae14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:26.523283 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f036d6-ea1d-4eb3-9068-fd2f2affae14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:26.525094 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f036d6-ea1d-4eb3-9068-fd2f2affae14 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:26.525578 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 805/1622] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:26.530593 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ab442-aed3-4f51-a231-f1b1a7709cb3 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:26.547435 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 818/1623] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:26.547712 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ab442-aed3-4f51-a231-f1b1a7709cb3 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:26.548715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f036d6-ea1d-4eb3-9068-fd2f2affae14 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:26.555789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528670b-47e6-494c-ae8c-fe937c512f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:26.556855 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528670b-47e6-494c-ae8c-fe937c512f7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:26.558207 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528670b-47e6-494c-ae8c-fe937c512f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:26.558697 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528670b-47e6-494c-ae8c-fe937c512f7c admin admin] PATH_INFO: `/v3/projects/3a068f590dcb4808adfe0379ae1fe19d/users/562bfc6fb9bd44e4bed8c870429cb4ab/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:26.568981 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f036d6-ea1d-4eb3-9068-fd2f2affae14 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:26.575251 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:26.575451 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c581b00-3c4f-46db-8c49-59c272bb4d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:26.576923 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c581b00-3c4f-46db-8c49-59c272bb4d98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:26.577212 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c581b00-3c4f-46db-8c49-59c272bb4d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:26.578477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c581b00-3c4f-46db-8c49-59c272bb4d98 admin admin] PATH_INFO: `/v3/projects/6529b72bef4d4f4d99070f47df42bf87/users/5aeb62eb7ad74324bded2a507b29f032/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:26.581499 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528670b-47e6-494c-ae8c-fe937c512f7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a068f590dcb4808adfe0379ae1fe19d, user_id=562bfc6fb9bd44e4bed8c870429cb4ab, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:26.589107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528670b-47e6-494c-ae8c-fe937c512f7c admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:26.601629 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c581b00-3c4f-46db-8c49-59c272bb4d98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6529b72bef4d4f4d99070f47df42bf87, user_id=5aeb62eb7ad74324bded2a507b29f032, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:26.604946 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c581b00-3c4f-46db-8c49-59c272bb4d98 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:26.614477 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 806/1624] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:04:26 2022] PUT /identity/v3/projects/3a068f590dcb4808adfe0379ae1fe19d/users/562bfc6fb9bd44e4bed8c870429cb4ab/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:26.619276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528670b-47e6-494c-ae8c-fe937c512f7c admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:26.628995 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 819/1625] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:04:26 2022] PUT /identity/v3/projects/6529b72bef4d4f4d99070f47df42bf87/users/5aeb62eb7ad74324bded2a507b29f032/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:26.631091 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c581b00-3c4f-46db-8c49-59c272bb4d98 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:26.749586 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c581b00-3c4f-46db-8c49-59c272bb4d98 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:26.753708 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528670b-47e6-494c-ae8c-fe937c512f7c admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:26.760041 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4aa9a-3805-41dc-81d5-737f6ca1646c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:26.760749 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4aa9a-3805-41dc-81d5-737f6ca1646c admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:26.761064 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4aa9a-3805-41dc-81d5-737f6ca1646c admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:26.761328 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4aa9a-3805-41dc-81d5-737f6ca1646c admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:26.763313 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4aa9a-3805-41dc-81d5-737f6ca1646c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:26.768082 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4aa9a-3805-41dc-81d5-737f6ca1646c admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:26.769424 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055f0de-1b57-42b5-9ab9-4014842d4063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:26.769564 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055f0de-1b57-42b5-9ab9-4014842d4063 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:26.769752 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055f0de-1b57-42b5-9ab9-4014842d4063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:26.770030 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055f0de-1b57-42b5-9ab9-4014842d4063 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:26.772774 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055f0de-1b57-42b5-9ab9-4014842d4063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:26.774602 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055f0de-1b57-42b5-9ab9-4014842d4063 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:26.791870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 820/1626] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:26.799146 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4aa9a-3805-41dc-81d5-737f6ca1646c admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:26.804229 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 807/1627] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:04:26.804724 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055f0de-1b57-42b5-9ab9-4014842d4063 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:26.823121 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:26.827139 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4aa9a-3805-41dc-81d5-737f6ca1646c admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:26.831836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055f0de-1b57-42b5-9ab9-4014842d4063 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:26.839139 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e62ff8-9d51-4a4b-9c16-8fb0bf9b57aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:26.842206 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e62ff8-9d51-4a4b-9c16-8fb0bf9b57aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:26.842517 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e62ff8-9d51-4a4b-9c16-8fb0bf9b57aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:26.842799 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e62ff8-9d51-4a4b-9c16-8fb0bf9b57aa admin admin] PATH_INFO: `/v3/projects/6529b72bef4d4f4d99070f47df42bf87/users/5aeb62eb7ad74324bded2a507b29f032/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:26.845886 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56158f-a0b4-4f02-8795-1277469220dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:26.846824 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56158f-a0b4-4f02-8795-1277469220dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:26.847104 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56158f-a0b4-4f02-8795-1277469220dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:26.847379 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56158f-a0b4-4f02-8795-1277469220dc admin admin] PATH_INFO: `/v3/projects/3a068f590dcb4808adfe0379ae1fe19d/users/562bfc6fb9bd44e4bed8c870429cb4ab/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:26.852704 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e62ff8-9d51-4a4b-9c16-8fb0bf9b57aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6529b72bef4d4f4d99070f47df42bf87, user_id=5aeb62eb7ad74324bded2a507b29f032, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:26.856001 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56158f-a0b4-4f02-8795-1277469220dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a068f590dcb4808adfe0379ae1fe19d, user_id=562bfc6fb9bd44e4bed8c870429cb4ab, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:26.859251 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e62ff8-9d51-4a4b-9c16-8fb0bf9b57aa admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:26.863332 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56158f-a0b4-4f02-8795-1277469220dc admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:26.894779 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 821/1628] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:04:26 2022] PUT /identity/v3/projects/6529b72bef4d4f4d99070f47df42bf87/users/5aeb62eb7ad74324bded2a507b29f032/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:26.895023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 808/1629] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:04:26 2022] PUT /identity/v3/projects/3a068f590dcb4808adfe0379ae1fe19d/users/562bfc6fb9bd44e4bed8c870429cb4ab/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:26.896911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbb06e-ec5a-4c5f-81ed-16dfedd14fb0 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:26.897286 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbb06e-ec5a-4c5f-81ed-16dfedd14fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:26.897723 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbb06e-ec5a-4c5f-81ed-16dfedd14fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:26.900141 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f57b50-f48c-49f4-bbf5-0ff1e7d54d25 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:26.901359 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f57b50-f48c-49f4-bbf5-0ff1e7d54d25 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:26.901650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f57b50-f48c-49f4-bbf5-0ff1e7d54d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:26.961479 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-b1bbb06e-ec5a-4c5f-81ed-16dfedd14fb0 None None] MFA Rules not processed for user `5aeb62eb7ad74324bded2a507b29f032`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:26.963660 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b1bbb06e-ec5a-4c5f-81ed-16dfedd14fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:26.979532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-b5f57b50-f48c-49f4-bbf5-0ff1e7d54d25 None None] MFA Rules not processed for user `562bfc6fb9bd44e4bed8c870429cb4ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:26.980792 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-b5f57b50-f48c-49f4-bbf5-0ff1e7d54d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:27.188977 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 809/1630] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:26 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:27.195751 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 822/1631] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:26 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:27.196630 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f57b50-f48c-49f4-bbf5-0ff1e7d54d25 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:27.196840 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bbb06e-ec5a-4c5f-81ed-16dfedd14fb0 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:27.323883 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f57b50-f48c-49f4-bbf5-0ff1e7d54d25 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:27.327927 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fa0ce-9331-4bb8-b1ba-0f5b937bf0eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:27.328517 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fa0ce-9331-4bb8-b1ba-0f5b937bf0eb service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:27.328805 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fa0ce-9331-4bb8-b1ba-0f5b937bf0eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:27.329084 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fa0ce-9331-4bb8-b1ba-0f5b937bf0eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:27.349587 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fa0ce-9331-4bb8-b1ba-0f5b937bf0eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:27.351202 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fa0ce-9331-4bb8-b1ba-0f5b937bf0eb service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:27.360979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bbb06e-ec5a-4c5f-81ed-16dfedd14fb0 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:27.364835 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:27.368672 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c0d1a-798d-48e8-b30d-e9ec11dc8c29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:27.369299 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c0d1a-798d-48e8-b30d-e9ec11dc8c29 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:27.369576 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c0d1a-798d-48e8-b30d-e9ec11dc8c29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:27.370283 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c0d1a-798d-48e8-b30d-e9ec11dc8c29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:27.372245 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 810/1632] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:04:27 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:04:27.384757 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c0d1a-798d-48e8-b30d-e9ec11dc8c29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:27.386755 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c0d1a-798d-48e8-b30d-e9ec11dc8c29 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:27.405668 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 823/1633] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:04:27 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:04:27.605608 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fa0ce-9331-4bb8-b1ba-0f5b937bf0eb service cinder] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:27.617340 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fa0ce-9331-4bb8-b1ba-0f5b937bf0eb service cinder] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:27.625263 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3c5bd-e30b-4c24-977a-dffb1108ecd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:27.629422 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3c5bd-e30b-4c24-977a-dffb1108ecd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:27.629890 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3c5bd-e30b-4c24-977a-dffb1108ecd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:27.630400 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3c5bd-e30b-4c24-977a-dffb1108ecd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:27.875699 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3c5bd-e30b-4c24-977a-dffb1108ecd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:27.877350 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3c5bd-e30b-4c24-977a-dffb1108ecd3 service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:27.902297 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 811/1634] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:04:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:04:28.491141 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c0d1a-798d-48e8-b30d-e9ec11dc8c29 service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:28.594669 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c0d1a-798d-48e8-b30d-e9ec11dc8c29 service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:28.601935 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f43a7-f38e-46c5-b813-df4df8fb9053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:28.602881 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f43a7-f38e-46c5-b813-df4df8fb9053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:28.603488 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f43a7-f38e-46c5-b813-df4df8fb9053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:28.605212 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f43a7-f38e-46c5-b813-df4df8fb9053 admin admin] PATH_INFO: `/v3/users/e6b18be5761c4038b7db3e45da14a3ba` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:28.606919 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f43a7-f38e-46c5-b813-df4df8fb9053 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6b18be5761c4038b7db3e45da14a3ba)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:28.609023 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f43a7-f38e-46c5-b813-df4df8fb9053 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:28.635510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:28.681728 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b53f43a7-f38e-46c5-b813-df4df8fb9053 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6b18be5761c4038b7db3e45da14a3ba'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:28.692700 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b53f43a7-f38e-46c5-b813-df4df8fb9053 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6b18be5761c4038b7db3e45da14a3ba'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:28.694736 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b53f43a7-f38e-46c5-b813-df4df8fb9053 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6b18be5761c4038b7db3e45da14a3ba'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:28.713748 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b53f43a7-f38e-46c5-b813-df4df8fb9053 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6b18be5761c4038b7db3e45da14a3ba'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:28.714696 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b53f43a7-f38e-46c5-b813-df4df8fb9053 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6b18be5761c4038b7db3e45da14a3ba'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:28.737782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 824/1635] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:04:28 2022] DELETE /identity/v3/users/e6b18be5761c4038b7db3e45da14a3ba => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:28.740162 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02358011-0c99-409a-b796-d76e81bbc7ea None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:28.740695 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02358011-0c99-409a-b796-d76e81bbc7ea None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:28.741157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02358011-0c99-409a-b796-d76e81bbc7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:28.799091 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-02358011-0c99-409a-b796-d76e81bbc7ea None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:28.800545 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-02358011-0c99-409a-b796-d76e81bbc7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:28.992517 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 812/1636] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:29.015118 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f43a7-f38e-46c5-b813-df4df8fb9053 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:29.016991 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b53f43a7-f38e-46c5-b813-df4df8fb9053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:29.180542 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f43a7-f38e-46c5-b813-df4df8fb9053 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:29.191860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2245f-a907-46ac-b88b-352ee455ffbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:29.194473 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2245f-a907-46ac-b88b-352ee455ffbe service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:29.194875 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2245f-a907-46ac-b88b-352ee455ffbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:29.195224 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2245f-a907-46ac-b88b-352ee455ffbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:29.207389 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2245f-a907-46ac-b88b-352ee455ffbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:29.209591 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2245f-a907-46ac-b88b-352ee455ffbe service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:29.243050 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 825/1637] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:04:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:04:29.542008 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c735633-8703-41d1-9561-bb2191aa864c None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:29.542692 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c735633-8703-41d1-9561-bb2191aa864c None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:29.542692 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c735633-8703-41d1-9561-bb2191aa864c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:29.614778 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-7c735633-8703-41d1-9561-bb2191aa864c None None] MFA Rules not processed for user `317e4a8a116f4fc1aea4487ed1515c05`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:29.616237 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-7c735633-8703-41d1-9561-bb2191aa864c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:29.836816 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 813/1638] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:29 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:29.840509 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2245f-a907-46ac-b88b-352ee455ffbe service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:29.843706 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-3bc2245f-a907-46ac-b88b-352ee455ffbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:29.862416 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2245f-a907-46ac-b88b-352ee455ffbe service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:29.871167 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0c677-d177-4a87-ad11-988b13455832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:29.872055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0c677-d177-4a87-ad11-988b13455832 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:29.872347 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0c677-d177-4a87-ad11-988b13455832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:29.872863 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0c677-d177-4a87-ad11-988b13455832 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:29.873820 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0c677-d177-4a87-ad11-988b13455832 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:29.876568 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0c677-d177-4a87-ad11-988b13455832 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:29.933337 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c735633-8703-41d1-9561-bb2191aa864c None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:29.934707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 826/1639] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:04:29 2022] POST /identity/v3/projects => generated 401 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:04:29.949903 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c735633-8703-41d1-9561-bb2191aa864c None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:30.012208 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:30.090357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e28b8-9fe6-4ce0-9b62-3bd370972239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:30.091466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e28b8-9fe6-4ce0-9b62-3bd370972239 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:30.092329 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e28b8-9fe6-4ce0-9b62-3bd370972239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:30.092787 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e28b8-9fe6-4ce0-9b62-3bd370972239 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:30.094181 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e28b8-9fe6-4ce0-9b62-3bd370972239 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:30.096956 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e28b8-9fe6-4ce0-9b62-3bd370972239 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:30.141549 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 814/1640] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:04:29 2022] POST /identity/v3/users => generated 307 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:30.143497 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0c677-d177-4a87-ad11-988b13455832 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:30.170954 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0c677-d177-4a87-ad11-988b13455832 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:30.192287 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b78659-445a-434c-9b3d-cc5abb572491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:30.194394 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b78659-445a-434c-9b3d-cc5abb572491 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:30.199027 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b78659-445a-434c-9b3d-cc5abb572491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:30.201853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b78659-445a-434c-9b3d-cc5abb572491 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:30.202780 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b78659-445a-434c-9b3d-cc5abb572491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:30.205157 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b78659-445a-434c-9b3d-cc5abb572491 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:30.236623 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 827/1641] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:30.243876 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e28b8-9fe6-4ce0-9b62-3bd370972239 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:30.259892 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e28b8-9fe6-4ce0-9b62-3bd370972239 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:30.273560 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3447ca-0412-4cbb-9e2e-318526b9e6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:30.274818 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3447ca-0412-4cbb-9e2e-318526b9e6e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:30.278085 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3447ca-0412-4cbb-9e2e-318526b9e6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:30.278538 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3447ca-0412-4cbb-9e2e-318526b9e6e3 admin admin] PATH_INFO: `/v3/projects/d0f9ea3f164048c2a59d9767af3f108d/users/f252e0bc55794f38a0e938839cb1e46e/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:30.320218 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3447ca-0412-4cbb-9e2e-318526b9e6e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0f9ea3f164048c2a59d9767af3f108d, user_id=f252e0bc55794f38a0e938839cb1e46e, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:30.330765 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3447ca-0412-4cbb-9e2e-318526b9e6e3 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:30.358085 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 815/1642] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:04:30 2022] PUT /identity/v3/projects/d0f9ea3f164048c2a59d9767af3f108d/users/f252e0bc55794f38a0e938839cb1e46e/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:30.362309 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b78659-445a-434c-9b3d-cc5abb572491 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:30.382193 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b78659-445a-434c-9b3d-cc5abb572491 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:30.570730 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ca652-9b7c-41d3-a342-069575db766c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:30.573225 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ca652-9b7c-41d3-a342-069575db766c admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:30.573654 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ca652-9b7c-41d3-a342-069575db766c admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:30.574080 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ca652-9b7c-41d3-a342-069575db766c admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:30.575035 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ca652-9b7c-41d3-a342-069575db766c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:30.577136 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ca652-9b7c-41d3-a342-069575db766c admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:30.598099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3447ca-0412-4cbb-9e2e-318526b9e6e3 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:30.600870 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-5a3447ca-0412-4cbb-9e2e-318526b9e6e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:30.632509 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3447ca-0412-4cbb-9e2e-318526b9e6e3 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:30.636190 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 828/1643] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:30.637187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ca652-9b7c-41d3-a342-069575db766c admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:30.638143 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b6883-bb2e-4b42-8823-6fb5f2342e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:30.639068 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b6883-bb2e-4b42-8823-6fb5f2342e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:30.639572 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b6883-bb2e-4b42-8823-6fb5f2342e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:30.640044 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b6883-bb2e-4b42-8823-6fb5f2342e14 admin admin] PATH_INFO: `/v3/projects/c9a812e588bd4416886b8c548c78e6cf` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:30.641481 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b6883-bb2e-4b42-8823-6fb5f2342e14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9a812e588bd4416886b8c548c78e6cf)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:30.644439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b6883-bb2e-4b42-8823-6fb5f2342e14 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:30.658861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:30.670487 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ca652-9b7c-41d3-a342-069575db766c admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:30.685557 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c81f84-5311-43c1-8067-085d5c2ee628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:30.686477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c81f84-5311-43c1-8067-085d5c2ee628 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:30.686818 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c81f84-5311-43c1-8067-085d5c2ee628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:30.687103 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c81f84-5311-43c1-8067-085d5c2ee628 admin admin] PATH_INFO: `/v3/projects/d0f9ea3f164048c2a59d9767af3f108d/users/f252e0bc55794f38a0e938839cb1e46e/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:30.689442 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c81f84-5311-43c1-8067-085d5c2ee628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0f9ea3f164048c2a59d9767af3f108d, user_id=f252e0bc55794f38a0e938839cb1e46e, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:30.695018 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c81f84-5311-43c1-8067-085d5c2ee628 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:30.727490 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 829/1644] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:04:30 2022] PUT /identity/v3/projects/d0f9ea3f164048c2a59d9767af3f108d/users/f252e0bc55794f38a0e938839cb1e46e/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:30.750059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-305b6883-bb2e-4b42-8823-6fb5f2342e14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9a812e588bd4416886b8c548c78e6cf', 'request_id': 'req-305b6883-bb2e-4b42-8823-6fb5f2342e14'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:30.769439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-305b6883-bb2e-4b42-8823-6fb5f2342e14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9a812e588bd4416886b8c548c78e6cf', 'request_id': 'req-305b6883-bb2e-4b42-8823-6fb5f2342e14'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:30.787971 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-305b6883-bb2e-4b42-8823-6fb5f2342e14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9a812e588bd4416886b8c548c78e6cf', 'request_id': 'req-305b6883-bb2e-4b42-8823-6fb5f2342e14'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:30.821731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-305b6883-bb2e-4b42-8823-6fb5f2342e14 admin admin] The token cache is being invalidate because project c9a812e588bd4416886b8c548c78e6cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:04:30.822731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-305b6883-bb2e-4b42-8823-6fb5f2342e14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:30.824065 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-305b6883-bb2e-4b42-8823-6fb5f2342e14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:30.829566 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 816/1645] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:04:30 2022] DELETE /identity/v3/projects/c9a812e588bd4416886b8c548c78e6cf => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:30.835002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c81f84-5311-43c1-8067-085d5c2ee628 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:30.836966 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-02c81f84-5311-43c1-8067-085d5c2ee628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:30.993559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c81f84-5311-43c1-8067-085d5c2ee628 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:31.084411 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea21d9-c958-4e07-a40e-27e70e916ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:31.085173 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea21d9-c958-4e07-a40e-27e70e916ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:31.085173 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea21d9-c958-4e07-a40e-27e70e916ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:31.087113 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea21d9-c958-4e07-a40e-27e70e916ce7 admin admin] PATH_INFO: `/v3/users/5aeb62eb7ad74324bded2a507b29f032` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:31.087277 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea21d9-c958-4e07-a40e-27e70e916ce7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aeb62eb7ad74324bded2a507b29f032)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:31.090150 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea21d9-c958-4e07-a40e-27e70e916ce7 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:31.165238 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e8ea21d9-c958-4e07-a40e-27e70e916ce7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aeb62eb7ad74324bded2a507b29f032'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:31.176427 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e8ea21d9-c958-4e07-a40e-27e70e916ce7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aeb62eb7ad74324bded2a507b29f032'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:31.178029 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e8ea21d9-c958-4e07-a40e-27e70e916ce7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aeb62eb7ad74324bded2a507b29f032'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:31.201011 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e8ea21d9-c958-4e07-a40e-27e70e916ce7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aeb62eb7ad74324bded2a507b29f032'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:31.201852 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e8ea21d9-c958-4e07-a40e-27e70e916ce7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aeb62eb7ad74324bded2a507b29f032'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:31.229734 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 830/1646] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:04:30 2022] DELETE /identity/v3/users/5aeb62eb7ad74324bded2a507b29f032 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:32.719426 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b6883-bb2e-4b42-8823-6fb5f2342e14 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:32.731504 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b6883-bb2e-4b42-8823-6fb5f2342e14 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:32.834873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5278af-dcd0-490e-82f6-8e11c4d6a01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:32.835717 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5278af-dcd0-490e-82f6-8e11c4d6a01c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:32.836061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5278af-dcd0-490e-82f6-8e11c4d6a01c admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:32.836396 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5278af-dcd0-490e-82f6-8e11c4d6a01c admin admin] PATH_INFO: `/v3/projects/6529b72bef4d4f4d99070f47df42bf87` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:32.840380 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5278af-dcd0-490e-82f6-8e11c4d6a01c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6529b72bef4d4f4d99070f47df42bf87)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:32.842855 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5278af-dcd0-490e-82f6-8e11c4d6a01c admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:32.876779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:32.923725 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-5a5278af-dcd0-490e-82f6-8e11c4d6a01c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6529b72bef4d4f4d99070f47df42bf87', 'request_id': 'req-5a5278af-dcd0-490e-82f6-8e11c4d6a01c'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:32.941446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-5a5278af-dcd0-490e-82f6-8e11c4d6a01c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6529b72bef4d4f4d99070f47df42bf87', 'request_id': 'req-5a5278af-dcd0-490e-82f6-8e11c4d6a01c'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:32.962928 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-5a5278af-dcd0-490e-82f6-8e11c4d6a01c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6529b72bef4d4f4d99070f47df42bf87', 'request_id': 'req-5a5278af-dcd0-490e-82f6-8e11c4d6a01c'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:32.986865 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-5a5278af-dcd0-490e-82f6-8e11c4d6a01c admin admin] The token cache is being invalidate because project 6529b72bef4d4f4d99070f47df42bf87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:04:32.987162 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-5a5278af-dcd0-490e-82f6-8e11c4d6a01c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:32.987919 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-5a5278af-dcd0-490e-82f6-8e11c4d6a01c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:32.995604 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 817/1647] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:04:32 2022] DELETE /identity/v3/projects/6529b72bef4d4f4d99070f47df42bf87 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:32.997076 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eadcb1-c62a-4c86-ae9f-678005d8f366 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:32.997549 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eadcb1-c62a-4c86-ae9f-678005d8f366 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:32.997624 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eadcb1-c62a-4c86-ae9f-678005d8f366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:33.033489 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-02eadcb1-c62a-4c86-ae9f-678005d8f366 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:33.035291 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-02eadcb1-c62a-4c86-ae9f-678005d8f366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:33.066236 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:33.173585 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 831/1648] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:04:33.176687 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8749ad-3598-461b-9b81-94415d36f3a5 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:33.177208 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8749ad-3598-461b-9b81-94415d36f3a5 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:33.177631 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8749ad-3598-461b-9b81-94415d36f3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:33.226408 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-eb8749ad-3598-461b-9b81-94415d36f3a5 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:33.228938 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-eb8749ad-3598-461b-9b81-94415d36f3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:33.243623 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 818/1649] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:33.244442 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eadcb1-c62a-4c86-ae9f-678005d8f366 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:33.262038 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eadcb1-c62a-4c86-ae9f-678005d8f366 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:33.272141 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67824b-3fbc-426d-96d8-6110b1ef61b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:33.272141 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67824b-3fbc-426d-96d8-6110b1ef61b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:33.272463 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67824b-3fbc-426d-96d8-6110b1ef61b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:33.272628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67824b-3fbc-426d-96d8-6110b1ef61b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:33.273328 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67824b-3fbc-426d-96d8-6110b1ef61b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:04:33.273646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67824b-3fbc-426d-96d8-6110b1ef61b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:33.275395 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67824b-3fbc-426d-96d8-6110b1ef61b9 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:33.309820 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 832/1650] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:04:33.313248 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8749ad-3598-461b-9b81-94415d36f3a5 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:33.326192 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8749ad-3598-461b-9b81-94415d36f3a5 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:33.335278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9db2df-bd64-49ad-8efc-612bf6f98c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:33.336243 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9db2df-bd64-49ad-8efc-612bf6f98c0e admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:33.336713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9db2df-bd64-49ad-8efc-612bf6f98c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:33.337331 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9db2df-bd64-49ad-8efc-612bf6f98c0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:33.338188 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9db2df-bd64-49ad-8efc-612bf6f98c0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:33.340797 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9db2df-bd64-49ad-8efc-612bf6f98c0e admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:33.425975 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 819/1651] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:04:33 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:33.426165 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67824b-3fbc-426d-96d8-6110b1ef61b9 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:33.440564 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67824b-3fbc-426d-96d8-6110b1ef61b9 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:33.651627 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c027a-76b3-4c55-a317-57e0c5d5553b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:33.653003 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c027a-76b3-4c55-a317-57e0c5d5553b admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:33.653333 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c027a-76b3-4c55-a317-57e0c5d5553b admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:33.653628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c027a-76b3-4c55-a317-57e0c5d5553b admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:33.655129 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c027a-76b3-4c55-a317-57e0c5d5553b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:33.671087 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c027a-76b3-4c55-a317-57e0c5d5553b admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:33.776170 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9db2df-bd64-49ad-8efc-612bf6f98c0e admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:33.795308 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 833/1652] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:04:33 2022] POST /identity/v3/users => generated 291 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:33.800520 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9db2df-bd64-49ad-8efc-612bf6f98c0e admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:33.811507 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d55e6-017b-49a7-bb35-dafecb6b3466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:33.812415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d55e6-017b-49a7-bb35-dafecb6b3466 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:33.813672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d55e6-017b-49a7-bb35-dafecb6b3466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:33.814116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d55e6-017b-49a7-bb35-dafecb6b3466 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:33.819672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d55e6-017b-49a7-bb35-dafecb6b3466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:33.831985 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d55e6-017b-49a7-bb35-dafecb6b3466 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:33.853123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c027a-76b3-4c55-a317-57e0c5d5553b admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:33.864052 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 820/1653] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:33.868321 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c027a-76b3-4c55-a317-57e0c5d5553b admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:33.874211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5f5e2-bc38-43b7-be30-ae4e897b6048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:33.875637 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5f5e2-bc38-43b7-be30-ae4e897b6048 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:33.876210 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5f5e2-bc38-43b7-be30-ae4e897b6048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:33.876789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5f5e2-bc38-43b7-be30-ae4e897b6048 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:33.877892 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5f5e2-bc38-43b7-be30-ae4e897b6048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:33.881968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5f5e2-bc38-43b7-be30-ae4e897b6048 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:33.938820 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 834/1654] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:33.939597 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d55e6-017b-49a7-bb35-dafecb6b3466 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:33.956746 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d55e6-017b-49a7-bb35-dafecb6b3466 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:33.972726 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d44710-acd4-4af1-bc34-373c89f51111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:33.973708 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d44710-acd4-4af1-bc34-373c89f51111 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:33.974127 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d44710-acd4-4af1-bc34-373c89f51111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:33.974519 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d44710-acd4-4af1-bc34-373c89f51111 admin admin] PATH_INFO: `/v3/projects/872a02027a524489879334ce66960dc7/users/eb64d70a1b4448ad86260b9e4cdae943/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:34.012290 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d44710-acd4-4af1-bc34-373c89f51111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=872a02027a524489879334ce66960dc7, user_id=eb64d70a1b4448ad86260b9e4cdae943, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:34.023439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d44710-acd4-4af1-bc34-373c89f51111 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:34.075621 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 821/1655] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:04:33 2022] PUT /identity/v3/projects/872a02027a524489879334ce66960dc7/users/eb64d70a1b4448ad86260b9e4cdae943/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:34.077720 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2c20b-7370-42d5-abbd-857f850a0107 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:34.078235 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2c20b-7370-42d5-abbd-857f850a0107 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:34.078332 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2c20b-7370-42d5-abbd-857f850a0107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:34.088887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016c6ed-9c53-465d-aa3c-f50f53de839e None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:34.089178 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016c6ed-9c53-465d-aa3c-f50f53de839e None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:34.089632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016c6ed-9c53-465d-aa3c-f50f53de839e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:34.158094 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-6016c6ed-9c53-465d-aa3c-f50f53de839e None None] MFA Rules not processed for user `eb64d70a1b4448ad86260b9e4cdae943`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:34.160576 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-6016c6ed-9c53-465d-aa3c-f50f53de839e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:34.176747 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-99f2c20b-7370-42d5-abbd-857f850a0107 None None] MFA Rules not processed for user `f252e0bc55794f38a0e938839cb1e46e`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:34.179310 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-99f2c20b-7370-42d5-abbd-857f850a0107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:34.354667 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 822/1656] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:04:34.358232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016c6ed-9c53-465d-aa3c-f50f53de839e None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:34.387867 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 835/1657] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:34 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:34.443635 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:34.504039 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016c6ed-9c53-465d-aa3c-f50f53de839e None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:34.524818 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4668a-94ab-4a27-9e75-fbc350ea75f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:34.525537 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4668a-94ab-4a27-9e75-fbc350ea75f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:34.525838 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4668a-94ab-4a27-9e75-fbc350ea75f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:34.526111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4668a-94ab-4a27-9e75-fbc350ea75f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:34.526837 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4668a-94ab-4a27-9e75-fbc350ea75f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:34.528887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4668a-94ab-4a27-9e75-fbc350ea75f1 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:34.623002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 823/1658] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:04:34 2022] POST /identity/v3/projects => generated 379 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:34.627554 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2c20b-7370-42d5-abbd-857f850a0107 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:34.645648 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2c20b-7370-42d5-abbd-857f850a0107 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:34.668202 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:34.795232 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cd35d-fe6b-409e-b951-287827bf1f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:34.795978 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cd35d-fe6b-409e-b951-287827bf1f78 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:34.796335 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cd35d-fe6b-409e-b951-287827bf1f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:34.796725 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cd35d-fe6b-409e-b951-287827bf1f78 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:34.797568 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410cd35d-fe6b-409e-b951-287827bf1f78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:34.800902 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410cd35d-fe6b-409e-b951-287827bf1f78 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:34.842180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 836/1659] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:04:34 2022] POST /identity/v3/users => generated 296 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:34.846566 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4668a-94ab-4a27-9e75-fbc350ea75f1 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:34.868517 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4668a-94ab-4a27-9e75-fbc350ea75f1 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:34.880908 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0570f-f588-4ab8-9aed-e0603f4d1d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:34.881549 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0570f-f588-4ab8-9aed-e0603f4d1d3c admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:34.881825 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0570f-f588-4ab8-9aed-e0603f4d1d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:34.882094 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0570f-f588-4ab8-9aed-e0603f4d1d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:34.882864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0570f-f588-4ab8-9aed-e0603f4d1d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:34.884483 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0570f-f588-4ab8-9aed-e0603f4d1d3c admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:34.904836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 824/1660] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:34.909291 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cd35d-fe6b-409e-b951-287827bf1f78 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:34.925150 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cd35d-fe6b-409e-b951-287827bf1f78 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:34.945244 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8fdeb-6e63-4c84-9206-c02ad0cc759d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:34.946170 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8fdeb-6e63-4c84-9206-c02ad0cc759d admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:34.946625 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8fdeb-6e63-4c84-9206-c02ad0cc759d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:34.947056 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8fdeb-6e63-4c84-9206-c02ad0cc759d admin admin] PATH_INFO: `/v3/projects/88307659451f473983c11b0b747fcae6/users/4c471494bea94741b9d82156075dd88d/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:34.977990 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8fdeb-6e63-4c84-9206-c02ad0cc759d admin admin] RBAC: Authorizing `identity:create_grant(project_id=88307659451f473983c11b0b747fcae6, user_id=4c471494bea94741b9d82156075dd88d, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:34.995036 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8fdeb-6e63-4c84-9206-c02ad0cc759d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:35.023330 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 837/1661] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:04:34 2022] PUT /identity/v3/projects/88307659451f473983c11b0b747fcae6/users/4c471494bea94741b9d82156075dd88d/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:35.024537 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0570f-f588-4ab8-9aed-e0603f4d1d3c admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:35.047195 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0570f-f588-4ab8-9aed-e0603f4d1d3c admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:35.218304 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c31b46-bc84-4ff9-9d02-538f48e9f536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:35.218996 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c31b46-bc84-4ff9-9d02-538f48e9f536 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:35.219279 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c31b46-bc84-4ff9-9d02-538f48e9f536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:35.219562 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c31b46-bc84-4ff9-9d02-538f48e9f536 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:35.220279 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c31b46-bc84-4ff9-9d02-538f48e9f536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:35.222214 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c31b46-bc84-4ff9-9d02-538f48e9f536 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:35.255324 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8fdeb-6e63-4c84-9206-c02ad0cc759d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:35.256033 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 825/1662] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:04:35.266852 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8fdeb-6e63-4c84-9206-c02ad0cc759d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:35.287145 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64facabf-b317-471d-84f7-7a5c2f1ede70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:35.287944 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64facabf-b317-471d-84f7-7a5c2f1ede70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:35.288226 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64facabf-b317-471d-84f7-7a5c2f1ede70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:35.288504 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64facabf-b317-471d-84f7-7a5c2f1ede70 admin admin] PATH_INFO: `/v3/projects/88307659451f473983c11b0b747fcae6/users/4c471494bea94741b9d82156075dd88d/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:35.292262 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64facabf-b317-471d-84f7-7a5c2f1ede70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88307659451f473983c11b0b747fcae6, user_id=4c471494bea94741b9d82156075dd88d, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:35.295200 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64facabf-b317-471d-84f7-7a5c2f1ede70 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:35.384940 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 838/1663] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:04:35 2022] PUT /identity/v3/projects/88307659451f473983c11b0b747fcae6/users/4c471494bea94741b9d82156075dd88d/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:04:35.403952 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88a2c7-1ec9-4470-9f64-3dd5c2eac49b None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:35.404288 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88a2c7-1ec9-4470-9f64-3dd5c2eac49b None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:35.404510 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88a2c7-1ec9-4470-9f64-3dd5c2eac49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:35.499949 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-ca88a2c7-1ec9-4470-9f64-3dd5c2eac49b None None] MFA Rules not processed for user `4c471494bea94741b9d82156075dd88d`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:35.501540 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-ca88a2c7-1ec9-4470-9f64-3dd5c2eac49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:35.686534 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 826/1664] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:35.709747 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64facabf-b317-471d-84f7-7a5c2f1ede70 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:35.712389 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-64facabf-b317-471d-84f7-7a5c2f1ede70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:35.897592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64facabf-b317-471d-84f7-7a5c2f1ede70 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:35.905066 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79a2fc-ad37-46fb-9b7b-2d763592693f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:35.906072 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79a2fc-ad37-46fb-9b7b-2d763592693f service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:35.906670 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79a2fc-ad37-46fb-9b7b-2d763592693f service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:35.907284 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79a2fc-ad37-46fb-9b7b-2d763592693f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:35.944633 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79a2fc-ad37-46fb-9b7b-2d763592693f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:35.952144 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79a2fc-ad37-46fb-9b7b-2d763592693f service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:36.031742 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 839/1665] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:04:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:04:36.631784 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88a2c7-1ec9-4470-9f64-3dd5c2eac49b None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:36.660620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88a2c7-1ec9-4470-9f64-3dd5c2eac49b None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:36.683797 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7760b53-efc8-4065-b494-4d1862bd21d2 tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c471494bea94741b9d82156075dd88d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88307659451f473983c11b0b747fcae6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:36.685398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7760b53-efc8-4065-b494-4d1862bd21d2 tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:36.686181 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7760b53-efc8-4065-b494-4d1862bd21d2 tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:36.688007 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7760b53-efc8-4065-b494-4d1862bd21d2 tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:36.691217 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7760b53-efc8-4065-b494-4d1862bd21d2 tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:04:36.694394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7760b53-efc8-4065-b494-4d1862bd21d2 tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:36.700758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7760b53-efc8-4065-b494-4d1862bd21d2 tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:36.791749 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 827/1666] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:04:36.793364 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79a2fc-ad37-46fb-9b7b-2d763592693f service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:36.816777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79a2fc-ad37-46fb-9b7b-2d763592693f service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:36.825815 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205a15d-fa24-4a6c-a780-08c6d13eac68 tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c471494bea94741b9d82156075dd88d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88307659451f473983c11b0b747fcae6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:36.829775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205a15d-fa24-4a6c-a780-08c6d13eac68 tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:36.830063 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205a15d-fa24-4a6c-a780-08c6d13eac68 tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:36.830438 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205a15d-fa24-4a6c-a780-08c6d13eac68 tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:36.831345 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205a15d-fa24-4a6c-a780-08c6d13eac68 tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:36.834621 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205a15d-fa24-4a6c-a780-08c6d13eac68 tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:36.872875 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 840/1667] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:04:36 2022] POST /identity/v3/projects => generated 350 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:36.877481 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7760b53-efc8-4065-b494-4d1862bd21d2 tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:36.894197 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7760b53-efc8-4065-b494-4d1862bd21d2 tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:36.919817 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:37.150419 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ba5a1-b324-4e65-af7e-cc10597baaa8 tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c471494bea94741b9d82156075dd88d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88307659451f473983c11b0b747fcae6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:37.152229 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ba5a1-b324-4e65-af7e-cc10597baaa8 tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:37.153044 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ba5a1-b324-4e65-af7e-cc10597baaa8 tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:37.153353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ba5a1-b324-4e65-af7e-cc10597baaa8 tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:37.154239 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ba5a1-b324-4e65-af7e-cc10597baaa8 tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:04:37.154628 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ba5a1-b324-4e65-af7e-cc10597baaa8 tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:37.157174 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ba5a1-b324-4e65-af7e-cc10597baaa8 tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:37.183642 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 828/1668] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:04:37.246009 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205a15d-fa24-4a6c-a780-08c6d13eac68 tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:37.286793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205a15d-fa24-4a6c-a780-08c6d13eac68 tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:37.298811 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d88664-ccbf-4b1b-b256-7be28e69920a tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c471494bea94741b9d82156075dd88d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88307659451f473983c11b0b747fcae6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:37.300201 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d88664-ccbf-4b1b-b256-7be28e69920a tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:37.300638 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d88664-ccbf-4b1b-b256-7be28e69920a tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:37.301093 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d88664-ccbf-4b1b-b256-7be28e69920a tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] PATH_INFO: `/v3/projects/d9c856db2a79435d884eb8fd219de37a` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:37.306645 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d88664-ccbf-4b1b-b256-7be28e69920a tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d9c856db2a79435d884eb8fd219de37a)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:37.309100 dv-cinder-797608-64-smb devstack@keystone.service[80152]: WARNING py.warnings [None req-15d88664-ccbf-4b1b-b256-7be28e69920a tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 09:04:37.309100 dv-cinder-797608-64-smb devstack@keystone.service[80152]: warnings.warn(msg) Jul 27 09:04:37.309100 dv-cinder-797608-64-smb devstack@keystone.service[80152]: Jul 27 09:04:37.313096 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d88664-ccbf-4b1b-b256-7be28e69920a tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:37.497718 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:37.539467 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-15d88664-ccbf-4b1b-b256-7be28e69920a tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9c856db2a79435d884eb8fd219de37a', 'request_id': 'req-15d88664-ccbf-4b1b-b256-7be28e69920a'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:37.573771 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-15d88664-ccbf-4b1b-b256-7be28e69920a tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9c856db2a79435d884eb8fd219de37a', 'request_id': 'req-15d88664-ccbf-4b1b-b256-7be28e69920a'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:37.603561 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-15d88664-ccbf-4b1b-b256-7be28e69920a tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9c856db2a79435d884eb8fd219de37a', 'request_id': 'req-15d88664-ccbf-4b1b-b256-7be28e69920a'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:37.638716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-15d88664-ccbf-4b1b-b256-7be28e69920a tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] The token cache is being invalidate because project d9c856db2a79435d884eb8fd219de37a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:04:37.639128 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-15d88664-ccbf-4b1b-b256-7be28e69920a tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:37.642139 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-15d88664-ccbf-4b1b-b256-7be28e69920a tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:37.648176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 841/1669] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:04:37 2022] DELETE /identity/v3/projects/d9c856db2a79435d884eb8fd219de37a => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:38.135325 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ba5a1-b324-4e65-af7e-cc10597baaa8 tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:38.137297 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-e93ba5a1-b324-4e65-af7e-cc10597baaa8 tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:38.297479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ba5a1-b324-4e65-af7e-cc10597baaa8 tempest-VolumeQuotaClassesTest-982246630 tempest-VolumeQuotaClassesTest-982246630-project-admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:38.379368 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6715931-9b57-4ce4-99b5-431c3aeade5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:38.381403 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6715931-9b57-4ce4-99b5-431c3aeade5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:38.381716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6715931-9b57-4ce4-99b5-431c3aeade5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:38.382005 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6715931-9b57-4ce4-99b5-431c3aeade5a admin admin] PATH_INFO: `/v3/users/eb64d70a1b4448ad86260b9e4cdae943` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:38.383982 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6715931-9b57-4ce4-99b5-431c3aeade5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb64d70a1b4448ad86260b9e4cdae943)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:38.385761 dv-cinder-797608-64-smb devstack@keystone.service[80153]: WARNING py.warnings [None req-e6715931-9b57-4ce4-99b5-431c3aeade5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 09:04:38.385761 dv-cinder-797608-64-smb devstack@keystone.service[80153]: warnings.warn(msg) Jul 27 09:04:38.385761 dv-cinder-797608-64-smb devstack@keystone.service[80153]: Jul 27 09:04:38.387174 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6715931-9b57-4ce4-99b5-431c3aeade5a admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:38.533046 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-e6715931-9b57-4ce4-99b5-431c3aeade5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb64d70a1b4448ad86260b9e4cdae943'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:38.534072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-e6715931-9b57-4ce4-99b5-431c3aeade5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb64d70a1b4448ad86260b9e4cdae943'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:38.535064 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-e6715931-9b57-4ce4-99b5-431c3aeade5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb64d70a1b4448ad86260b9e4cdae943'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:38.554565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-e6715931-9b57-4ce4-99b5-431c3aeade5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb64d70a1b4448ad86260b9e4cdae943'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:38.574074 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f77bd-9a73-4324-96f4-0382ddcf1a81 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:38.574594 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f77bd-9a73-4324-96f4-0382ddcf1a81 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:38.574668 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f77bd-9a73-4324-96f4-0382ddcf1a81 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:38.576057 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 842/1670] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 09:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 09:04:38.582767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:38.595292 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ec506-209f-4f2d-a503-3dfa937de977 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:38.595585 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ec506-209f-4f2d-a503-3dfa937de977 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:38.595865 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ec506-209f-4f2d-a503-3dfa937de977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:38.612963 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-e6715931-9b57-4ce4-99b5-431c3aeade5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb64d70a1b4448ad86260b9e4cdae943'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:38.639527 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-3b7ec506-209f-4f2d-a503-3dfa937de977 None None] MFA Rules not processed for user `3d69004d02f9426b86e07907a553e523`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:38.640988 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-3b7ec506-209f-4f2d-a503-3dfa937de977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:38.651645 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 829/1671] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:04:38 2022] DELETE /identity/v3/users/eb64d70a1b4448ad86260b9e4cdae943 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:38.654805 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a31d6-4ca4-437e-9daa-dc3cb702d97e None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:38.655109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a31d6-4ca4-437e-9daa-dc3cb702d97e None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:38.655387 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a31d6-4ca4-437e-9daa-dc3cb702d97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:38.704823 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-de7a31d6-4ca4-437e-9daa-dc3cb702d97e None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:38.707316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-de7a31d6-4ca4-437e-9daa-dc3cb702d97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:38.831328 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 843/1672] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 09:04:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:04:38.861866 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 830/1673] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:39.054574 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ec506-209f-4f2d-a503-3dfa937de977 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:39.057566 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-3b7ec506-209f-4f2d-a503-3dfa937de977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:39.065371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241d3bc-7401-4f2d-8931-65ed7aae2dfc None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:39.065665 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241d3bc-7401-4f2d-8931-65ed7aae2dfc None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:39.065941 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241d3bc-7401-4f2d-8931-65ed7aae2dfc None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:39.068171 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 831/1674] 10.222.0.65 () {54 vars in 961 bytes} [Wed Jul 27 09:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 09:04:39.073005 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd99c96-368b-4d40-8395-76c3ee7c7a8b None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:39.073433 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd99c96-368b-4d40-8395-76c3ee7c7a8b None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:39.073692 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd99c96-368b-4d40-8395-76c3ee7c7a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:39.116888 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-1bd99c96-368b-4d40-8395-76c3ee7c7a8b None None] MFA Rules not processed for user `3d69004d02f9426b86e07907a553e523`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:39.119589 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-1bd99c96-368b-4d40-8395-76c3ee7c7a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:39.143098 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 832/1675] 10.222.0.65 () {58 vars in 1058 bytes} [Wed Jul 27 09:04:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:04:39.154441 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd99c96-368b-4d40-8395-76c3ee7c7a8b None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:39.181375 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd99c96-368b-4d40-8395-76c3ee7c7a8b None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:39.199952 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb9148-64a0-4c04-97ef-e665ae7e8b6d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d69004d02f9426b86e07907a553e523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:39.200653 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb9148-64a0-4c04-97ef-e665ae7e8b6d service placement] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:39.201592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb9148-64a0-4c04-97ef-e665ae7e8b6d service placement] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:39.201967 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb9148-64a0-4c04-97ef-e665ae7e8b6d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:39.220609 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ec506-209f-4f2d-a503-3dfa937de977 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:39.231727 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cf4a5-827f-49ca-8a7b-d3fd29da38a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:39.232109 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cf4a5-827f-49ca-8a7b-d3fd29da38a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:39.232396 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cf4a5-827f-49ca-8a7b-d3fd29da38a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:39.232673 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cf4a5-827f-49ca-8a7b-d3fd29da38a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:39.232770 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb9148-64a0-4c04-97ef-e665ae7e8b6d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:39.237841 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb9148-64a0-4c04-97ef-e665ae7e8b6d service placement] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:39.259773 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673cf4a5-827f-49ca-8a7b-d3fd29da38a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:39.261447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673cf4a5-827f-49ca-8a7b-d3fd29da38a4 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:39.266120 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 833/1676] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:04:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:04:39.287890 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 844/1677] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:04:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:04:42.305918 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb9148-64a0-4c04-97ef-e665ae7e8b6d service placement] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:42.316340 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-57bb9148-64a0-4c04-97ef-e665ae7e8b6d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:42.343936 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb9148-64a0-4c04-97ef-e665ae7e8b6d service placement] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:42.353975 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c786b6-8e69-4441-aad9-742868be67aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:42.354943 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c786b6-8e69-4441-aad9-742868be67aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:42.355355 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c786b6-8e69-4441-aad9-742868be67aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:42.355817 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c786b6-8e69-4441-aad9-742868be67aa admin admin] PATH_INFO: `/v3/projects/872a02027a524489879334ce66960dc7` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:42.360591 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c786b6-8e69-4441-aad9-742868be67aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=872a02027a524489879334ce66960dc7)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:42.364422 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c786b6-8e69-4441-aad9-742868be67aa admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:42.493325 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-e9c786b6-8e69-4441-aad9-742868be67aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '872a02027a524489879334ce66960dc7', 'request_id': 'req-e9c786b6-8e69-4441-aad9-742868be67aa'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:42.509436 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-e9c786b6-8e69-4441-aad9-742868be67aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '872a02027a524489879334ce66960dc7', 'request_id': 'req-e9c786b6-8e69-4441-aad9-742868be67aa'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:42.526269 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-e9c786b6-8e69-4441-aad9-742868be67aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '872a02027a524489879334ce66960dc7', 'request_id': 'req-e9c786b6-8e69-4441-aad9-742868be67aa'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:42.554048 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-e9c786b6-8e69-4441-aad9-742868be67aa admin admin] The token cache is being invalidate because project 872a02027a524489879334ce66960dc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:04:42.554373 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-e9c786b6-8e69-4441-aad9-742868be67aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:42.557716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-e9c786b6-8e69-4441-aad9-742868be67aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:42.576314 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 834/1678] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:04:42 2022] DELETE /identity/v3/projects/872a02027a524489879334ce66960dc7 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:42.576955 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cf4a5-827f-49ca-8a7b-d3fd29da38a4 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:42.591565 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cf4a5-827f-49ca-8a7b-d3fd29da38a4 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:42.764431 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff95548-7d98-4374-b769-04e4d9d020f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:42.765232 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff95548-7d98-4374-b769-04e4d9d020f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:42.765590 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff95548-7d98-4374-b769-04e4d9d020f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:42.766239 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff95548-7d98-4374-b769-04e4d9d020f3 admin admin] PATH_INFO: `/v3/users/4c471494bea94741b9d82156075dd88d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:42.767639 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff95548-7d98-4374-b769-04e4d9d020f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c471494bea94741b9d82156075dd88d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:42.769724 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff95548-7d98-4374-b769-04e4d9d020f3 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:42.776265 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:42.870028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-1ff95548-7d98-4374-b769-04e4d9d020f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c471494bea94741b9d82156075dd88d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:42.897591 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-1ff95548-7d98-4374-b769-04e4d9d020f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c471494bea94741b9d82156075dd88d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:42.899087 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-1ff95548-7d98-4374-b769-04e4d9d020f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c471494bea94741b9d82156075dd88d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:42.946162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-1ff95548-7d98-4374-b769-04e4d9d020f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c471494bea94741b9d82156075dd88d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:42.947409 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-1ff95548-7d98-4374-b769-04e4d9d020f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c471494bea94741b9d82156075dd88d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:43.013881 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 845/1679] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:04:42 2022] DELETE /identity/v3/users/4c471494bea94741b9d82156075dd88d => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:04:43.134495 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c786b6-8e69-4441-aad9-742868be67aa admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:43.139595 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-e9c786b6-8e69-4441-aad9-742868be67aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:43.166049 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c786b6-8e69-4441-aad9-742868be67aa admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:43.315050 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:43.356074 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a8877-7ceb-43c3-86eb-93485dfa7827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:43.357188 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a8877-7ceb-43c3-86eb-93485dfa7827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:43.357615 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a8877-7ceb-43c3-86eb-93485dfa7827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:43.358500 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a8877-7ceb-43c3-86eb-93485dfa7827 admin admin] PATH_INFO: `/v3/users/317e4a8a116f4fc1aea4487ed1515c05` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:43.363494 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a8877-7ceb-43c3-86eb-93485dfa7827 admin admin] RBAC: Authorizing `identity:delete_user(user_id=317e4a8a116f4fc1aea4487ed1515c05)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:43.366971 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a8877-7ceb-43c3-86eb-93485dfa7827 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:43.469908 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-661a8877-7ceb-43c3-86eb-93485dfa7827 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '317e4a8a116f4fc1aea4487ed1515c05'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:43.471044 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-661a8877-7ceb-43c3-86eb-93485dfa7827 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '317e4a8a116f4fc1aea4487ed1515c05'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:43.471828 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-661a8877-7ceb-43c3-86eb-93485dfa7827 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '317e4a8a116f4fc1aea4487ed1515c05'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:43.485243 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-661a8877-7ceb-43c3-86eb-93485dfa7827 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '317e4a8a116f4fc1aea4487ed1515c05'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:43.521461 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-661a8877-7ceb-43c3-86eb-93485dfa7827 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '317e4a8a116f4fc1aea4487ed1515c05'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:43.547136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 835/1680] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:04:43 2022] DELETE /identity/v3/users/317e4a8a116f4fc1aea4487ed1515c05 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:44.462221 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218e174-02bb-49cc-a455-75c8d414cada None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:44.463157 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218e174-02bb-49cc-a455-75c8d414cada None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:44.463579 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218e174-02bb-49cc-a455-75c8d414cada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:44.504663 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-8218e174-02bb-49cc-a455-75c8d414cada None None] MFA Rules not processed for user `1d586ea72a1a4865941b30fa77103a52`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:44.514548 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-8218e174-02bb-49cc-a455-75c8d414cada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:44.745109 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 846/1681] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:44.809398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7a445-ce6a-4083-a795-a53afb067cc8 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:44.812272 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7a445-ce6a-4083-a795-a53afb067cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:44.812800 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7a445-ce6a-4083-a795-a53afb067cc8 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:44.814663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 836/1682] 10.222.0.65 () {54 vars in 962 bytes} [Wed Jul 27 09:04:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 09:04:44.863882 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24592c46-4c54-44a4-bf87-b11d31100b54 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:44.864109 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24592c46-4c54-44a4-bf87-b11d31100b54 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:44.865291 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24592c46-4c54-44a4-bf87-b11d31100b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:44.980693 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-24592c46-4c54-44a4-bf87-b11d31100b54 None None] MFA Rules not processed for user `c30bc55c6a1348bb961f0d010422da87`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:44.983438 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-24592c46-4c54-44a4-bf87-b11d31100b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:45.106602 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fc919-bcfe-4421-a7df-578deae98ef0 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:45.108204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fc919-bcfe-4421-a7df-578deae98ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:45.108986 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fc919-bcfe-4421-a7df-578deae98ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:45.168286 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:45.198934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-754fc919-bcfe-4421-a7df-578deae98ef0 None None] MFA Rules not processed for user `5f1dfc498c1f4ccfa214d8c4777a2b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:45.201811 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-754fc919-bcfe-4421-a7df-578deae98ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:45.204466 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 847/1683] 10.222.0.65 () {58 vars in 1059 bytes} [Wed Jul 27 09:04:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:45.212758 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24592c46-4c54-44a4-bf87-b11d31100b54 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:45.240790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24592c46-4c54-44a4-bf87-b11d31100b54 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:45.258164 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d4aab-57cf-4ac5-903b-c6da0bed8698 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:45.259071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d4aab-57cf-4ac5-903b-c6da0bed8698 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:45.259287 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d4aab-57cf-4ac5-903b-c6da0bed8698 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:45.259643 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d4aab-57cf-4ac5-903b-c6da0bed8698 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:45.287949 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d4aab-57cf-4ac5-903b-c6da0bed8698 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:45.291980 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d4aab-57cf-4ac5-903b-c6da0bed8698 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:45.328445 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 848/1684] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:04:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:04:45.331022 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d4aab-57cf-4ac5-903b-c6da0bed8698 service nova] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:45.336030 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b94d4aab-57cf-4ac5-903b-c6da0bed8698 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:45.417424 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 837/1685] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:45.427822 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fc919-bcfe-4421-a7df-578deae98ef0 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:45.429334 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-754fc919-bcfe-4421-a7df-578deae98ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:45.545152 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d4aab-57cf-4ac5-903b-c6da0bed8698 service nova] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:45.561961 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf3104-aa0d-4d85-a79a-5f3f39736385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:45.563114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf3104-aa0d-4d85-a79a-5f3f39736385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:45.563114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf3104-aa0d-4d85-a79a-5f3f39736385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:45.564517 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf3104-aa0d-4d85-a79a-5f3f39736385 admin admin] PATH_INFO: `/v3/projects/09126a8ed6374cbe81c35695d034c0e7` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:45.565672 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf3104-aa0d-4d85-a79a-5f3f39736385 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09126a8ed6374cbe81c35695d034c0e7)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:45.570558 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:45.573528 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf3104-aa0d-4d85-a79a-5f3f39736385 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:45.618991 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fc919-bcfe-4421-a7df-578deae98ef0 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:45.631024 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6df3c6-60f6-4de8-8fa8-39039550e0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:45.631768 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6df3c6-60f6-4de8-8fa8-39039550e0a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:45.632157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6df3c6-60f6-4de8-8fa8-39039550e0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:45.632316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6df3c6-60f6-4de8-8fa8-39039550e0a8 admin admin] PATH_INFO: `/v3/projects/88307659451f473983c11b0b747fcae6` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:45.638389 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6df3c6-60f6-4de8-8fa8-39039550e0a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88307659451f473983c11b0b747fcae6)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:45.640354 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6df3c6-60f6-4de8-8fa8-39039550e0a8 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:45.723363 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-46cf3104-aa0d-4d85-a79a-5f3f39736385 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09126a8ed6374cbe81c35695d034c0e7', 'request_id': 'req-46cf3104-aa0d-4d85-a79a-5f3f39736385'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:45.731901 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-46cf3104-aa0d-4d85-a79a-5f3f39736385 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09126a8ed6374cbe81c35695d034c0e7', 'request_id': 'req-46cf3104-aa0d-4d85-a79a-5f3f39736385'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:45.747518 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-46cf3104-aa0d-4d85-a79a-5f3f39736385 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09126a8ed6374cbe81c35695d034c0e7', 'request_id': 'req-46cf3104-aa0d-4d85-a79a-5f3f39736385'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:45.774534 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-46cf3104-aa0d-4d85-a79a-5f3f39736385 admin admin] The token cache is being invalidate because project 09126a8ed6374cbe81c35695d034c0e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:04:45.774896 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-46cf3104-aa0d-4d85-a79a-5f3f39736385 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:45.775743 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-ac6df3c6-60f6-4de8-8fa8-39039550e0a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88307659451f473983c11b0b747fcae6', 'request_id': 'req-ac6df3c6-60f6-4de8-8fa8-39039550e0a8'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:45.780596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-46cf3104-aa0d-4d85-a79a-5f3f39736385 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:45.788536 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 849/1686] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:04:45 2022] DELETE /identity/v3/projects/09126a8ed6374cbe81c35695d034c0e7 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:45.790276 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d77be1-399f-4a22-a26c-cd4fdcae1b3f None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:45.790563 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d77be1-399f-4a22-a26c-cd4fdcae1b3f None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:45.790906 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d77be1-399f-4a22-a26c-cd4fdcae1b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:45.797402 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-ac6df3c6-60f6-4de8-8fa8-39039550e0a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88307659451f473983c11b0b747fcae6', 'request_id': 'req-ac6df3c6-60f6-4de8-8fa8-39039550e0a8'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:45.809718 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-ac6df3c6-60f6-4de8-8fa8-39039550e0a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88307659451f473983c11b0b747fcae6', 'request_id': 'req-ac6df3c6-60f6-4de8-8fa8-39039550e0a8'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:45.837629 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-ac6df3c6-60f6-4de8-8fa8-39039550e0a8 admin admin] The token cache is being invalidate because project 88307659451f473983c11b0b747fcae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:04:45.838664 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-ac6df3c6-60f6-4de8-8fa8-39039550e0a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:45.841204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-ac6df3c6-60f6-4de8-8fa8-39039550e0a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:45.843968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 838/1687] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:04:45 2022] DELETE /identity/v3/projects/88307659451f473983c11b0b747fcae6 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:45.850738 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6df3c6-60f6-4de8-8fa8-39039550e0a8 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:45.852296 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-ac6df3c6-60f6-4de8-8fa8-39039550e0a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:45.859754 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-44d77be1-399f-4a22-a26c-cd4fdcae1b3f None None] MFA Rules not processed for user `5f1dfc498c1f4ccfa214d8c4777a2b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:45.861047 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-44d77be1-399f-4a22-a26c-cd4fdcae1b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:45.930110 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 850/1688] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:45.931444 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bab40d-f152-47d8-9323-67589f55c9e4 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:45.931790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bab40d-f152-47d8-9323-67589f55c9e4 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:45.932334 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bab40d-f152-47d8-9323-67589f55c9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:45.956191 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f1bab40d-f152-47d8-9323-67589f55c9e4 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:45.957410 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f1bab40d-f152-47d8-9323-67589f55c9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:45.968943 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 851/1689] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:45.970311 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3d803-a349-4b41-ac99-7f3514a6f826 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:45.970311 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3d803-a349-4b41-ac99-7f3514a6f826 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:45.970903 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3d803-a349-4b41-ac99-7f3514a6f826 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:45.972418 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 852/1690] 10.222.0.65 () {54 vars in 962 bytes} [Wed Jul 27 09:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 09:04:45.973757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6df3c6-60f6-4de8-8fa8-39039550e0a8 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:45.979233 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631768b-d2be-4112-af2d-cbb38dc81e07 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:45.979523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631768b-d2be-4112-af2d-cbb38dc81e07 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:45.979964 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631768b-d2be-4112-af2d-cbb38dc81e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:45.988301 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efba300-4c8b-4e9b-9f04-278b8285fd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:45.989696 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efba300-4c8b-4e9b-9f04-278b8285fd70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:45.990872 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efba300-4c8b-4e9b-9f04-278b8285fd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:45.991937 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efba300-4c8b-4e9b-9f04-278b8285fd70 admin admin] PATH_INFO: `/v3/users/f252e0bc55794f38a0e938839cb1e46e` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:45.993620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efba300-4c8b-4e9b-9f04-278b8285fd70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f252e0bc55794f38a0e938839cb1e46e)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:45.996298 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efba300-4c8b-4e9b-9f04-278b8285fd70 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:46.009896 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:46.024678 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-b631768b-d2be-4112-af2d-cbb38dc81e07 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:46.028071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b631768b-d2be-4112-af2d-cbb38dc81e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:46.042286 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 853/1691] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:46.044588 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e74a37-d879-4f14-acc8-5917497d5e88 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:46.045049 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e74a37-d879-4f14-acc8-5917497d5e88 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:46.045587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e74a37-d879-4f14-acc8-5917497d5e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:46.086386 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-50e74a37-d879-4f14-acc8-5917497d5e88 None None] MFA Rules not processed for user `c30bc55c6a1348bb961f0d010422da87`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:46.087835 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-50e74a37-d879-4f14-acc8-5917497d5e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:46.104895 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-2efba300-4c8b-4e9b-9f04-278b8285fd70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f252e0bc55794f38a0e938839cb1e46e'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:46.106602 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-2efba300-4c8b-4e9b-9f04-278b8285fd70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f252e0bc55794f38a0e938839cb1e46e'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:46.108248 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-2efba300-4c8b-4e9b-9f04-278b8285fd70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f252e0bc55794f38a0e938839cb1e46e'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:46.124955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-2efba300-4c8b-4e9b-9f04-278b8285fd70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f252e0bc55794f38a0e938839cb1e46e'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:46.142084 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-2efba300-4c8b-4e9b-9f04-278b8285fd70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f252e0bc55794f38a0e938839cb1e46e'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:46.152339 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:46.170180 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 839/1692] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:04:45 2022] DELETE /identity/v3/users/f252e0bc55794f38a0e938839cb1e46e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:46.171625 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efba300-4c8b-4e9b-9f04-278b8285fd70 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:46.176919 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-2efba300-4c8b-4e9b-9f04-278b8285fd70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:46.226813 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 854/1693] 10.222.0.65 () {58 vars in 1059 bytes} [Wed Jul 27 09:04:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:46.245011 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e74a37-d879-4f14-acc8-5917497d5e88 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:46.266637 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e74a37-d879-4f14-acc8-5917497d5e88 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:46.317431 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efba300-4c8b-4e9b-9f04-278b8285fd70 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:46.330106 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f74075-567e-4830-9c11-8c096f10577d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:46.330809 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f74075-567e-4830-9c11-8c096f10577d admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:46.331075 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f74075-567e-4830-9c11-8c096f10577d admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:46.331377 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f74075-567e-4830-9c11-8c096f10577d admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:46.332105 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f74075-567e-4830-9c11-8c096f10577d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:04:46.332392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f74075-567e-4830-9c11-8c096f10577d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:46.338205 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f74075-567e-4830-9c11-8c096f10577d admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:46.363642 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d4237-64d4-4e27-acc7-842aa0499a17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:46.364291 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d4237-64d4-4e27-acc7-842aa0499a17 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:46.365090 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d4237-64d4-4e27-acc7-842aa0499a17 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:46.365572 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d4237-64d4-4e27-acc7-842aa0499a17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:46.373239 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 840/1694] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:04:46.374712 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3beee52-3862-4a19-9f36-27f8b686554e None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:46.375007 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3beee52-3862-4a19-9f36-27f8b686554e None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:46.375290 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3beee52-3862-4a19-9f36-27f8b686554e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:46.381492 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ae8d4237-64d4-4e27-acc7-842aa0499a17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:46.448332 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-b3beee52-3862-4a19-9f36-27f8b686554e None None] MFA Rules not processed for user `ae3fe5b4d9344c3bb7ae21b030377313`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:46.450748 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-b3beee52-3862-4a19-9f36-27f8b686554e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:46.527886 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d4237-64d4-4e27-acc7-842aa0499a17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:46.558626 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d4237-64d4-4e27-acc7-842aa0499a17 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:46.589663 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 855/1695] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:04:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:04:46.591470 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d4237-64d4-4e27-acc7-842aa0499a17 service nova] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:46.639384 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d4237-64d4-4e27-acc7-842aa0499a17 service nova] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:46.658417 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff1d0a-c5dd-4bd1-aba2-4d0b26dc8d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:46.659064 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff1d0a-c5dd-4bd1-aba2-4d0b26dc8d3c admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:46.659348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff1d0a-c5dd-4bd1-aba2-4d0b26dc8d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:46.659626 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff1d0a-c5dd-4bd1-aba2-4d0b26dc8d3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:46.660301 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff1d0a-c5dd-4bd1-aba2-4d0b26dc8d3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:46.662289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff1d0a-c5dd-4bd1-aba2-4d0b26dc8d3c admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:46.688255 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 841/1696] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:46.688255 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227b5d9-4c83-4b3e-967a-44091cd1b0b4 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:46.688255 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227b5d9-4c83-4b3e-967a-44091cd1b0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:46.688255 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227b5d9-4c83-4b3e-967a-44091cd1b0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:46.756109 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 856/1697] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:04:46 2022] POST /identity/v3/projects => generated 389 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:46.770687 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff1d0a-c5dd-4bd1-aba2-4d0b26dc8d3c admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:46.779913 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e7ff1d0a-c5dd-4bd1-aba2-4d0b26dc8d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:46.784352 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-3227b5d9-4c83-4b3e-967a-44091cd1b0b4 None None] MFA Rules not processed for user `f67b7dc78caf4da490739ff96f436764`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:46.785558 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-3227b5d9-4c83-4b3e-967a-44091cd1b0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:46.807180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:46.986692 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 842/1698] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:46.987654 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227b5d9-4c83-4b3e-967a-44091cd1b0b4 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:47.027792 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:47.132578 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff1d0a-c5dd-4bd1-aba2-4d0b26dc8d3c admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:47.155108 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcddb20-de92-431d-8b3a-7e022d45f482 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:47.155760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcddb20-de92-431d-8b3a-7e022d45f482 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:47.157655 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcddb20-de92-431d-8b3a-7e022d45f482 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:47.157944 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcddb20-de92-431d-8b3a-7e022d45f482 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:47.168352 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227b5d9-4c83-4b3e-967a-44091cd1b0b4 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:47.185107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ace617-5aac-4e1d-b018-2e6ea429f346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:47.185771 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ace617-5aac-4e1d-b018-2e6ea429f346 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:47.186061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ace617-5aac-4e1d-b018-2e6ea429f346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:47.186361 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ace617-5aac-4e1d-b018-2e6ea429f346 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:47.187060 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ace617-5aac-4e1d-b018-2e6ea429f346 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:47.201473 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ace617-5aac-4e1d-b018-2e6ea429f346 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:47.259494 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 843/1699] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:04:46 2022] POST /identity/v3/users => generated 295 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:47.260666 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ace617-5aac-4e1d-b018-2e6ea429f346 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:47.266916 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-14ace617-5aac-4e1d-b018-2e6ea429f346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:47.281196 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ace617-5aac-4e1d-b018-2e6ea429f346 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:47.286236 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804985b7-d3fd-45a0-af73-106c1d961edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:47.286951 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804985b7-d3fd-45a0-af73-106c1d961edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:47.287268 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804985b7-d3fd-45a0-af73-106c1d961edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:47.288240 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804985b7-d3fd-45a0-af73-106c1d961edb admin admin] PATH_INFO: `/v3/projects/d0f9ea3f164048c2a59d9767af3f108d` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:47.289551 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804985b7-d3fd-45a0-af73-106c1d961edb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0f9ea3f164048c2a59d9767af3f108d)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:47.293173 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804985b7-d3fd-45a0-af73-106c1d961edb admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:47.363765 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcddb20-de92-431d-8b3a-7e022d45f482 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:47.369263 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcddb20-de92-431d-8b3a-7e022d45f482 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:47.418938 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-804985b7-d3fd-45a0-af73-106c1d961edb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0f9ea3f164048c2a59d9767af3f108d', 'request_id': 'req-804985b7-d3fd-45a0-af73-106c1d961edb'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:47.419714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 857/1700] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:04:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:04:47.422936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcddb20-de92-431d-8b3a-7e022d45f482 service nova] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:47.432820 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-804985b7-d3fd-45a0-af73-106c1d961edb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0f9ea3f164048c2a59d9767af3f108d', 'request_id': 'req-804985b7-d3fd-45a0-af73-106c1d961edb'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:47.449240 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-804985b7-d3fd-45a0-af73-106c1d961edb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0f9ea3f164048c2a59d9767af3f108d', 'request_id': 'req-804985b7-d3fd-45a0-af73-106c1d961edb'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:47.470281 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcddb20-de92-431d-8b3a-7e022d45f482 service nova] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:47.480641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-804985b7-d3fd-45a0-af73-106c1d961edb admin admin] The token cache is being invalidate because project d0f9ea3f164048c2a59d9767af3f108d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:04:47.480947 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-804985b7-d3fd-45a0-af73-106c1d961edb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:47.482135 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-804985b7-d3fd-45a0-af73-106c1d961edb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:47.493199 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 844/1701] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:04:47 2022] DELETE /identity/v3/projects/d0f9ea3f164048c2a59d9767af3f108d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:47.500302 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e88cb9-498c-4089-962d-de4bda71b331 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:47.500736 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e88cb9-498c-4089-962d-de4bda71b331 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:47.501098 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e88cb9-498c-4089-962d-de4bda71b331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:47.566307 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-76e88cb9-498c-4089-962d-de4bda71b331 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:47.567589 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-76e88cb9-498c-4089-962d-de4bda71b331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:47.663280 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733b25c-e622-4991-abf3-cade12ce9dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:47.663990 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733b25c-e622-4991-abf3-cade12ce9dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:47.664207 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733b25c-e622-4991-abf3-cade12ce9dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:47.664480 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733b25c-e622-4991-abf3-cade12ce9dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:47.665196 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d733b25c-e622-4991-abf3-cade12ce9dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:47.670378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d733b25c-e622-4991-abf3-cade12ce9dd4 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:47.699400 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 858/1702] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:47.703166 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe053bea-e557-4a65-8b67-5d2f42f1992c None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:47.705684 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe053bea-e557-4a65-8b67-5d2f42f1992c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:47.706187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe053bea-e557-4a65-8b67-5d2f42f1992c None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:47.711375 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 859/1703] 10.222.0.65 () {54 vars in 912 bytes} [Wed Jul 27 09:04:47 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 09:04:47.712646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe053bea-e557-4a65-8b67-5d2f42f1992c None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:47.729903 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fe053bea-e557-4a65-8b67-5d2f42f1992c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:47.775352 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 845/1704] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:47.776797 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e88cb9-498c-4089-962d-de4bda71b331 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:47.797708 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-76e88cb9-498c-4089-962d-de4bda71b331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:47.840384 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:47.841461 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e88cb9-498c-4089-962d-de4bda71b331 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:47.851373 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9413dd-b1db-4fb8-b80f-e085e085d255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:47.852921 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9413dd-b1db-4fb8-b80f-e085e085d255 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:47.853284 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9413dd-b1db-4fb8-b80f-e085e085d255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:47.853484 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9413dd-b1db-4fb8-b80f-e085e085d255 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:47.856730 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9413dd-b1db-4fb8-b80f-e085e085d255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:47.860337 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9413dd-b1db-4fb8-b80f-e085e085d255 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:47.900280 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 846/1705] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:47.903844 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af430c-2fa7-4271-86d2-e40e899934f1 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:47.905678 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af430c-2fa7-4271-86d2-e40e899934f1 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:47.905990 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af430c-2fa7-4271-86d2-e40e899934f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:47.937920 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe053bea-e557-4a65-8b67-5d2f42f1992c None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:47.957762 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc936c1e-88f8-44b1-82b8-7f2135e91767 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:47.959737 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc936c1e-88f8-44b1-82b8-7f2135e91767 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:47.960793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc936c1e-88f8-44b1-82b8-7f2135e91767 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:47.962522 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc936c1e-88f8-44b1-82b8-7f2135e91767 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:47.963736 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-f6af430c-2fa7-4271-86d2-e40e899934f1 None None] MFA Rules not processed for user `c30bc55c6a1348bb961f0d010422da87`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:47.965742 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-f6af430c-2fa7-4271-86d2-e40e899934f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:47.967884 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-bc936c1e-88f8-44b1-82b8-7f2135e91767 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:48.003666 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 847/1706] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 09:04:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:48.005009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97eef0-d284-4205-90a6-d85b10cf2ba0 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:48.005477 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97eef0-d284-4205-90a6-d85b10cf2ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:48.010691 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97eef0-d284-4205-90a6-d85b10cf2ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:48.061463 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:48.079529 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-fb97eef0-d284-4205-90a6-d85b10cf2ba0 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:48.080797 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-fb97eef0-d284-4205-90a6-d85b10cf2ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:48.100187 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 848/1707] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:48.100187 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a979e6-6641-4422-aead-5bc42f5c4d6d None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:48.100187 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a979e6-6641-4422-aead-5bc42f5c4d6d None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:48.100187 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a979e6-6641-4422-aead-5bc42f5c4d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:48.140303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc936c1e-88f8-44b1-82b8-7f2135e91767 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:48.143746 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc936c1e-88f8-44b1-82b8-7f2135e91767 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:48.173799 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 860/1708] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:04:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:04:48.177941 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc936c1e-88f8-44b1-82b8-7f2135e91767 service nova] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:48.191358 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-59a979e6-6641-4422-aead-5bc42f5c4d6d None None] MFA Rules not processed for user `78116abe231f4e8fa7f62e8764fb5857`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:48.195758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-59a979e6-6641-4422-aead-5bc42f5c4d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:48.206367 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc936c1e-88f8-44b1-82b8-7f2135e91767 service nova] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:48.219870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdcdc1-592d-4f74-978c-995aa4b430f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:48.222427 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdcdc1-592d-4f74-978c-995aa4b430f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:48.222837 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdcdc1-592d-4f74-978c-995aa4b430f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:48.224849 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdcdc1-592d-4f74-978c-995aa4b430f4 admin admin] PATH_INFO: `/v3/projects/918a82fc728943aa86516953509e5819/users/f57110de5c5e4098a9060eade1e902e0/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:48.270435 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cdcdc1-592d-4f74-978c-995aa4b430f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=918a82fc728943aa86516953509e5819, user_id=f57110de5c5e4098a9060eade1e902e0, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:48.283201 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cdcdc1-592d-4f74-978c-995aa4b430f4 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:48.331149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 861/1709] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:04:48 2022] PUT /identity/v3/projects/918a82fc728943aa86516953509e5819/users/f57110de5c5e4098a9060eade1e902e0/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:48.331149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdcdc1-592d-4f74-978c-995aa4b430f4 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:48.348583 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d7cdcdc1-592d-4f74-978c-995aa4b430f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:48.406087 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 849/1710] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:48.407194 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a979e6-6641-4422-aead-5bc42f5c4d6d None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:48.429880 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a979e6-6641-4422-aead-5bc42f5c4d6d None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:48.564171 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff32ffc-5c50-44f8-8785-9c4d39ea8384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:48.565094 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff32ffc-5c50-44f8-8785-9c4d39ea8384 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:48.565564 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff32ffc-5c50-44f8-8785-9c4d39ea8384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:48.566165 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff32ffc-5c50-44f8-8785-9c4d39ea8384 admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:48.567076 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff32ffc-5c50-44f8-8785-9c4d39ea8384 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:04:48.573189 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff32ffc-5c50-44f8-8785-9c4d39ea8384 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:48.576085 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff32ffc-5c50-44f8-8785-9c4d39ea8384 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:48.617155 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 850/1711] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:04:48.619099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b7c28-95c0-42ef-b5e0-323035d6c2fc None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:48.619429 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b7c28-95c0-42ef-b5e0-323035d6c2fc None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:48.620247 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b7c28-95c0-42ef-b5e0-323035d6c2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:48.691551 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-bc2b7c28-95c0-42ef-b5e0-323035d6c2fc None None] MFA Rules not processed for user `f57110de5c5e4098a9060eade1e902e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:48.692951 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-bc2b7c28-95c0-42ef-b5e0-323035d6c2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:48.703359 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdcdc1-592d-4f74-978c-995aa4b430f4 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:48.719813 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36966cb1-d623-4bea-9370-26ae474e911c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713805e0f1174a01987014319075ec03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:48.725433 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36966cb1-d623-4bea-9370-26ae474e911c service glance] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:48.727015 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36966cb1-d623-4bea-9370-26ae474e911c service glance] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:48.727588 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36966cb1-d623-4bea-9370-26ae474e911c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:48.883216 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:48.913496 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 851/1712] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:48.919196 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36439c07-9dc5-42eb-a6ad-5aeb4a90eb61 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:48.921466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36439c07-9dc5-42eb-a6ad-5aeb4a90eb61 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:48.921987 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36439c07-9dc5-42eb-a6ad-5aeb4a90eb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:48.984543 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-36439c07-9dc5-42eb-a6ad-5aeb4a90eb61 None None] MFA Rules not processed for user `78116abe231f4e8fa7f62e8764fb5857`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:48.992623 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-36439c07-9dc5-42eb-a6ad-5aeb4a90eb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:49.016685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:49.046351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36966cb1-d623-4bea-9370-26ae474e911c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:49.051287 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36966cb1-d623-4bea-9370-26ae474e911c service glance] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:49.118445 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 862/1713] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:04:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 796 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:04:49.119466 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36966cb1-d623-4bea-9370-26ae474e911c service glance] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:49.146932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36966cb1-d623-4bea-9370-26ae474e911c service glance] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:49.160088 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b397d9-d85d-458f-a740-b4a96b00fd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:49.161246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b397d9-d85d-458f-a740-b4a96b00fd2b admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:49.162051 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b397d9-d85d-458f-a740-b4a96b00fd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:49.163460 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b397d9-d85d-458f-a740-b4a96b00fd2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:49.164868 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b397d9-d85d-458f-a740-b4a96b00fd2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:49.168963 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b397d9-d85d-458f-a740-b4a96b00fd2b admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:49.192299 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 852/1714] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:49.194028 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36439c07-9dc5-42eb-a6ad-5aeb4a90eb61 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:49.238308 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36439c07-9dc5-42eb-a6ad-5aeb4a90eb61 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:49.250475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad8cf2-4c92-4701-be5a-f0d2d950dee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:49.253099 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 863/1715] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:04:49 2022] POST /identity/v3/projects => generated 367 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:49.254545 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b397d9-d85d-458f-a740-b4a96b00fd2b admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:49.254822 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad8cf2-4c92-4701-be5a-f0d2d950dee7 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:49.255203 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad8cf2-4c92-4701-be5a-f0d2d950dee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:49.256294 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad8cf2-4c92-4701-be5a-f0d2d950dee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:49.260773 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad8cf2-4c92-4701-be5a-f0d2d950dee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:49.265213 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad8cf2-4c92-4701-be5a-f0d2d950dee7 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:49.336186 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 853/1716] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:04:49 2022] POST /identity/v3/projects => generated 389 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:49.338014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad8cf2-4c92-4701-be5a-f0d2d950dee7 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:49.431396 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b397d9-d85d-458f-a740-b4a96b00fd2b admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:49.471601 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad8cf2-4c92-4701-be5a-f0d2d950dee7 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:49.486797 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a98a8-7c06-4f86-b397-fd5d82d5c7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:49.487735 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a98a8-7c06-4f86-b397-fd5d82d5c7fd admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:49.488126 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a98a8-7c06-4f86-b397-fd5d82d5c7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:49.488401 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a98a8-7c06-4f86-b397-fd5d82d5c7fd admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:49.489162 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a98a8-7c06-4f86-b397-fd5d82d5c7fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:49.495965 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a98a8-7c06-4f86-b397-fd5d82d5c7fd admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:49.543616 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 854/1717] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:04:49 2022] POST /identity/v3/users => generated 284 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:49.546683 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a98a8-7c06-4f86-b397-fd5d82d5c7fd admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:49.570131 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a98a8-7c06-4f86-b397-fd5d82d5c7fd admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:49.579321 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193acde2-a0ed-45ba-8c6f-81b525eb05cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:49.579962 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193acde2-a0ed-45ba-8c6f-81b525eb05cf service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:49.580243 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193acde2-a0ed-45ba-8c6f-81b525eb05cf service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:49.580514 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193acde2-a0ed-45ba-8c6f-81b525eb05cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:49.584744 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c6ba4-c155-4658-81f1-16de7d3eb456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:49.585376 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c6ba4-c155-4658-81f1-16de7d3eb456 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:49.585654 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c6ba4-c155-4658-81f1-16de7d3eb456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:49.586286 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c6ba4-c155-4658-81f1-16de7d3eb456 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:49.587060 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c6ba4-c155-4658-81f1-16de7d3eb456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:49.589023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c6ba4-c155-4658-81f1-16de7d3eb456 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:49.640657 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 855/1718] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:04:49 2022] POST /identity/v3/users => generated 301 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:49.641586 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c6ba4-c155-4658-81f1-16de7d3eb456 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:49.662376 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c6ba4-c155-4658-81f1-16de7d3eb456 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:49.679644 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f553a3a-8240-4e53-8ad0-05507e931e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:49.680283 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f553a3a-8240-4e53-8ad0-05507e931e09 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:49.680591 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f553a3a-8240-4e53-8ad0-05507e931e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:49.680879 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f553a3a-8240-4e53-8ad0-05507e931e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:49.681591 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f553a3a-8240-4e53-8ad0-05507e931e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:49.685254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f553a3a-8240-4e53-8ad0-05507e931e09 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:49.691354 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:49.713415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 856/1719] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:49.718379 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193acde2-a0ed-45ba-8c6f-81b525eb05cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:49.718937 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f553a3a-8240-4e53-8ad0-05507e931e09 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:49.720911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193acde2-a0ed-45ba-8c6f-81b525eb05cf service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:49.737206 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f553a3a-8240-4e53-8ad0-05507e931e09 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:49.742840 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 864/1720] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:04:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:04:49.760024 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193acde2-a0ed-45ba-8c6f-81b525eb05cf service nova] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:49.768405 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e072133-c8d0-4378-88d4-bd6a4512e26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:49.769032 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e072133-c8d0-4378-88d4-bd6a4512e26b admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:49.769310 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e072133-c8d0-4378-88d4-bd6a4512e26b admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:49.769580 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e072133-c8d0-4378-88d4-bd6a4512e26b admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:49.770277 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e072133-c8d0-4378-88d4-bd6a4512e26b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:49.772129 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e072133-c8d0-4378-88d4-bd6a4512e26b admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:49.795801 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193acde2-a0ed-45ba-8c6f-81b525eb05cf service nova] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:49.804028 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 857/1721] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:49.811495 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e072133-c8d0-4378-88d4-bd6a4512e26b admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:49.813511 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfe0a8-8bc3-4de7-95b8-4c2ea9094226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:49.814157 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfe0a8-8bc3-4de7-95b8-4c2ea9094226 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:49.814461 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfe0a8-8bc3-4de7-95b8-4c2ea9094226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:49.814745 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfe0a8-8bc3-4de7-95b8-4c2ea9094226 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:49.815483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfe0a8-8bc3-4de7-95b8-4c2ea9094226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:49.817055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfe0a8-8bc3-4de7-95b8-4c2ea9094226 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:49.843330 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e072133-c8d0-4378-88d4-bd6a4512e26b admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:49.854989 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 865/1722] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:49.858542 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3767679-dcf2-4960-8559-0f055ae8020e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:49.859243 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3767679-dcf2-4960-8559-0f055ae8020e admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:49.859565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3767679-dcf2-4960-8559-0f055ae8020e admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:49.859987 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3767679-dcf2-4960-8559-0f055ae8020e admin admin] PATH_INFO: `/v3/projects/8cb6a79473c94ae0aa5e370b38f2f4dd/users/3a00d958622847fe8cfdba198172e93b/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:49.860188 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfe0a8-8bc3-4de7-95b8-4c2ea9094226 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:49.873869 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfe0a8-8bc3-4de7-95b8-4c2ea9094226 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:49.880988 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a2fec-8f14-433d-a8a1-f91b186e5c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:49.881230 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3767679-dcf2-4960-8559-0f055ae8020e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cb6a79473c94ae0aa5e370b38f2f4dd, user_id=3a00d958622847fe8cfdba198172e93b, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:49.882074 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a2fec-8f14-433d-a8a1-f91b186e5c9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:49.882589 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a2fec-8f14-433d-a8a1-f91b186e5c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:49.883053 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a2fec-8f14-433d-a8a1-f91b186e5c9d admin admin] PATH_INFO: `/v3/projects/973a1ea44eab4dbfa9ec55d14f50b943/users/ca65d6a28d6b4b47aa7461adf0a97e9f/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:49.884152 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3767679-dcf2-4960-8559-0f055ae8020e admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:49.912643 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 858/1723] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:04:49 2022] PUT /identity/v3/projects/8cb6a79473c94ae0aa5e370b38f2f4dd/users/3a00d958622847fe8cfdba198172e93b/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:49.915132 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106a89f-fd58-4ad4-a79f-d7926e0e5312 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:49.915578 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106a89f-fd58-4ad4-a79f-d7926e0e5312 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:49.915919 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a2fec-8f14-433d-a8a1-f91b186e5c9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=973a1ea44eab4dbfa9ec55d14f50b943, user_id=ca65d6a28d6b4b47aa7461adf0a97e9f, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:49.916143 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106a89f-fd58-4ad4-a79f-d7926e0e5312 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:49.917735 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 859/1724] 10.222.0.65 () {54 vars in 912 bytes} [Wed Jul 27 09:04:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 09:04:49.919625 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a2fec-8f14-433d-a8a1-f91b186e5c9d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:49.923985 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106a89f-fd58-4ad4-a79f-d7926e0e5312 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:49.948287 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 866/1725] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:04:49 2022] PUT /identity/v3/projects/973a1ea44eab4dbfa9ec55d14f50b943/users/ca65d6a28d6b4b47aa7461adf0a97e9f/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:49.951344 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58096978-f6a8-47c1-91f5-6bf0fc9b8461 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:49.951636 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58096978-f6a8-47c1-91f5-6bf0fc9b8461 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:49.951919 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58096978-f6a8-47c1-91f5-6bf0fc9b8461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:49.987632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:50.010459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-58096978-f6a8-47c1-91f5-6bf0fc9b8461 None None] MFA Rules not processed for user `c30bc55c6a1348bb961f0d010422da87`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:50.012475 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-58096978-f6a8-47c1-91f5-6bf0fc9b8461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:50.057064 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106a89f-fd58-4ad4-a79f-d7926e0e5312 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:50.191367 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 867/1726] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 09:04:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:50.193431 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93237c1-6e16-42fc-9241-ef604e26a519 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:50.193994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93237c1-6e16-42fc-9241-ef604e26a519 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:50.194526 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93237c1-6e16-42fc-9241-ef604e26a519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:50.243598 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133367dd-8d9e-4c0f-83b4-fa7ec0f00eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:50.244412 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133367dd-8d9e-4c0f-83b4-fa7ec0f00eed admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:50.244695 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133367dd-8d9e-4c0f-83b4-fa7ec0f00eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:50.244965 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133367dd-8d9e-4c0f-83b4-fa7ec0f00eed admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:50.245728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133367dd-8d9e-4c0f-83b4-fa7ec0f00eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:50.247383 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133367dd-8d9e-4c0f-83b4-fa7ec0f00eed admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:50.249508 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-d93237c1-6e16-42fc-9241-ef604e26a519 None None] MFA Rules not processed for user `ca65d6a28d6b4b47aa7461adf0a97e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:50.251441 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d93237c1-6e16-42fc-9241-ef604e26a519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:50.274926 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 860/1727] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:50.276174 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507f1df-ca90-4a49-a13b-f909efb8c1d9 None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:50.276492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507f1df-ca90-4a49-a13b-f909efb8c1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:50.276746 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507f1df-ca90-4a49-a13b-f909efb8c1d9 None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:50.295754 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 861/1728] 10.222.0.65 () {54 vars in 912 bytes} [Wed Jul 27 09:04:50 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 09:04:50.297901 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507f1df-ca90-4a49-a13b-f909efb8c1d9 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:50.303100 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-0507f1df-ca90-4a49-a13b-f909efb8c1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:50.428391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 868/1729] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:50.430348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93237c1-6e16-42fc-9241-ef604e26a519 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:50.454955 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93237c1-6e16-42fc-9241-ef604e26a519 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:50.460831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507f1df-ca90-4a49-a13b-f909efb8c1d9 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:50.470008 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf683963-c285-4799-ac16-7e40b3adf339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:50.471023 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf683963-c285-4799-ac16-7e40b3adf339 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:50.471589 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf683963-c285-4799-ac16-7e40b3adf339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:50.472182 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf683963-c285-4799-ac16-7e40b3adf339 admin admin] PATH_INFO: `/v3/projects/8cb6a79473c94ae0aa5e370b38f2f4dd/users/3a00d958622847fe8cfdba198172e93b/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:50.473357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc01359-d32d-40e6-ab8e-4e2014173736 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713805e0f1174a01987014319075ec03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:50.473731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc01359-d32d-40e6-ab8e-4e2014173736 service glance] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:50.474562 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc01359-d32d-40e6-ab8e-4e2014173736 service glance] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:50.474863 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc01359-d32d-40e6-ab8e-4e2014173736 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:50.477958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf683963-c285-4799-ac16-7e40b3adf339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cb6a79473c94ae0aa5e370b38f2f4dd, user_id=3a00d958622847fe8cfdba198172e93b, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:50.488223 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf683963-c285-4799-ac16-7e40b3adf339 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:50.502957 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc01359-d32d-40e6-ab8e-4e2014173736 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:50.504420 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc01359-d32d-40e6-ab8e-4e2014173736 service glance] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:50.529023 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 869/1730] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:04:50 2022] PUT /identity/v3/projects/8cb6a79473c94ae0aa5e370b38f2f4dd/users/3a00d958622847fe8cfdba198172e93b/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:50.530592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 862/1731] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:04:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:04:50.531500 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc01359-d32d-40e6-ab8e-4e2014173736 service glance] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:50.547206 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd4e9a-b7a5-4187-b23a-187903208656 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:50.548945 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd4e9a-b7a5-4187-b23a-187903208656 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:50.549735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd4e9a-b7a5-4187-b23a-187903208656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:50.550119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc01359-d32d-40e6-ab8e-4e2014173736 service glance] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:50.674360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:50.686968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-c6dd4e9a-b7a5-4187-b23a-187903208656 None None] MFA Rules not processed for user `b018ac10ad804c6cbbe7fdcc1cec61e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:50.688872 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c6dd4e9a-b7a5-4187-b23a-187903208656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:50.702503 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc13084-a6e7-4f7f-b5c0-7538d46478df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:50.703448 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc13084-a6e7-4f7f-b5c0-7538d46478df admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:50.703727 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc13084-a6e7-4f7f-b5c0-7538d46478df admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:50.704010 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc13084-a6e7-4f7f-b5c0-7538d46478df admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:50.704661 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc13084-a6e7-4f7f-b5c0-7538d46478df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:50.708939 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc13084-a6e7-4f7f-b5c0-7538d46478df admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:50.745623 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:50.775441 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 863/1732] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:04:50 2022] POST /identity/v3/projects => generated 367 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:50.776819 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07801ed4-06ef-426e-b904-d8e4365bd97d None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:50.777109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07801ed4-06ef-426e-b904-d8e4365bd97d None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:50.777388 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07801ed4-06ef-426e-b904-d8e4365bd97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:50.792036 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 870/1733] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 09:04:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:50.792793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd4e9a-b7a5-4187-b23a-187903208656 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:50.821558 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd4e9a-b7a5-4187-b23a-187903208656 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:50.835024 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-07801ed4-06ef-426e-b904-d8e4365bd97d None None] MFA Rules not processed for user `3a00d958622847fe8cfdba198172e93b`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:50.836144 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-07801ed4-06ef-426e-b904-d8e4365bd97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:50.929058 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356eb42-31ca-46b4-b1b1-2f6f3d1c2e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:50.930425 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356eb42-31ca-46b4-b1b1-2f6f3d1c2e1d admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:50.930711 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356eb42-31ca-46b4-b1b1-2f6f3d1c2e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:50.931708 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356eb42-31ca-46b4-b1b1-2f6f3d1c2e1d admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:50.933874 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356eb42-31ca-46b4-b1b1-2f6f3d1c2e1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:50.936522 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356eb42-31ca-46b4-b1b1-2f6f3d1c2e1d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:51.016371 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 871/1734] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:04:50 2022] POST /identity/v3/users => generated 290 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:51.023334 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356eb42-31ca-46b4-b1b1-2f6f3d1c2e1d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:51.026386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 864/1735] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:50 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:51.027409 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07801ed4-06ef-426e-b904-d8e4365bd97d None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:51.047311 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d356eb42-31ca-46b4-b1b1-2f6f3d1c2e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:51.057057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07801ed4-06ef-426e-b904-d8e4365bd97d None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:51.064408 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9b155-131d-46b3-96bd-348cd5feb9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:51.065892 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9b155-131d-46b3-96bd-348cd5feb9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:51.066427 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9b155-131d-46b3-96bd-348cd5feb9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:51.066941 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9b155-131d-46b3-96bd-348cd5feb9b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:51.067996 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b9b155-131d-46b3-96bd-348cd5feb9b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:51.070835 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b9b155-131d-46b3-96bd-348cd5feb9b4 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:51.105933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 865/1736] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:51.108182 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9b155-131d-46b3-96bd-348cd5feb9b4 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:51.111238 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-02b9b155-131d-46b3-96bd-348cd5feb9b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:51.189036 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356eb42-31ca-46b4-b1b1-2f6f3d1c2e1d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:51.201949 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be834a3-e860-4f1a-a13c-353fe8a6655f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:51.202711 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be834a3-e860-4f1a-a13c-353fe8a6655f service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:51.203146 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be834a3-e860-4f1a-a13c-353fe8a6655f service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:51.203428 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be834a3-e860-4f1a-a13c-353fe8a6655f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:51.215231 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9b155-131d-46b3-96bd-348cd5feb9b4 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:51.218882 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be834a3-e860-4f1a-a13c-353fe8a6655f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:51.221782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be834a3-e860-4f1a-a13c-353fe8a6655f service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:51.227350 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556c16e-67b8-4e67-9581-acf3bd08965d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:51.228055 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556c16e-67b8-4e67-9581-acf3bd08965d service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:51.228347 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556c16e-67b8-4e67-9581-acf3bd08965d service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:51.230968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556c16e-67b8-4e67-9581-acf3bd08965d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:51.235189 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 872/1737] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:04:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:04:51.239905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547a95a-2264-4f20-8188-f966d0a83c4b None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:51.240646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547a95a-2264-4f20-8188-f966d0a83c4b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:51.241091 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547a95a-2264-4f20-8188-f966d0a83c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:51.295388 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556c16e-67b8-4e67-9581-acf3bd08965d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:51.299185 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556c16e-67b8-4e67-9581-acf3bd08965d service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:51.352904 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 866/1738] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:04:51 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:04:51.353859 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556c16e-67b8-4e67-9581-acf3bd08965d service cinder] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:51.390434 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-d547a95a-2264-4f20-8188-f966d0a83c4b None None] MFA Rules not processed for user `1d586ea72a1a4865941b30fa77103a52`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:51.394242 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556c16e-67b8-4e67-9581-acf3bd08965d service cinder] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:51.394822 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d547a95a-2264-4f20-8188-f966d0a83c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:51.427343 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b4228-e54b-48ea-baba-01d3c0d68348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:51.428382 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b4228-e54b-48ea-baba-01d3c0d68348 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:51.428681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b4228-e54b-48ea-baba-01d3c0d68348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:51.428970 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b4228-e54b-48ea-baba-01d3c0d68348 admin admin] PATH_INFO: `/v3/projects/542fb09c6a254ebdad4d8ce06e50ebf4/users/2a1fbe9893494a1da1a248d60563c7c3/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:51.478247 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b4228-e54b-48ea-baba-01d3c0d68348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=542fb09c6a254ebdad4d8ce06e50ebf4, user_id=2a1fbe9893494a1da1a248d60563c7c3, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:51.498449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b4228-e54b-48ea-baba-01d3c0d68348 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:51.535047 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 867/1739] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:04:51 2022] PUT /identity/v3/projects/542fb09c6a254ebdad4d8ce06e50ebf4/users/2a1fbe9893494a1da1a248d60563c7c3/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:51.543736 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b4228-e54b-48ea-baba-01d3c0d68348 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:51.588174 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:51.616876 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 873/1740] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:51.678722 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547a95a-2264-4f20-8188-f966d0a83c4b None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:51.693339 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:51.714722 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547a95a-2264-4f20-8188-f966d0a83c4b None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:51.745196 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180841e7-d2ae-4c7d-96a7-eff9f6c38339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:51.745875 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180841e7-d2ae-4c7d-96a7-eff9f6c38339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:51.746157 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180841e7-d2ae-4c7d-96a7-eff9f6c38339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:51.747761 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180841e7-d2ae-4c7d-96a7-eff9f6c38339 admin admin] PATH_INFO: `/v3/users/f57110de5c5e4098a9060eade1e902e0` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:51.750953 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b4228-e54b-48ea-baba-01d3c0d68348 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:51.751097 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180841e7-d2ae-4c7d-96a7-eff9f6c38339 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f57110de5c5e4098a9060eade1e902e0)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:51.761056 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180841e7-d2ae-4c7d-96a7-eff9f6c38339 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:51.772883 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac66677-c1f7-45f2-81ca-4c63797e585a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:51.773697 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac66677-c1f7-45f2-81ca-4c63797e585a admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:51.776374 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac66677-c1f7-45f2-81ca-4c63797e585a admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:51.778793 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac66677-c1f7-45f2-81ca-4c63797e585a admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:51.780952 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac66677-c1f7-45f2-81ca-4c63797e585a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:51.785001 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac66677-c1f7-45f2-81ca-4c63797e585a admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:51.804416 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 868/1741] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:51.808607 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac66677-c1f7-45f2-81ca-4c63797e585a admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:51.845812 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac66677-c1f7-45f2-81ca-4c63797e585a admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:51.862130 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637f869-90f3-422e-a679-8c70d1126fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:51.868386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637f869-90f3-422e-a679-8c70d1126fc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:51.868887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637f869-90f3-422e-a679-8c70d1126fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:51.870706 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637f869-90f3-422e-a679-8c70d1126fc5 admin admin] PATH_INFO: `/v3/projects/542fb09c6a254ebdad4d8ce06e50ebf4/users/2a1fbe9893494a1da1a248d60563c7c3/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:51.874188 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637f869-90f3-422e-a679-8c70d1126fc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=542fb09c6a254ebdad4d8ce06e50ebf4, user_id=2a1fbe9893494a1da1a248d60563c7c3, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:51.877841 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637f869-90f3-422e-a679-8c70d1126fc5 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:51.879997 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-180841e7-d2ae-4c7d-96a7-eff9f6c38339 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f57110de5c5e4098a9060eade1e902e0'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:51.892267 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-180841e7-d2ae-4c7d-96a7-eff9f6c38339 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f57110de5c5e4098a9060eade1e902e0'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:51.893718 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-180841e7-d2ae-4c7d-96a7-eff9f6c38339 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f57110de5c5e4098a9060eade1e902e0'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:51.917924 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 869/1742] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:04:51 2022] PUT /identity/v3/projects/542fb09c6a254ebdad4d8ce06e50ebf4/users/2a1fbe9893494a1da1a248d60563c7c3/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:51.921585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929abf9-2216-42a0-883a-f6d2a608b549 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:51.921982 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929abf9-2216-42a0-883a-f6d2a608b549 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:51.922274 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929abf9-2216-42a0-883a-f6d2a608b549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:51.935707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-180841e7-d2ae-4c7d-96a7-eff9f6c38339 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f57110de5c5e4098a9060eade1e902e0'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:51.937674 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-180841e7-d2ae-4c7d-96a7-eff9f6c38339 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f57110de5c5e4098a9060eade1e902e0'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:52.002648 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 874/1743] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:04:51 2022] DELETE /identity/v3/users/f57110de5c5e4098a9060eade1e902e0 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:04:52.007570 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752ad37-5b71-444c-8f71-389c080bfc6f None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:52.007873 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752ad37-5b71-444c-8f71-389c080bfc6f None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:52.009005 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752ad37-5b71-444c-8f71-389c080bfc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:52.047021 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-6929abf9-2216-42a0-883a-f6d2a608b549 None None] MFA Rules not processed for user `2a1fbe9893494a1da1a248d60563c7c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:52.048274 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-6929abf9-2216-42a0-883a-f6d2a608b549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:52.072813 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-9752ad37-5b71-444c-8f71-389c080bfc6f None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:52.076542 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9752ad37-5b71-444c-8f71-389c080bfc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:52.242368 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 870/1744] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:51 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:52.255326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929abf9-2216-42a0-883a-f6d2a608b549 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:52.257610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-6929abf9-2216-42a0-883a-f6d2a608b549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:52.279124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 875/1745] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:52.292453 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752ad37-5b71-444c-8f71-389c080bfc6f None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:52.294229 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9752ad37-5b71-444c-8f71-389c080bfc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:52.434604 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929abf9-2216-42a0-883a-f6d2a608b549 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:52.438115 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073aa01-a643-4671-95e4-cc41e295bd19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:52.439560 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073aa01-a643-4671-95e4-cc41e295bd19 service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:52.439560 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073aa01-a643-4671-95e4-cc41e295bd19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:52.440288 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073aa01-a643-4671-95e4-cc41e295bd19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:52.466673 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a073aa01-a643-4671-95e4-cc41e295bd19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:52.468450 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a073aa01-a643-4671-95e4-cc41e295bd19 service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:52.475225 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752ad37-5b71-444c-8f71-389c080bfc6f None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:52.481895 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c679cca-8ffa-45a5-bf89-417da17f2b43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:52.484122 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c679cca-8ffa-45a5-bf89-417da17f2b43 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:52.484428 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c679cca-8ffa-45a5-bf89-417da17f2b43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:52.486095 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c679cca-8ffa-45a5-bf89-417da17f2b43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:52.494179 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 871/1746] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:04:52 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:04:52.517835 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c679cca-8ffa-45a5-bf89-417da17f2b43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:52.519952 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c679cca-8ffa-45a5-bf89-417da17f2b43 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:52.536656 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 876/1747] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:04:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:04:52.606430 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073aa01-a643-4671-95e4-cc41e295bd19 service cinder] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:52.608216 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-a073aa01-a643-4671-95e4-cc41e295bd19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:52.765349 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:52.791579 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073aa01-a643-4671-95e4-cc41e295bd19 service cinder] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:52.797327 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8f0e6-11cc-424e-a3ea-1d07552541fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d69004d02f9426b86e07907a553e523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:52.798461 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8f0e6-11cc-424e-a3ea-1d07552541fb service placement] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:52.810594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8f0e6-11cc-424e-a3ea-1d07552541fb service placement] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:52.810922 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8f0e6-11cc-424e-a3ea-1d07552541fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:52.816888 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-0fc8f0e6-11cc-424e-a3ea-1d07552541fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:52.865541 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8f0e6-11cc-424e-a3ea-1d07552541fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:52.879364 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8f0e6-11cc-424e-a3ea-1d07552541fb service placement] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:52.895898 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 872/1748] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:04:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:04:53.001593 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f328f35-885d-4c4d-9246-42df664368d2 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:53.002676 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f328f35-885d-4c4d-9246-42df664368d2 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:53.003184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f328f35-885d-4c4d-9246-42df664368d2 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:53.005976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 877/1749] 10.222.0.65 () {54 vars in 912 bytes} [Wed Jul 27 09:04:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 09:04:53.031274 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084b2bc-da62-4d42-9a8c-110c417bd531 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:53.031562 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084b2bc-da62-4d42-9a8c-110c417bd531 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:53.031839 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084b2bc-da62-4d42-9a8c-110c417bd531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:53.094358 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-4084b2bc-da62-4d42-9a8c-110c417bd531 None None] MFA Rules not processed for user `b018ac10ad804c6cbbe7fdcc1cec61e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:53.094358 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-4084b2bc-da62-4d42-9a8c-110c417bd531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:53.135639 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 873/1750] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 09:04:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:53.386564 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f328f35-885d-4c4d-9246-42df664368d2 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:53.389188 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4f328f35-885d-4c4d-9246-42df664368d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:53.436399 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f328f35-885d-4c4d-9246-42df664368d2 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:53.441165 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59d008-c4cf-4668-b50b-f530c6ce01a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:53.441778 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59d008-c4cf-4668-b50b-f530c6ce01a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:53.442057 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59d008-c4cf-4668-b50b-f530c6ce01a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:53.442524 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59d008-c4cf-4668-b50b-f530c6ce01a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:53.457799 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:53.472741 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59d008-c4cf-4668-b50b-f530c6ce01a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:53.483058 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59d008-c4cf-4668-b50b-f530c6ce01a6 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:53.507684 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 878/1751] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:04:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:04:53.985447 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084b2bc-da62-4d42-9a8c-110c417bd531 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:53.987669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-4084b2bc-da62-4d42-9a8c-110c417bd531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:54.016099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084b2bc-da62-4d42-9a8c-110c417bd531 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:54.032553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4b0c8-26f9-4f82-a153-67bbae1750b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:54.033286 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4b0c8-26f9-4f82-a153-67bbae1750b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:54.033638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4b0c8-26f9-4f82-a153-67bbae1750b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:54.033776 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4b0c8-26f9-4f82-a153-67bbae1750b2 admin admin] PATH_INFO: `/v3/projects/918a82fc728943aa86516953509e5819` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:54.041722 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4b0c8-26f9-4f82-a153-67bbae1750b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=918a82fc728943aa86516953509e5819)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:54.056564 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4b0c8-26f9-4f82-a153-67bbae1750b2 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:54.067761 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113ab06-66d5-4ce5-b700-a49778ef7098 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:54.068278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113ab06-66d5-4ce5-b700-a49778ef7098 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:54.071683 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113ab06-66d5-4ce5-b700-a49778ef7098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:54.141762 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-c113ab06-66d5-4ce5-b700-a49778ef7098 None None] MFA Rules not processed for user `ae3fe5b4d9344c3bb7ae21b030377313`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:54.143511 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c113ab06-66d5-4ce5-b700-a49778ef7098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:54.218038 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-47a4b0c8-26f9-4f82-a153-67bbae1750b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '918a82fc728943aa86516953509e5819', 'request_id': 'req-47a4b0c8-26f9-4f82-a153-67bbae1750b2'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:54.232856 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-47a4b0c8-26f9-4f82-a153-67bbae1750b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '918a82fc728943aa86516953509e5819', 'request_id': 'req-47a4b0c8-26f9-4f82-a153-67bbae1750b2'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:54.250912 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-47a4b0c8-26f9-4f82-a153-67bbae1750b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '918a82fc728943aa86516953509e5819', 'request_id': 'req-47a4b0c8-26f9-4f82-a153-67bbae1750b2'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:54.292855 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-47a4b0c8-26f9-4f82-a153-67bbae1750b2 admin admin] The token cache is being invalidate because project 918a82fc728943aa86516953509e5819 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:04:54.293359 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-47a4b0c8-26f9-4f82-a153-67bbae1750b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:54.295883 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-47a4b0c8-26f9-4f82-a153-67bbae1750b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:54.298519 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 874/1752] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:04:53 2022] DELETE /identity/v3/projects/918a82fc728943aa86516953509e5819 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:54.302697 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4b0c8-26f9-4f82-a153-67bbae1750b2 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:54.310141 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-47a4b0c8-26f9-4f82-a153-67bbae1750b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:54.419138 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 879/1753] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:54.504779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4b0c8-26f9-4f82-a153-67bbae1750b2 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:54.524021 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79ac3f-d47f-411f-bd25-98496950a525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:54.525423 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79ac3f-d47f-411f-bd25-98496950a525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:54.525704 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79ac3f-d47f-411f-bd25-98496950a525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:54.529062 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79ac3f-d47f-411f-bd25-98496950a525 admin admin] PATH_INFO: `/v3/users/3a00d958622847fe8cfdba198172e93b` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:54.536132 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca79ac3f-d47f-411f-bd25-98496950a525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a00d958622847fe8cfdba198172e93b)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:54.540622 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca79ac3f-d47f-411f-bd25-98496950a525 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:54.652788 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-ca79ac3f-d47f-411f-bd25-98496950a525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a00d958622847fe8cfdba198172e93b'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:54.653511 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-ca79ac3f-d47f-411f-bd25-98496950a525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a00d958622847fe8cfdba198172e93b'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:54.654158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-ca79ac3f-d47f-411f-bd25-98496950a525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a00d958622847fe8cfdba198172e93b'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:54.665734 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-ca79ac3f-d47f-411f-bd25-98496950a525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a00d958622847fe8cfdba198172e93b'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:54.681988 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:54.709682 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-ca79ac3f-d47f-411f-bd25-98496950a525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a00d958622847fe8cfdba198172e93b'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:54.781673 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 875/1754] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:04:54 2022] DELETE /identity/v3/users/3a00d958622847fe8cfdba198172e93b => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:04:55.382512 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383d189-23f8-4d63-a5e7-e3b0bd56044e None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:55.383045 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383d189-23f8-4d63-a5e7-e3b0bd56044e None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:55.383279 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383d189-23f8-4d63-a5e7-e3b0bd56044e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:55.444338 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-6383d189-23f8-4d63-a5e7-e3b0bd56044e None None] MFA Rules not processed for user `f67b7dc78caf4da490739ff96f436764`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:55.448687 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6383d189-23f8-4d63-a5e7-e3b0bd56044e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:55.672854 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd95b8-bbbb-48a7-aee6-4c2ecad69320 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:55.673491 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd95b8-bbbb-48a7-aee6-4c2ecad69320 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:55.673491 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd95b8-bbbb-48a7-aee6-4c2ecad69320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:55.764050 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 880/1755] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:55.796499 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-5fcd95b8-bbbb-48a7-aee6-4c2ecad69320 None None] MFA Rules not processed for user `5f1dfc498c1f4ccfa214d8c4777a2b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:55.797909 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-5fcd95b8-bbbb-48a7-aee6-4c2ecad69320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:55.934299 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383d189-23f8-4d63-a5e7-e3b0bd56044e None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:55.936199 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6383d189-23f8-4d63-a5e7-e3b0bd56044e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:56.047180 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 876/1756] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:56.123030 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383d189-23f8-4d63-a5e7-e3b0bd56044e None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:56.135045 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190d8b2-7b14-4f42-bb6a-47b060a8802d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:56.136125 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190d8b2-7b14-4f42-bb6a-47b060a8802d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:56.136617 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190d8b2-7b14-4f42-bb6a-47b060a8802d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:56.137134 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190d8b2-7b14-4f42-bb6a-47b060a8802d admin admin] PATH_INFO: `/v3/projects/8cb6a79473c94ae0aa5e370b38f2f4dd` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:56.138852 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190d8b2-7b14-4f42-bb6a-47b060a8802d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cb6a79473c94ae0aa5e370b38f2f4dd)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:56.143442 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190d8b2-7b14-4f42-bb6a-47b060a8802d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:56.249360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:56.259579 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c190d8b2-7b14-4f42-bb6a-47b060a8802d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cb6a79473c94ae0aa5e370b38f2f4dd', 'request_id': 'req-c190d8b2-7b14-4f42-bb6a-47b060a8802d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:56.283226 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c190d8b2-7b14-4f42-bb6a-47b060a8802d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cb6a79473c94ae0aa5e370b38f2f4dd', 'request_id': 'req-c190d8b2-7b14-4f42-bb6a-47b060a8802d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:56.293361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c190d8b2-7b14-4f42-bb6a-47b060a8802d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cb6a79473c94ae0aa5e370b38f2f4dd', 'request_id': 'req-c190d8b2-7b14-4f42-bb6a-47b060a8802d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:56.313559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c190d8b2-7b14-4f42-bb6a-47b060a8802d admin admin] The token cache is being invalidate because project 8cb6a79473c94ae0aa5e370b38f2f4dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:04:56.314636 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c190d8b2-7b14-4f42-bb6a-47b060a8802d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:56.318152 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c190d8b2-7b14-4f42-bb6a-47b060a8802d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:56.326628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 881/1757] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:04:55 2022] DELETE /identity/v3/projects/8cb6a79473c94ae0aa5e370b38f2f4dd => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:04:56.331763 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f784c-dead-4edf-b023-649e86251dc9 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:56.332075 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f784c-dead-4edf-b023-649e86251dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:56.332439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f784c-dead-4edf-b023-649e86251dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:56.403336 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-0d9f784c-dead-4edf-b023-649e86251dc9 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:56.404586 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-0d9f784c-dead-4edf-b023-649e86251dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:56.592937 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 877/1758] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:04:56.601624 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53a648-fef3-4163-9a9f-6b345064a40d None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:56.603079 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53a648-fef3-4163-9a9f-6b345064a40d None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:56.603543 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53a648-fef3-4163-9a9f-6b345064a40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:56.640510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-4c53a648-fef3-4163-9a9f-6b345064a40d None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:56.647830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4c53a648-fef3-4163-9a9f-6b345064a40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:56.684368 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f784c-dead-4edf-b023-649e86251dc9 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:56.685239 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 882/1759] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:56.687382 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53a648-fef3-4163-9a9f-6b345064a40d None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:56.696039 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4c53a648-fef3-4163-9a9f-6b345064a40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:56.713209 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f784c-dead-4edf-b023-649e86251dc9 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:56.731074 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df906ad-2fd2-4d79-b7eb-346bcc88f8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:56.732353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df906ad-2fd2-4d79-b7eb-346bcc88f8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:56.734535 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df906ad-2fd2-4d79-b7eb-346bcc88f8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:56.735416 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df906ad-2fd2-4d79-b7eb-346bcc88f8a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:56.738943 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53a648-fef3-4163-9a9f-6b345064a40d None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:56.739538 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df906ad-2fd2-4d79-b7eb-346bcc88f8a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:04:56.740112 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df906ad-2fd2-4d79-b7eb-346bcc88f8a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:56.765468 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df906ad-2fd2-4d79-b7eb-346bcc88f8a3 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:56.774080 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987859c4-16d0-45ef-8373-509c28381942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:56.776192 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987859c4-16d0-45ef-8373-509c28381942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:56.778681 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987859c4-16d0-45ef-8373-509c28381942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:56.779143 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987859c4-16d0-45ef-8373-509c28381942 admin admin] PATH_INFO: `/v3/users/ca65d6a28d6b4b47aa7461adf0a97e9f` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:56.780638 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987859c4-16d0-45ef-8373-509c28381942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca65d6a28d6b4b47aa7461adf0a97e9f)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:56.784106 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987859c4-16d0-45ef-8373-509c28381942 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:56.797413 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 878/1760] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:04:56.800209 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df906ad-2fd2-4d79-b7eb-346bcc88f8a3 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:56.830634 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df906ad-2fd2-4d79-b7eb-346bcc88f8a3 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:56.851056 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b9fee-02e3-44a9-92b2-d63bef604f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:56.851943 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b9fee-02e3-44a9-92b2-d63bef604f08 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:56.855047 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b9fee-02e3-44a9-92b2-d63bef604f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:56.857438 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b9fee-02e3-44a9-92b2-d63bef604f08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:56.859189 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b9fee-02e3-44a9-92b2-d63bef604f08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:56.868257 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b9fee-02e3-44a9-92b2-d63bef604f08 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:56.946100 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-987859c4-16d0-45ef-8373-509c28381942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca65d6a28d6b4b47aa7461adf0a97e9f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:56.964981 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-987859c4-16d0-45ef-8373-509c28381942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca65d6a28d6b4b47aa7461adf0a97e9f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:56.966064 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-987859c4-16d0-45ef-8373-509c28381942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca65d6a28d6b4b47aa7461adf0a97e9f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:56.991266 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 879/1761] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:04:56 2022] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:56.996977 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b9fee-02e3-44a9-92b2-d63bef604f08 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:57.006344 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-987859c4-16d0-45ef-8373-509c28381942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca65d6a28d6b4b47aa7461adf0a97e9f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:57.007101 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-987859c4-16d0-45ef-8373-509c28381942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca65d6a28d6b4b47aa7461adf0a97e9f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:04:57.066926 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 883/1762] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:04:56 2022] DELETE /identity/v3/users/ca65d6a28d6b4b47aa7461adf0a97e9f => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:57.071061 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082cd7c-05ca-4bad-be6d-2cd8ad340344 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:57.071376 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082cd7c-05ca-4bad-be6d-2cd8ad340344 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:57.071663 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082cd7c-05ca-4bad-be6d-2cd8ad340344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:57.140339 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:57.165339 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b9fee-02e3-44a9-92b2-d63bef604f08 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:57.199029 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-9082cd7c-05ca-4bad-be6d-2cd8ad340344 None None] MFA Rules not processed for user `c607472800fc49d5a75c5e6acb33f2a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:57.201529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9082cd7c-05ca-4bad-be6d-2cd8ad340344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:57.313926 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7f41c-1077-4b0e-89a7-5227e27a4093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:57.314866 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7f41c-1077-4b0e-89a7-5227e27a4093 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:57.315417 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7f41c-1077-4b0e-89a7-5227e27a4093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:57.315527 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7f41c-1077-4b0e-89a7-5227e27a4093 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:57.316269 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7f41c-1077-4b0e-89a7-5227e27a4093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:57.319047 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7f41c-1077-4b0e-89a7-5227e27a4093 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:57.437807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 880/1763] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:04:56 2022] POST /identity/v3/users => generated 290 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:04:57.439739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bad3d-ef58-4089-b576-b47a3ef73a29 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:57.441527 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 884/1764] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 09:04:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:57.443970 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082cd7c-05ca-4bad-be6d-2cd8ad340344 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:57.444737 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bad3d-ef58-4089-b576-b47a3ef73a29 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:57.450457 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9082cd7c-05ca-4bad-be6d-2cd8ad340344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:57.450977 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bad3d-ef58-4089-b576-b47a3ef73a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:57.498757 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082cd7c-05ca-4bad-be6d-2cd8ad340344 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:57.515859 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-056bad3d-ef58-4089-b576-b47a3ef73a29 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:57.517768 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-056bad3d-ef58-4089-b576-b47a3ef73a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:57.522386 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04e2db-1e05-476d-a4a9-3c5460fc9654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:57.523106 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04e2db-1e05-476d-a4a9-3c5460fc9654 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:57.523453 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04e2db-1e05-476d-a4a9-3c5460fc9654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:57.523812 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04e2db-1e05-476d-a4a9-3c5460fc9654 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:57.524600 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04e2db-1e05-476d-a4a9-3c5460fc9654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:57.529331 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04e2db-1e05-476d-a4a9-3c5460fc9654 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:57.549286 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 881/1765] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:57.565053 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 885/1766] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:57.567622 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056bad3d-ef58-4089-b576-b47a3ef73a29 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:57.590229 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056bad3d-ef58-4089-b576-b47a3ef73a29 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:57.605829 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2aa302-f227-4d8c-b096-6bfbcd8ef7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:57.606802 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2aa302-f227-4d8c-b096-6bfbcd8ef7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:57.607211 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2aa302-f227-4d8c-b096-6bfbcd8ef7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:57.607568 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2aa302-f227-4d8c-b096-6bfbcd8ef7b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:57.608968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2aa302-f227-4d8c-b096-6bfbcd8ef7b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:57.610389 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2aa302-f227-4d8c-b096-6bfbcd8ef7b3 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:57.632357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 882/1767] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:57.637206 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04e2db-1e05-476d-a4a9-3c5460fc9654 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:57.649329 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:57.657080 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2aa302-f227-4d8c-b096-6bfbcd8ef7b3 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:57.661630 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04e2db-1e05-476d-a4a9-3c5460fc9654 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:57.662981 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-cd2aa302-f227-4d8c-b096-6bfbcd8ef7b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:57.702510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e2fe3-a76a-4934-b778-82008c21b3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:57.705005 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e2fe3-a76a-4934-b778-82008c21b3a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:57.705339 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e2fe3-a76a-4934-b778-82008c21b3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:57.705683 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e2fe3-a76a-4934-b778-82008c21b3a1 admin admin] PATH_INFO: `/v3/projects/50386e06738d40cfb351b607f1f442a4/users/525f18241f2741d08bc4e5d28f4ed8bd/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:57.815054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e2fe3-a76a-4934-b778-82008c21b3a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50386e06738d40cfb351b607f1f442a4, user_id=525f18241f2741d08bc4e5d28f4ed8bd, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:57.827726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e2fe3-a76a-4934-b778-82008c21b3a1 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:57.870308 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 886/1768] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:04:57 2022] PUT /identity/v3/projects/50386e06738d40cfb351b607f1f442a4/users/525f18241f2741d08bc4e5d28f4ed8bd/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:04:57.871504 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e2fe3-a76a-4934-b778-82008c21b3a1 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:57.881927 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-7a3e2fe3-a76a-4934-b778-82008c21b3a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:58.107149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e2fe3-a76a-4934-b778-82008c21b3a1 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:58.120188 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3718c5-b6cd-4653-8727-67f69070b81d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:58.121134 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3718c5-b6cd-4653-8727-67f69070b81d service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:58.121430 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3718c5-b6cd-4653-8727-67f69070b81d service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:58.122348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3718c5-b6cd-4653-8727-67f69070b81d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:58.160426 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2aa302-f227-4d8c-b096-6bfbcd8ef7b3 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:58.280746 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:58.300627 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec5ef8-631f-42d6-b788-a9a1df69d802 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158ea5c9dd5142eebd903d5f732997ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:58.306589 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec5ef8-631f-42d6-b788-a9a1df69d802 service swift] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:58.306589 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec5ef8-631f-42d6-b788-a9a1df69d802 service swift] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:58.306589 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec5ef8-631f-42d6-b788-a9a1df69d802 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:58.420089 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3718c5-b6cd-4653-8727-67f69070b81d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:58.428112 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3718c5-b6cd-4653-8727-67f69070b81d service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:58.459909 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 887/1769] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:04:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:04:58.463801 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96caa40-2d13-40be-afbe-ad9589d85bea None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:58.464161 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96caa40-2d13-40be-afbe-ad9589d85bea None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:58.464452 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96caa40-2d13-40be-afbe-ad9589d85bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:58.511420 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec5ef8-631f-42d6-b788-a9a1df69d802 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:58.513106 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec5ef8-631f-42d6-b788-a9a1df69d802 service swift] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:58.545350 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 883/1770] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 09:04:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 889 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 09:04:58.551144 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-e96caa40-2d13-40be-afbe-ad9589d85bea None None] MFA Rules not processed for user `525f18241f2741d08bc4e5d28f4ed8bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:58.552625 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e96caa40-2d13-40be-afbe-ad9589d85bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:04:58.865621 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 888/1771] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:04:58.877209 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec5ef8-631f-42d6-b788-a9a1df69d802 service swift] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:58.911340 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec5ef8-631f-42d6-b788-a9a1df69d802 service swift] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:58.936838 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6fad9-ca03-4906-b84c-2e8b1b5e6656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:58.939268 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6fad9-ca03-4906-b84c-2e8b1b5e6656 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:58.942844 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6fad9-ca03-4906-b84c-2e8b1b5e6656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:58.944869 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6fad9-ca03-4906-b84c-2e8b1b5e6656 admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:58.945780 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6fad9-ca03-4906-b84c-2e8b1b5e6656 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:58.958878 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6fad9-ca03-4906-b84c-2e8b1b5e6656 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:59.068554 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96caa40-2d13-40be-afbe-ad9589d85bea None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:59.077813 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 884/1772] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:04:58 2022] POST /identity/v3/projects => generated 379 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:59.082052 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96caa40-2d13-40be-afbe-ad9589d85bea None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:59.164007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:04:59.369946 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729ef31-9db7-4b51-9689-8b50d0f34180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:59.370650 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729ef31-9db7-4b51-9689-8b50d0f34180 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:59.370938 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729ef31-9db7-4b51-9689-8b50d0f34180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:59.371220 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729ef31-9db7-4b51-9689-8b50d0f34180 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:59.371908 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8729ef31-9db7-4b51-9689-8b50d0f34180 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:59.373883 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8729ef31-9db7-4b51-9689-8b50d0f34180 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:59.459216 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 889/1773] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:04:59 2022] POST /identity/v3/users => generated 290 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:04:59.464357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6fad9-ca03-4906-b84c-2e8b1b5e6656 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:59.484321 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6fad9-ca03-4906-b84c-2e8b1b5e6656 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:59.497577 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fad39-d2fb-422a-862d-95f33a79481b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:59.498740 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fad39-d2fb-422a-862d-95f33a79481b admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:59.499350 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fad39-d2fb-422a-862d-95f33a79481b admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:59.499907 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fad39-d2fb-422a-862d-95f33a79481b admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:59.505002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262fad39-d2fb-422a-862d-95f33a79481b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:59.508435 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262fad39-d2fb-422a-862d-95f33a79481b admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:59.541990 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 885/1774] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:59.546888 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729ef31-9db7-4b51-9689-8b50d0f34180 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:59.561459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729ef31-9db7-4b51-9689-8b50d0f34180 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:59.579487 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af0c1b-0299-4036-8b06-c26e964f66f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:59.580522 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af0c1b-0299-4036-8b06-c26e964f66f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:59.580964 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af0c1b-0299-4036-8b06-c26e964f66f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:59.581569 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af0c1b-0299-4036-8b06-c26e964f66f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:59.582820 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af0c1b-0299-4036-8b06-c26e964f66f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:59.587274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af0c1b-0299-4036-8b06-c26e964f66f9 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:59.622474 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 890/1775] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:04:59.624400 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fad39-d2fb-422a-862d-95f33a79481b admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:04:59.646387 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fad39-d2fb-422a-862d-95f33a79481b admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:04:59.667070 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a9d3a-b314-4e9e-a27c-30235e2aeb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:04:59.670506 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a9d3a-b314-4e9e-a27c-30235e2aeb72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:59.670823 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a9d3a-b314-4e9e-a27c-30235e2aeb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:59.673797 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a9d3a-b314-4e9e-a27c-30235e2aeb72 admin admin] PATH_INFO: `/v3/projects/065d6a33fd224c60b104d8be05fe1fa6/users/1a5f91c258f941c8a7f952e5bfe558be/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:59.763048 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a9d3a-b314-4e9e-a27c-30235e2aeb72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=065d6a33fd224c60b104d8be05fe1fa6, user_id=1a5f91c258f941c8a7f952e5bfe558be, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:04:59.772770 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a9d3a-b314-4e9e-a27c-30235e2aeb72 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:04:59.826983 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 886/1776] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:04:59 2022] PUT /identity/v3/projects/065d6a33fd224c60b104d8be05fe1fa6/users/1a5f91c258f941c8a7f952e5bfe558be/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:04:59.842169 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8644fcc-fad3-4744-a3ef-5fec5509b9fa None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:04:59.842797 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8644fcc-fad3-4744-a3ef-5fec5509b9fa None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:04:59.843465 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8644fcc-fad3-4744-a3ef-5fec5509b9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:04:59.937817 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-d8644fcc-fad3-4744-a3ef-5fec5509b9fa None None] MFA Rules not processed for user `1a5f91c258f941c8a7f952e5bfe558be`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:04:59.939810 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d8644fcc-fad3-4744-a3ef-5fec5509b9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:00.108768 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a9d3a-b314-4e9e-a27c-30235e2aeb72 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:00.111088 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 891/1777] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:04:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:00.302074 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a9d3a-b314-4e9e-a27c-30235e2aeb72 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:00.319233 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a582c-2a6d-4de9-9fc0-b80bbd0acc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:00.319892 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a582c-2a6d-4de9-9fc0-b80bbd0acc54 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:00.320178 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a582c-2a6d-4de9-9fc0-b80bbd0acc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:00.320455 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a582c-2a6d-4de9-9fc0-b80bbd0acc54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:00.321157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a582c-2a6d-4de9-9fc0-b80bbd0acc54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:00.323251 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a582c-2a6d-4de9-9fc0-b80bbd0acc54 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:00.393174 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 887/1778] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:05:00 2022] POST /identity/v3/projects => generated 377 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:00.394202 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8644fcc-fad3-4744-a3ef-5fec5509b9fa None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:00.441300 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8644fcc-fad3-4744-a3ef-5fec5509b9fa None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:00.573443 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5d9a5-5ec8-4ec1-828c-a089cd00cc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:00.574898 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5d9a5-5ec8-4ec1-828c-a089cd00cc43 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:00.575510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5d9a5-5ec8-4ec1-828c-a089cd00cc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:00.576711 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5d9a5-5ec8-4ec1-828c-a089cd00cc43 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:00.577636 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5d9a5-5ec8-4ec1-828c-a089cd00cc43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:00.580697 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5d9a5-5ec8-4ec1-828c-a089cd00cc43 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:00.641834 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 892/1779] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:05:00 2022] POST /identity/v3/users => generated 295 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:05:00.643504 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a582c-2a6d-4de9-9fc0-b80bbd0acc54 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:00.676808 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a582c-2a6d-4de9-9fc0-b80bbd0acc54 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:00.703253 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d517f-ac17-4f33-b434-82dbd5f62555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:00.712056 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d517f-ac17-4f33-b434-82dbd5f62555 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:00.712350 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d517f-ac17-4f33-b434-82dbd5f62555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:00.712634 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d517f-ac17-4f33-b434-82dbd5f62555 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:00.713372 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d517f-ac17-4f33-b434-82dbd5f62555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:00.735973 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d517f-ac17-4f33-b434-82dbd5f62555 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:00.778453 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 888/1780] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:00.780050 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5d9a5-5ec8-4ec1-828c-a089cd00cc43 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:00.807430 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5d9a5-5ec8-4ec1-828c-a089cd00cc43 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:00.830567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4f4a8-bf8e-472d-9af7-8d66a136cf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:00.832640 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4f4a8-bf8e-472d-9af7-8d66a136cf3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:00.833008 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4f4a8-bf8e-472d-9af7-8d66a136cf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:00.834613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4f4a8-bf8e-472d-9af7-8d66a136cf3f admin admin] PATH_INFO: `/v3/projects/7037b61511d4444e9ed0fcf5208b533b/users/e921d08e997745928b4c9aee514ef8c8/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:00.869768 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:00.883809 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4f4a8-bf8e-472d-9af7-8d66a136cf3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7037b61511d4444e9ed0fcf5208b533b, user_id=e921d08e997745928b4c9aee514ef8c8, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:00.889558 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4f4a8-bf8e-472d-9af7-8d66a136cf3f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:00.935529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 893/1781] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:00 2022] PUT /identity/v3/projects/7037b61511d4444e9ed0fcf5208b533b/users/e921d08e997745928b4c9aee514ef8c8/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:00.937244 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d517f-ac17-4f33-b434-82dbd5f62555 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:00.962618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d517f-ac17-4f33-b434-82dbd5f62555 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:00.991577 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:01.197527 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9310b-429f-4c89-8b67-c3924c331f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:01.199170 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9310b-429f-4c89-8b67-c3924c331f97 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:01.200318 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9310b-429f-4c89-8b67-c3924c331f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:01.200917 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9310b-429f-4c89-8b67-c3924c331f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:01.205342 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9310b-429f-4c89-8b67-c3924c331f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:01.210109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9310b-429f-4c89-8b67-c3924c331f97 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:01.243891 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 889/1782] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:01.247300 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4f4a8-bf8e-472d-9af7-8d66a136cf3f admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:01.279128 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4f4a8-bf8e-472d-9af7-8d66a136cf3f admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:01.299734 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc40e1-552d-494a-a8a3-8da1f98eebad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:01.312284 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc40e1-552d-494a-a8a3-8da1f98eebad admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:01.314840 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc40e1-552d-494a-a8a3-8da1f98eebad admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:01.316156 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc40e1-552d-494a-a8a3-8da1f98eebad admin admin] PATH_INFO: `/v3/projects/7037b61511d4444e9ed0fcf5208b533b/users/e921d08e997745928b4c9aee514ef8c8/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:01.326717 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc40e1-552d-494a-a8a3-8da1f98eebad admin admin] RBAC: Authorizing `identity:create_grant(project_id=7037b61511d4444e9ed0fcf5208b533b, user_id=e921d08e997745928b4c9aee514ef8c8, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:01.339279 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc40e1-552d-494a-a8a3-8da1f98eebad admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:01.387831 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 894/1783] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:01 2022] PUT /identity/v3/projects/7037b61511d4444e9ed0fcf5208b533b/users/e921d08e997745928b4c9aee514ef8c8/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:01.392936 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48f5be-739f-40ef-8b6f-2755249628aa None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:01.393529 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48f5be-739f-40ef-8b6f-2755249628aa None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:01.394002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48f5be-739f-40ef-8b6f-2755249628aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:01.542414 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-bb48f5be-739f-40ef-8b6f-2755249628aa None None] MFA Rules not processed for user `e921d08e997745928b4c9aee514ef8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:01.545702 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-bb48f5be-739f-40ef-8b6f-2755249628aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:01.797771 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 890/1784] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:01.810671 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc40e1-552d-494a-a8a3-8da1f98eebad admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:01.819783 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-57cc40e1-552d-494a-a8a3-8da1f98eebad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:02.050526 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc40e1-552d-494a-a8a3-8da1f98eebad admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:02.098242 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c957c-db3d-42ec-bdeb-97de0d605bc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:02.099246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c957c-db3d-42ec-bdeb-97de0d605bc4 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:02.099246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c957c-db3d-42ec-bdeb-97de0d605bc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:02.100300 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c957c-db3d-42ec-bdeb-97de0d605bc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:02.122201 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c957c-db3d-42ec-bdeb-97de0d605bc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:02.123813 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c957c-db3d-42ec-bdeb-97de0d605bc4 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:02.190268 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 895/1785] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:01 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:02.267030 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48f5be-739f-40ef-8b6f-2755249628aa None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:02.269001 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-bb48f5be-739f-40ef-8b6f-2755249628aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:02.296975 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48f5be-739f-40ef-8b6f-2755249628aa None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:02.309718 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1873e-0add-47da-908d-c968b50d582e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:02.310741 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1873e-0add-47da-908d-c968b50d582e service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:02.311251 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1873e-0add-47da-908d-c968b50d582e service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:02.311779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1873e-0add-47da-908d-c968b50d582e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:02.521082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1873e-0add-47da-908d-c968b50d582e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:02.526352 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1873e-0add-47da-908d-c968b50d582e service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:02.576986 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 891/1786] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:03.480734 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99e9dd-f6e5-4b30-b165-6bd56a46ef66 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:03.481595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99e9dd-f6e5-4b30-b165-6bd56a46ef66 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:03.482018 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99e9dd-f6e5-4b30-b165-6bd56a46ef66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:03.548193 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-ad99e9dd-f6e5-4b30-b165-6bd56a46ef66 None None] MFA Rules not processed for user `b018ac10ad804c6cbbe7fdcc1cec61e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:03.549460 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ad99e9dd-f6e5-4b30-b165-6bd56a46ef66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:03.779859 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 896/1787] 10.222.0.69 () {58 vars in 1015 bytes} [Wed Jul 27 09:05:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:03.799685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1873e-0add-47da-908d-c968b50d582e service cinder] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:03.801381 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-b4b1873e-0add-47da-908d-c968b50d582e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:03.845941 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1873e-0add-47da-908d-c968b50d582e service cinder] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:03.852398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ecea7-6463-4a59-9104-b88a7bf51792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:03.853484 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ecea7-6463-4a59-9104-b88a7bf51792 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:03.853916 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ecea7-6463-4a59-9104-b88a7bf51792 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:03.854415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ecea7-6463-4a59-9104-b88a7bf51792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:03.881729 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ecea7-6463-4a59-9104-b88a7bf51792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:03.883691 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ecea7-6463-4a59-9104-b88a7bf51792 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:03.901193 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99e9dd-f6e5-4b30-b165-6bd56a46ef66 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:03.903428 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ad99e9dd-f6e5-4b30-b165-6bd56a46ef66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:03.917124 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 892/1788] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:04.135595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99e9dd-f6e5-4b30-b165-6bd56a46ef66 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:04.162760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6ce0b-b4f7-462f-87d4-bac4f37c9624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:04.174776 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6ce0b-b4f7-462f-87d4-bac4f37c9624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:04.176484 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6ce0b-b4f7-462f-87d4-bac4f37c9624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:04.177050 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6ce0b-b4f7-462f-87d4-bac4f37c9624 admin admin] PATH_INFO: `/v3/projects/973a1ea44eab4dbfa9ec55d14f50b943` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:04.190941 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6ce0b-b4f7-462f-87d4-bac4f37c9624 admin admin] RBAC: Authorizing `identity:delete_project(project_id=973a1ea44eab4dbfa9ec55d14f50b943)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:04.207903 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6ce0b-b4f7-462f-87d4-bac4f37c9624 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:04.342956 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:04.431998 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-95c6ce0b-b4f7-462f-87d4-bac4f37c9624 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '973a1ea44eab4dbfa9ec55d14f50b943', 'request_id': 'req-95c6ce0b-b4f7-462f-87d4-bac4f37c9624'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:04.499571 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-95c6ce0b-b4f7-462f-87d4-bac4f37c9624 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '973a1ea44eab4dbfa9ec55d14f50b943', 'request_id': 'req-95c6ce0b-b4f7-462f-87d4-bac4f37c9624'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:04.519042 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-95c6ce0b-b4f7-462f-87d4-bac4f37c9624 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '973a1ea44eab4dbfa9ec55d14f50b943', 'request_id': 'req-95c6ce0b-b4f7-462f-87d4-bac4f37c9624'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:04.560153 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-95c6ce0b-b4f7-462f-87d4-bac4f37c9624 admin admin] The token cache is being invalidate because project 973a1ea44eab4dbfa9ec55d14f50b943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:05:04.560449 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-95c6ce0b-b4f7-462f-87d4-bac4f37c9624 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:04.567505 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-95c6ce0b-b4f7-462f-87d4-bac4f37c9624 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:04.582770 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 897/1789] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:05:03 2022] DELETE /identity/v3/projects/973a1ea44eab4dbfa9ec55d14f50b943 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:04.584050 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ecea7-6463-4a59-9104-b88a7bf51792 service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:04.604678 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ecea7-6463-4a59-9104-b88a7bf51792 service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:04.656288 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:04.884289 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71784b7b-ad26-4b74-86df-4aad754738cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:04.885739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71784b7b-ad26-4b74-86df-4aad754738cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:04.886204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71784b7b-ad26-4b74-86df-4aad754738cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:04.886699 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71784b7b-ad26-4b74-86df-4aad754738cd admin admin] PATH_INFO: `/v3/users/2a1fbe9893494a1da1a248d60563c7c3` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:04.889802 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71784b7b-ad26-4b74-86df-4aad754738cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a1fbe9893494a1da1a248d60563c7c3)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:04.892027 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71784b7b-ad26-4b74-86df-4aad754738cd admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:05.045991 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-71784b7b-ad26-4b74-86df-4aad754738cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a1fbe9893494a1da1a248d60563c7c3'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:05.058101 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-71784b7b-ad26-4b74-86df-4aad754738cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a1fbe9893494a1da1a248d60563c7c3'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:05.059803 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-71784b7b-ad26-4b74-86df-4aad754738cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a1fbe9893494a1da1a248d60563c7c3'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:05.074332 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-71784b7b-ad26-4b74-86df-4aad754738cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a1fbe9893494a1da1a248d60563c7c3'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:05.128462 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-71784b7b-ad26-4b74-86df-4aad754738cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a1fbe9893494a1da1a248d60563c7c3'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:05.188593 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 893/1790] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:05:04 2022] DELETE /identity/v3/users/2a1fbe9893494a1da1a248d60563c7c3 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:06.457289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6558bed-f80e-4c1c-a129-04c6689f051f None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:06.457794 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6558bed-f80e-4c1c-a129-04c6689f051f None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:06.457905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6558bed-f80e-4c1c-a129-04c6689f051f None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:06.461613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 898/1791] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 09:05:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 09:05:06.471512 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0ec3d-bef9-4a26-9f8f-ec9e1d94d0f3 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:06.472059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0ec3d-bef9-4a26-9f8f-ec9e1d94d0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:06.472059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0ec3d-bef9-4a26-9f8f-ec9e1d94d0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:06.561611 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-8bb0ec3d-bef9-4a26-9f8f-ec9e1d94d0f3 None None] MFA Rules not processed for user `c30bc55c6a1348bb961f0d010422da87`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:06.573300 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-8bb0ec3d-bef9-4a26-9f8f-ec9e1d94d0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:06.846204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 894/1792] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 09:05:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:07.430312 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6558bed-f80e-4c1c-a129-04c6689f051f None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:07.432384 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e6558bed-f80e-4c1c-a129-04c6689f051f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:07.454109 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6558bed-f80e-4c1c-a129-04c6689f051f None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:07.463245 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91acd92-636d-4383-a021-e1efe3053539 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:07.465358 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91acd92-636d-4383-a021-e1efe3053539 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:07.466084 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91acd92-636d-4383-a021-e1efe3053539 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:07.471824 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91acd92-636d-4383-a021-e1efe3053539 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:07.485820 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91acd92-636d-4383-a021-e1efe3053539 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:07.488047 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91acd92-636d-4383-a021-e1efe3053539 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:07.507476 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 899/1793] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:07.571260 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0ec3d-bef9-4a26-9f8f-ec9e1d94d0f3 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:07.572713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-8bb0ec3d-bef9-4a26-9f8f-ec9e1d94d0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:07.689572 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:07.782942 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0ec3d-bef9-4a26-9f8f-ec9e1d94d0f3 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:07.789725 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb75dfe-9fb5-4ee1-9874-4282833a8bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:07.790670 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb75dfe-9fb5-4ee1-9874-4282833a8bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:07.791154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb75dfe-9fb5-4ee1-9874-4282833a8bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:07.791655 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb75dfe-9fb5-4ee1-9874-4282833a8bf7 admin admin] PATH_INFO: `/v3/users/525f18241f2741d08bc4e5d28f4ed8bd` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:07.793413 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb75dfe-9fb5-4ee1-9874-4282833a8bf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=525f18241f2741d08bc4e5d28f4ed8bd)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:07.796050 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb75dfe-9fb5-4ee1-9874-4282833a8bf7 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:07.896389 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-6bb75dfe-9fb5-4ee1-9874-4282833a8bf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '525f18241f2741d08bc4e5d28f4ed8bd'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:07.898476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-6bb75dfe-9fb5-4ee1-9874-4282833a8bf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '525f18241f2741d08bc4e5d28f4ed8bd'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:07.899556 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-6bb75dfe-9fb5-4ee1-9874-4282833a8bf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '525f18241f2741d08bc4e5d28f4ed8bd'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:07.920087 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-6bb75dfe-9fb5-4ee1-9874-4282833a8bf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '525f18241f2741d08bc4e5d28f4ed8bd'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:07.955498 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-6bb75dfe-9fb5-4ee1-9874-4282833a8bf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '525f18241f2741d08bc4e5d28f4ed8bd'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:07.980360 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 895/1794] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:05:07 2022] DELETE /identity/v3/users/525f18241f2741d08bc4e5d28f4ed8bd => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:07.985771 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04321ba-e175-4885-afb2-97b457d53dca None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:07.986425 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04321ba-e175-4885-afb2-97b457d53dca None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:07.986920 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04321ba-e175-4885-afb2-97b457d53dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:08.024846 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-e04321ba-e175-4885-afb2-97b457d53dca None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:08.029276 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e04321ba-e175-4885-afb2-97b457d53dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:08.203421 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 900/1795] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:08.245745 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb75dfe-9fb5-4ee1-9874-4282833a8bf7 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:08.247784 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-6bb75dfe-9fb5-4ee1-9874-4282833a8bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:08.410018 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb75dfe-9fb5-4ee1-9874-4282833a8bf7 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:08.414834 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cd015-bf8a-4d81-bc20-8fe7a175aff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:08.415698 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cd015-bf8a-4d81-bc20-8fe7a175aff6 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:08.416132 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cd015-bf8a-4d81-bc20-8fe7a175aff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:08.416591 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cd015-bf8a-4d81-bc20-8fe7a175aff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:08.431610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0cd015-bf8a-4d81-bc20-8fe7a175aff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:08.433170 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0cd015-bf8a-4d81-bc20-8fe7a175aff6 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:08.464503 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 896/1796] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:08.909646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04321ba-e175-4885-afb2-97b457d53dca None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:08.911451 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e04321ba-e175-4885-afb2-97b457d53dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:08.934216 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04321ba-e175-4885-afb2-97b457d53dca None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:08.959692 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f161eb-efeb-4dfd-a9fc-3a0d45f1c1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:08.960952 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f161eb-efeb-4dfd-a9fc-3a0d45f1c1d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:08.961518 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f161eb-efeb-4dfd-a9fc-3a0d45f1c1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:08.961959 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f161eb-efeb-4dfd-a9fc-3a0d45f1c1d5 admin admin] PATH_INFO: `/v3/projects/542fb09c6a254ebdad4d8ce06e50ebf4` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:08.963809 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f161eb-efeb-4dfd-a9fc-3a0d45f1c1d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=542fb09c6a254ebdad4d8ce06e50ebf4)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:08.972353 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f161eb-efeb-4dfd-a9fc-3a0d45f1c1d5 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:09.098304 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-00f161eb-efeb-4dfd-a9fc-3a0d45f1c1d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '542fb09c6a254ebdad4d8ce06e50ebf4', 'request_id': 'req-00f161eb-efeb-4dfd-a9fc-3a0d45f1c1d5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:09.126502 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-00f161eb-efeb-4dfd-a9fc-3a0d45f1c1d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '542fb09c6a254ebdad4d8ce06e50ebf4', 'request_id': 'req-00f161eb-efeb-4dfd-a9fc-3a0d45f1c1d5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:09.134960 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-00f161eb-efeb-4dfd-a9fc-3a0d45f1c1d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '542fb09c6a254ebdad4d8ce06e50ebf4', 'request_id': 'req-00f161eb-efeb-4dfd-a9fc-3a0d45f1c1d5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:09.155919 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-00f161eb-efeb-4dfd-a9fc-3a0d45f1c1d5 admin admin] The token cache is being invalidate because project 542fb09c6a254ebdad4d8ce06e50ebf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:05:09.156105 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-00f161eb-efeb-4dfd-a9fc-3a0d45f1c1d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:09.156869 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-00f161eb-efeb-4dfd-a9fc-3a0d45f1c1d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:09.159185 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 901/1797] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:05:08 2022] DELETE /identity/v3/projects/542fb09c6a254ebdad4d8ce06e50ebf4 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:09.171556 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171ce1b-3ecb-4486-810c-0b1b4eaa1e1e None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:09.172150 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171ce1b-3ecb-4486-810c-0b1b4eaa1e1e None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:09.172150 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171ce1b-3ecb-4486-810c-0b1b4eaa1e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:09.208034 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-7171ce1b-3ecb-4486-810c-0b1b4eaa1e1e None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:09.208034 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-7171ce1b-3ecb-4486-810c-0b1b4eaa1e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:09.296614 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:09.323714 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 897/1798] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:09.333234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d02cb-f7a5-49d4-95ea-07029d2d223a None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:09.333234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d02cb-f7a5-49d4-95ea-07029d2d223a None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:09.333234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d02cb-f7a5-49d4-95ea-07029d2d223a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:09.361090 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-c89d02cb-f7a5-49d4-95ea-07029d2d223a None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:09.363453 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c89d02cb-f7a5-49d4-95ea-07029d2d223a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:09.388128 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171ce1b-3ecb-4486-810c-0b1b4eaa1e1e None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:09.388409 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 902/1799] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:09.404584 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171ce1b-3ecb-4486-810c-0b1b4eaa1e1e None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:09.410124 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1895b-3204-46a5-a0cd-31ed637c777a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:09.411143 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1895b-3204-46a5-a0cd-31ed637c777a admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:09.411629 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1895b-3204-46a5-a0cd-31ed637c777a admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:09.413247 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1895b-3204-46a5-a0cd-31ed637c777a admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:09.414597 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1895b-3204-46a5-a0cd-31ed637c777a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:05:09.415193 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1895b-3204-46a5-a0cd-31ed637c777a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:09.417164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1895b-3204-46a5-a0cd-31ed637c777a admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:09.434012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 898/1800] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:05:09.438771 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d02cb-f7a5-49d4-95ea-07029d2d223a None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:09.458468 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d02cb-f7a5-49d4-95ea-07029d2d223a None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:09.474224 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b5df6-3046-472f-b3e8-e7a058374878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:09.476407 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b5df6-3046-472f-b3e8-e7a058374878 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:09.476698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b5df6-3046-472f-b3e8-e7a058374878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:09.478642 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b5df6-3046-472f-b3e8-e7a058374878 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:09.479275 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b5df6-3046-472f-b3e8-e7a058374878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:09.493468 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b5df6-3046-472f-b3e8-e7a058374878 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:09.606054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 903/1801] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:05:09 2022] POST /identity/v3/projects => generated 367 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:09.610084 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1895b-3204-46a5-a0cd-31ed637c777a admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:09.627495 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1895b-3204-46a5-a0cd-31ed637c777a admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:09.799142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a705c6-a9f2-4183-8c11-13c2495e78e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:09.800491 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a705c6-a9f2-4183-8c11-13c2495e78e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:09.801047 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a705c6-a9f2-4183-8c11-13c2495e78e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:09.801563 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a705c6-a9f2-4183-8c11-13c2495e78e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:09.803988 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a705c6-a9f2-4183-8c11-13c2495e78e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:09.806342 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a705c6-a9f2-4183-8c11-13c2495e78e8 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:09.845550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 899/1802] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:05:09 2022] POST /identity/v3/users => generated 284 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:05:09.851888 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b5df6-3046-472f-b3e8-e7a058374878 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:09.858752 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:09.880541 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b5df6-3046-472f-b3e8-e7a058374878 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:09.903982 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289af98-984c-4334-aef4-32223e4d727b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:09.903982 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289af98-984c-4334-aef4-32223e4d727b admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:09.903982 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289af98-984c-4334-aef4-32223e4d727b admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:09.903982 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289af98-984c-4334-aef4-32223e4d727b admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:09.904487 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289af98-984c-4334-aef4-32223e4d727b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:09.905185 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289af98-984c-4334-aef4-32223e4d727b admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:09.945716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a705c6-a9f2-4183-8c11-13c2495e78e8 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:09.946497 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 904/1803] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:09.961119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a705c6-a9f2-4183-8c11-13c2495e78e8 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:09.969294 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d359548-fdd9-4b3f-8fbd-282e80bf0708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:09.971270 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d359548-fdd9-4b3f-8fbd-282e80bf0708 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:09.971910 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d359548-fdd9-4b3f-8fbd-282e80bf0708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:09.972419 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d359548-fdd9-4b3f-8fbd-282e80bf0708 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:09.973621 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d359548-fdd9-4b3f-8fbd-282e80bf0708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:09.985342 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d359548-fdd9-4b3f-8fbd-282e80bf0708 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:10.020597 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289af98-984c-4334-aef4-32223e4d727b admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:10.034110 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 900/1804] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:05:10.037776 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289af98-984c-4334-aef4-32223e4d727b admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:10.046974 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f3171-a7b2-4a73-97a1-72e7feecbb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:10.047972 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f3171-a7b2-4a73-97a1-72e7feecbb97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:10.048468 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f3171-a7b2-4a73-97a1-72e7feecbb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:10.048992 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f3171-a7b2-4a73-97a1-72e7feecbb97 admin admin] PATH_INFO: `/v3/projects/f0b572e44f964e6c9d8fff583c320f4b/users/a303cd5fd8a649d7846cebfc0443876b/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:10.108396 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f3171-a7b2-4a73-97a1-72e7feecbb97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b572e44f964e6c9d8fff583c320f4b, user_id=a303cd5fd8a649d7846cebfc0443876b, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:10.111420 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f3171-a7b2-4a73-97a1-72e7feecbb97 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:10.163437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 905/1805] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:10 2022] PUT /identity/v3/projects/f0b572e44f964e6c9d8fff583c320f4b/users/a303cd5fd8a649d7846cebfc0443876b/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:10.165444 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d064cf-02aa-4f21-b096-457a8cce92cd None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:10.165444 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d064cf-02aa-4f21-b096-457a8cce92cd None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:10.165718 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d064cf-02aa-4f21-b096-457a8cce92cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:10.221067 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-f7d064cf-02aa-4f21-b096-457a8cce92cd None None] MFA Rules not processed for user `a303cd5fd8a649d7846cebfc0443876b`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:10.222357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-f7d064cf-02aa-4f21-b096-457a8cce92cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:10.370708 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 901/1806] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:10.379020 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f3171-a7b2-4a73-97a1-72e7feecbb97 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:10.565491 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f3171-a7b2-4a73-97a1-72e7feecbb97 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:10.587040 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b3cfc-2f5c-40aa-97f8-5ad5ee07c668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:10.590059 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b3cfc-2f5c-40aa-97f8-5ad5ee07c668 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:10.590919 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b3cfc-2f5c-40aa-97f8-5ad5ee07c668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:10.592339 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b3cfc-2f5c-40aa-97f8-5ad5ee07c668 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:10.610664 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b3cfc-2f5c-40aa-97f8-5ad5ee07c668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:10.624102 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b3cfc-2f5c-40aa-97f8-5ad5ee07c668 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:10.684250 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d064cf-02aa-4f21-b096-457a8cce92cd None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:10.712148 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 906/1807] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:05:10 2022] POST /identity/v3/projects => generated 369 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:10.712251 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d064cf-02aa-4f21-b096-457a8cce92cd None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:10.819113 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:10.842860 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da860a0-15fd-4380-be71-b21bb4efd829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:10.844086 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da860a0-15fd-4380-be71-b21bb4efd829 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:10.844635 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da860a0-15fd-4380-be71-b21bb4efd829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:10.845046 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da860a0-15fd-4380-be71-b21bb4efd829 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:10.845931 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da860a0-15fd-4380-be71-b21bb4efd829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:10.851308 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da860a0-15fd-4380-be71-b21bb4efd829 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:10.891177 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 902/1808] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:05:10 2022] POST /identity/v3/users => generated 291 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:10.904001 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b3cfc-2f5c-40aa-97f8-5ad5ee07c668 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:10.967428 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b3cfc-2f5c-40aa-97f8-5ad5ee07c668 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:10.976354 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f21471-e526-499f-9a9c-b5249a64f681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:10.977415 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f21471-e526-499f-9a9c-b5249a64f681 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:10.981499 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f21471-e526-499f-9a9c-b5249a64f681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:10.982868 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f21471-e526-499f-9a9c-b5249a64f681 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:10.984057 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f21471-e526-499f-9a9c-b5249a64f681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:10.987790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f21471-e526-499f-9a9c-b5249a64f681 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:11.012314 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 907/1809] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:11.012477 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da860a0-15fd-4380-be71-b21bb4efd829 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:11.031424 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da860a0-15fd-4380-be71-b21bb4efd829 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:11.047208 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090da79-5ede-4cfd-9121-50da6446ccc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:11.056002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090da79-5ede-4cfd-9121-50da6446ccc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:11.056002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090da79-5ede-4cfd-9121-50da6446ccc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:11.056002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090da79-5ede-4cfd-9121-50da6446ccc9 admin admin] PATH_INFO: `/v3/projects/398f9d1fec4c49f2b35ff7c94c9658f7/users/c115de2c762e4399a8d47e543ff96dbc/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:11.076494 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090da79-5ede-4cfd-9121-50da6446ccc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=398f9d1fec4c49f2b35ff7c94c9658f7, user_id=c115de2c762e4399a8d47e543ff96dbc, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:11.081007 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090da79-5ede-4cfd-9121-50da6446ccc9 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:11.111696 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 903/1810] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:11 2022] PUT /identity/v3/projects/398f9d1fec4c49f2b35ff7c94c9658f7/users/c115de2c762e4399a8d47e543ff96dbc/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:11.116449 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f21471-e526-499f-9a9c-b5249a64f681 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:11.135823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f21471-e526-499f-9a9c-b5249a64f681 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:11.278573 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090da79-5ede-4cfd-9121-50da6446ccc9 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:11.280530 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-f090da79-5ede-4cfd-9121-50da6446ccc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:11.341151 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1848f34-51f1-4b7d-82e3-6fe6bcbb16b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:11.344525 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1848f34-51f1-4b7d-82e3-6fe6bcbb16b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:11.350297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1848f34-51f1-4b7d-82e3-6fe6bcbb16b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:11.354438 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1848f34-51f1-4b7d-82e3-6fe6bcbb16b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:11.355306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1848f34-51f1-4b7d-82e3-6fe6bcbb16b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:11.356956 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1848f34-51f1-4b7d-82e3-6fe6bcbb16b1 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:11.403499 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 908/1811] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:11.407359 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1848f34-51f1-4b7d-82e3-6fe6bcbb16b1 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:11.436219 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1848f34-51f1-4b7d-82e3-6fe6bcbb16b1 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:11.454769 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94599c2c-cc43-4f5d-aaea-46445d38ed08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:11.459689 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94599c2c-cc43-4f5d-aaea-46445d38ed08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:11.459988 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94599c2c-cc43-4f5d-aaea-46445d38ed08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:11.460249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94599c2c-cc43-4f5d-aaea-46445d38ed08 admin admin] PATH_INFO: `/v3/projects/398f9d1fec4c49f2b35ff7c94c9658f7/users/c115de2c762e4399a8d47e543ff96dbc/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:11.467605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94599c2c-cc43-4f5d-aaea-46445d38ed08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=398f9d1fec4c49f2b35ff7c94c9658f7, user_id=c115de2c762e4399a8d47e543ff96dbc, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:11.470414 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94599c2c-cc43-4f5d-aaea-46445d38ed08 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:11.520858 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090da79-5ede-4cfd-9121-50da6446ccc9 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:11.533223 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 909/1812] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:11 2022] PUT /identity/v3/projects/398f9d1fec4c49f2b35ff7c94c9658f7/users/c115de2c762e4399a8d47e543ff96dbc/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:11.534857 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660e0b3-8c7e-4687-8b70-26ff49232667 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:11.535697 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660e0b3-8c7e-4687-8b70-26ff49232667 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:11.535697 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660e0b3-8c7e-4687-8b70-26ff49232667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:11.602353 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-0660e0b3-8c7e-4687-8b70-26ff49232667 None None] MFA Rules not processed for user `c115de2c762e4399a8d47e543ff96dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:11.603476 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-0660e0b3-8c7e-4687-8b70-26ff49232667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:11.650734 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:11.694660 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e7233-53ba-447f-98e3-0ee53bd48b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:11.695337 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e7233-53ba-447f-98e3-0ee53bd48b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:11.695617 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e7233-53ba-447f-98e3-0ee53bd48b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:11.695892 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e7233-53ba-447f-98e3-0ee53bd48b25 admin admin] PATH_INFO: `/v3/users/ec8b9371831a4ebab41ebcee9f2a6d12` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:11.699318 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e7233-53ba-447f-98e3-0ee53bd48b25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec8b9371831a4ebab41ebcee9f2a6d12)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:11.701321 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e7233-53ba-447f-98e3-0ee53bd48b25 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:11.821409 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-fc9e7233-53ba-447f-98e3-0ee53bd48b25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec8b9371831a4ebab41ebcee9f2a6d12'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:11.822662 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-fc9e7233-53ba-447f-98e3-0ee53bd48b25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec8b9371831a4ebab41ebcee9f2a6d12'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:11.823388 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-fc9e7233-53ba-447f-98e3-0ee53bd48b25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec8b9371831a4ebab41ebcee9f2a6d12'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:11.833712 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 910/1813] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:11 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:11.847742 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660e0b3-8c7e-4687-8b70-26ff49232667 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:11.848903 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-fc9e7233-53ba-447f-98e3-0ee53bd48b25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec8b9371831a4ebab41ebcee9f2a6d12'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:11.850165 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-0660e0b3-8c7e-4687-8b70-26ff49232667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:11.877178 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:11.897865 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-fc9e7233-53ba-447f-98e3-0ee53bd48b25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec8b9371831a4ebab41ebcee9f2a6d12'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:11.926494 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 904/1814] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:05:11 2022] DELETE /identity/v3/users/ec8b9371831a4ebab41ebcee9f2a6d12 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:11.942896 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e4527-5c08-4391-aede-d8202da1a291 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:11.943812 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e4527-5c08-4391-aede-d8202da1a291 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:11.947386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e4527-5c08-4391-aede-d8202da1a291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:11.998052 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660e0b3-8c7e-4687-8b70-26ff49232667 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:12.006683 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-197e4527-5c08-4391-aede-d8202da1a291 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:12.008008 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-197e4527-5c08-4391-aede-d8202da1a291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:12.093299 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d331a-52a6-49da-88b4-8e751ee11bc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:12.094772 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d331a-52a6-49da-88b4-8e751ee11bc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:12.095061 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d331a-52a6-49da-88b4-8e751ee11bc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:12.095343 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d331a-52a6-49da-88b4-8e751ee11bc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:12.097576 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-855d331a-52a6-49da-88b4-8e751ee11bc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:12.103012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 905/1815] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:12.164968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e4527-5c08-4391-aede-d8202da1a291 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:12.169861 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-197e4527-5c08-4391-aede-d8202da1a291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:12.185760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d331a-52a6-49da-88b4-8e751ee11bc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:12.188112 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d331a-52a6-49da-88b4-8e751ee11bc3 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:12.205262 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 911/1816] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:11 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:05:12.265306 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e4527-5c08-4391-aede-d8202da1a291 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:12.270986 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ea753-2f00-4a14-b6bc-af37a8672127 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:12.271480 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ea753-2f00-4a14-b6bc-af37a8672127 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:12.271872 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ea753-2f00-4a14-b6bc-af37a8672127 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:12.272140 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ea753-2f00-4a14-b6bc-af37a8672127 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:12.283213 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ea753-2f00-4a14-b6bc-af37a8672127 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:12.284702 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ea753-2f00-4a14-b6bc-af37a8672127 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:12.313279 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 906/1817] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:05:12.319564 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d331a-52a6-49da-88b4-8e751ee11bc3 service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:12.321210 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-855d331a-52a6-49da-88b4-8e751ee11bc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:12.336084 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d331a-52a6-49da-88b4-8e751ee11bc3 service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:12.340547 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de581118-bbfc-4907-9623-01219f8844a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:12.341835 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de581118-bbfc-4907-9623-01219f8844a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:12.341835 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de581118-bbfc-4907-9623-01219f8844a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:12.342119 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de581118-bbfc-4907-9623-01219f8844a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:12.345322 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-de581118-bbfc-4907-9623-01219f8844a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:12.365397 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:12.416442 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b74fb7-31b6-4938-bc28-41425587aa4a None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:12.417254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b74fb7-31b6-4938-bc28-41425587aa4a None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:12.417754 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b74fb7-31b6-4938-bc28-41425587aa4a None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:12.420015 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 907/1818] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 09:05:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 09:05:12.468504 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de581118-bbfc-4907-9623-01219f8844a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:12.470934 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de581118-bbfc-4907-9623-01219f8844a1 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:12.485655 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 912/1819] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:12 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:12.500878 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359aba5-db13-4b12-ab91-fd03a9a1f106 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:12.501207 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359aba5-db13-4b12-ab91-fd03a9a1f106 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:12.501428 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359aba5-db13-4b12-ab91-fd03a9a1f106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:12.522794 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de581118-bbfc-4907-9623-01219f8844a1 service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:12.524722 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-de581118-bbfc-4907-9623-01219f8844a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:12.551182 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de581118-bbfc-4907-9623-01219f8844a1 service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:12.552457 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-2359aba5-db13-4b12-ab91-fd03a9a1f106 None None] MFA Rules not processed for user `c30bc55c6a1348bb961f0d010422da87`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:12.555669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-2359aba5-db13-4b12-ab91-fd03a9a1f106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:12.565807 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c23f30-c303-49d3-93ad-8f870c721094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:12.570333 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c23f30-c303-49d3-93ad-8f870c721094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:12.570892 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c23f30-c303-49d3-93ad-8f870c721094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:12.573861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c23f30-c303-49d3-93ad-8f870c721094 admin admin] PATH_INFO: `/v3/projects/50386e06738d40cfb351b607f1f442a4` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:12.576440 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c23f30-c303-49d3-93ad-8f870c721094 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50386e06738d40cfb351b607f1f442a4)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:12.580955 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c23f30-c303-49d3-93ad-8f870c721094 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:12.725909 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a4c23f30-c303-49d3-93ad-8f870c721094 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50386e06738d40cfb351b607f1f442a4', 'request_id': 'req-a4c23f30-c303-49d3-93ad-8f870c721094'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:12.739888 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a4c23f30-c303-49d3-93ad-8f870c721094 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50386e06738d40cfb351b607f1f442a4', 'request_id': 'req-a4c23f30-c303-49d3-93ad-8f870c721094'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:12.794452 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a4c23f30-c303-49d3-93ad-8f870c721094 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50386e06738d40cfb351b607f1f442a4', 'request_id': 'req-a4c23f30-c303-49d3-93ad-8f870c721094'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:12.835388 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a4c23f30-c303-49d3-93ad-8f870c721094 admin admin] The token cache is being invalidate because project 50386e06738d40cfb351b607f1f442a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:05:12.838742 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a4c23f30-c303-49d3-93ad-8f870c721094 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:12.839091 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 908/1820] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 09:05:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:12.841080 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a4c23f30-c303-49d3-93ad-8f870c721094 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:12.844214 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 913/1821] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:05:12 2022] DELETE /identity/v3/projects/50386e06738d40cfb351b607f1f442a4 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:12.848724 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359aba5-db13-4b12-ab91-fd03a9a1f106 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:12.870086 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359aba5-db13-4b12-ab91-fd03a9a1f106 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:12.913846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:13.069427 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea9ac7-3be6-45c9-837b-1afd2c90fa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:13.070095 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea9ac7-3be6-45c9-837b-1afd2c90fa30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:13.070394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea9ac7-3be6-45c9-837b-1afd2c90fa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:13.070666 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea9ac7-3be6-45c9-837b-1afd2c90fa30 admin admin] PATH_INFO: `/v3/users/1a5f91c258f941c8a7f952e5bfe558be` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:13.079141 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea9ac7-3be6-45c9-837b-1afd2c90fa30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a5f91c258f941c8a7f952e5bfe558be)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:13.086021 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea9ac7-3be6-45c9-837b-1afd2c90fa30 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:13.234250 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-efea9ac7-3be6-45c9-837b-1afd2c90fa30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a5f91c258f941c8a7f952e5bfe558be'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:13.241002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-efea9ac7-3be6-45c9-837b-1afd2c90fa30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a5f91c258f941c8a7f952e5bfe558be'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:13.244029 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-efea9ac7-3be6-45c9-837b-1afd2c90fa30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a5f91c258f941c8a7f952e5bfe558be'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:13.265830 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-efea9ac7-3be6-45c9-837b-1afd2c90fa30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a5f91c258f941c8a7f952e5bfe558be'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:13.351904 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-efea9ac7-3be6-45c9-837b-1afd2c90fa30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a5f91c258f941c8a7f952e5bfe558be'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:13.381694 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 909/1822] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:05:12 2022] DELETE /identity/v3/users/1a5f91c258f941c8a7f952e5bfe558be => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:13.512096 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c23f30-c303-49d3-93ad-8f870c721094 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:13.513773 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a4c23f30-c303-49d3-93ad-8f870c721094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:13.638711 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c23f30-c303-49d3-93ad-8f870c721094 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:13.684065 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:13.764722 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d89225-66d9-4ed3-93bc-24d9ff90a1d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:13.765334 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d89225-66d9-4ed3-93bc-24d9ff90a1d0 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:13.765614 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d89225-66d9-4ed3-93bc-24d9ff90a1d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:13.766445 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d89225-66d9-4ed3-93bc-24d9ff90a1d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:13.768429 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-52d89225-66d9-4ed3-93bc-24d9ff90a1d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:13.797938 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d89225-66d9-4ed3-93bc-24d9ff90a1d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:13.799927 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d89225-66d9-4ed3-93bc-24d9ff90a1d0 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:13.814533 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 914/1823] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:05:14.242795 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea9ac7-3be6-45c9-837b-1afd2c90fa30 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:14.244246 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-efea9ac7-3be6-45c9-837b-1afd2c90fa30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:14.345313 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea9ac7-3be6-45c9-837b-1afd2c90fa30 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:14.352483 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052ae4e-d3fc-4e16-a0f9-1f76497c30f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:14.353154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052ae4e-d3fc-4e16-a0f9-1f76497c30f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:14.353603 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052ae4e-d3fc-4e16-a0f9-1f76497c30f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:14.354024 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052ae4e-d3fc-4e16-a0f9-1f76497c30f5 admin admin] PATH_INFO: `/v3/projects/b6bc49b952ca42f7a51a15035ce4e81b` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:14.355450 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052ae4e-d3fc-4e16-a0f9-1f76497c30f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6bc49b952ca42f7a51a15035ce4e81b)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:14.357781 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052ae4e-d3fc-4e16-a0f9-1f76497c30f5 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:14.432060 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:14.451107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-7052ae4e-d3fc-4e16-a0f9-1f76497c30f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6bc49b952ca42f7a51a15035ce4e81b', 'request_id': 'req-7052ae4e-d3fc-4e16-a0f9-1f76497c30f5'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:14.484254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-7052ae4e-d3fc-4e16-a0f9-1f76497c30f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6bc49b952ca42f7a51a15035ce4e81b', 'request_id': 'req-7052ae4e-d3fc-4e16-a0f9-1f76497c30f5'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:14.502933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-7052ae4e-d3fc-4e16-a0f9-1f76497c30f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6bc49b952ca42f7a51a15035ce4e81b', 'request_id': 'req-7052ae4e-d3fc-4e16-a0f9-1f76497c30f5'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:14.532819 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-7052ae4e-d3fc-4e16-a0f9-1f76497c30f5 admin admin] The token cache is being invalidate because project b6bc49b952ca42f7a51a15035ce4e81b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:05:14.533114 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-7052ae4e-d3fc-4e16-a0f9-1f76497c30f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:14.533802 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-7052ae4e-d3fc-4e16-a0f9-1f76497c30f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:14.535462 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 910/1824] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:05:14 2022] DELETE /identity/v3/projects/b6bc49b952ca42f7a51a15035ce4e81b => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:14.539424 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d89225-66d9-4ed3-93bc-24d9ff90a1d0 service nova] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:14.553407 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d89225-66d9-4ed3-93bc-24d9ff90a1d0 service nova] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:14.688931 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f371a-0629-40a9-8832-5750d461c726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:14.689636 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f371a-0629-40a9-8832-5750d461c726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:14.692894 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f371a-0629-40a9-8832-5750d461c726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:14.693514 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f371a-0629-40a9-8832-5750d461c726 admin admin] PATH_INFO: `/v3/users/562bfc6fb9bd44e4bed8c870429cb4ab` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:14.695478 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f371a-0629-40a9-8832-5750d461c726 admin admin] RBAC: Authorizing `identity:delete_user(user_id=562bfc6fb9bd44e4bed8c870429cb4ab)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:14.698499 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f371a-0629-40a9-8832-5750d461c726 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:14.776589 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052ae4e-d3fc-4e16-a0f9-1f76497c30f5 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:14.779429 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-7052ae4e-d3fc-4e16-a0f9-1f76497c30f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:14.817286 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052ae4e-d3fc-4e16-a0f9-1f76497c30f5 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:14.823229 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b66f371a-0629-40a9-8832-5750d461c726 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '562bfc6fb9bd44e4bed8c870429cb4ab'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:14.825650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1718860-5f51-423b-93be-31a0c7549df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:14.827103 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1718860-5f51-423b-93be-31a0c7549df8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:14.827718 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1718860-5f51-423b-93be-31a0c7549df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:14.828079 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1718860-5f51-423b-93be-31a0c7549df8 admin admin] PATH_INFO: `/v3/projects/065d6a33fd224c60b104d8be05fe1fa6` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:14.829616 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1718860-5f51-423b-93be-31a0c7549df8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=065d6a33fd224c60b104d8be05fe1fa6)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:14.832831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1718860-5f51-423b-93be-31a0c7549df8 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:14.842861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b66f371a-0629-40a9-8832-5750d461c726 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '562bfc6fb9bd44e4bed8c870429cb4ab'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:14.843475 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b66f371a-0629-40a9-8832-5750d461c726 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '562bfc6fb9bd44e4bed8c870429cb4ab'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:14.868827 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b66f371a-0629-40a9-8832-5750d461c726 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '562bfc6fb9bd44e4bed8c870429cb4ab'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:14.869777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b66f371a-0629-40a9-8832-5750d461c726 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '562bfc6fb9bd44e4bed8c870429cb4ab'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:14.894946 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 915/1825] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:05:14 2022] DELETE /identity/v3/users/562bfc6fb9bd44e4bed8c870429cb4ab => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:14.917685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-a1718860-5f51-423b-93be-31a0c7549df8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '065d6a33fd224c60b104d8be05fe1fa6', 'request_id': 'req-a1718860-5f51-423b-93be-31a0c7549df8'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:14.936871 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-a1718860-5f51-423b-93be-31a0c7549df8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '065d6a33fd224c60b104d8be05fe1fa6', 'request_id': 'req-a1718860-5f51-423b-93be-31a0c7549df8'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:14.978374 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-a1718860-5f51-423b-93be-31a0c7549df8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '065d6a33fd224c60b104d8be05fe1fa6', 'request_id': 'req-a1718860-5f51-423b-93be-31a0c7549df8'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:15.022499 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-a1718860-5f51-423b-93be-31a0c7549df8 admin admin] The token cache is being invalidate because project 065d6a33fd224c60b104d8be05fe1fa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:05:15.027660 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-a1718860-5f51-423b-93be-31a0c7549df8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:15.029159 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-a1718860-5f51-423b-93be-31a0c7549df8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:15.042894 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 911/1826] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:05:14 2022] DELETE /identity/v3/projects/065d6a33fd224c60b104d8be05fe1fa6 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:05:15.050582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f371a-0629-40a9-8832-5750d461c726 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:15.052109 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b66f371a-0629-40a9-8832-5750d461c726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:15.153834 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:15.194475 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f371a-0629-40a9-8832-5750d461c726 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:15.200702 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfdfc5-ead2-4c1f-82de-0d60690aaad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:15.201762 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfdfc5-ead2-4c1f-82de-0d60690aaad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:15.202264 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfdfc5-ead2-4c1f-82de-0d60690aaad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:15.202815 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfdfc5-ead2-4c1f-82de-0d60690aaad8 admin admin] PATH_INFO: `/v3/users/e921d08e997745928b4c9aee514ef8c8` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:15.204720 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfdfc5-ead2-4c1f-82de-0d60690aaad8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e921d08e997745928b4c9aee514ef8c8)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:15.207337 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfdfc5-ead2-4c1f-82de-0d60690aaad8 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:15.319713 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f8bfdfc5-ead2-4c1f-82de-0d60690aaad8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e921d08e997745928b4c9aee514ef8c8'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:15.328694 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f8bfdfc5-ead2-4c1f-82de-0d60690aaad8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e921d08e997745928b4c9aee514ef8c8'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:15.329722 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f8bfdfc5-ead2-4c1f-82de-0d60690aaad8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e921d08e997745928b4c9aee514ef8c8'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:15.345672 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f8bfdfc5-ead2-4c1f-82de-0d60690aaad8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e921d08e997745928b4c9aee514ef8c8'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:15.346629 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f8bfdfc5-ead2-4c1f-82de-0d60690aaad8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e921d08e997745928b4c9aee514ef8c8'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:15.372856 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 916/1827] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:05:15 2022] DELETE /identity/v3/users/e921d08e997745928b4c9aee514ef8c8 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:15.670224 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1718860-5f51-423b-93be-31a0c7549df8 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:15.672430 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-a1718860-5f51-423b-93be-31a0c7549df8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:15.776082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1718860-5f51-423b-93be-31a0c7549df8 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:15.856311 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:15.864275 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48722f86-f404-468e-a228-36fd77843391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:15.864981 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48722f86-f404-468e-a228-36fd77843391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:15.865255 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48722f86-f404-468e-a228-36fd77843391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:15.866075 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48722f86-f404-468e-a228-36fd77843391 admin admin] PATH_INFO: `/v3/projects/3a068f590dcb4808adfe0379ae1fe19d` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:15.867790 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48722f86-f404-468e-a228-36fd77843391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a068f590dcb4808adfe0379ae1fe19d)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:15.870810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48722f86-f404-468e-a228-36fd77843391 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:15.946086 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfdfc5-ead2-4c1f-82de-0d60690aaad8 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:15.946732 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-48722f86-f404-468e-a228-36fd77843391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a068f590dcb4808adfe0379ae1fe19d', 'request_id': 'req-48722f86-f404-468e-a228-36fd77843391'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:15.946900 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f8bfdfc5-ead2-4c1f-82de-0d60690aaad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:15.948039 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-48722f86-f404-468e-a228-36fd77843391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a068f590dcb4808adfe0379ae1fe19d', 'request_id': 'req-48722f86-f404-468e-a228-36fd77843391'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:15.966246 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-48722f86-f404-468e-a228-36fd77843391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a068f590dcb4808adfe0379ae1fe19d', 'request_id': 'req-48722f86-f404-468e-a228-36fd77843391'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:15.982462 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfdfc5-ead2-4c1f-82de-0d60690aaad8 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:15.995843 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-48722f86-f404-468e-a228-36fd77843391 admin admin] The token cache is being invalidate because project 3a068f590dcb4808adfe0379ae1fe19d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:05:15.996240 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-48722f86-f404-468e-a228-36fd77843391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:15.996919 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-48722f86-f404-468e-a228-36fd77843391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:16.001962 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 912/1828] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:05:15 2022] DELETE /identity/v3/projects/3a068f590dcb4808adfe0379ae1fe19d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:16.010708 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be7cd8-8197-41e5-aceb-9f387c279a09 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:16.011072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be7cd8-8197-41e5-aceb-9f387c279a09 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:16.011855 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be7cd8-8197-41e5-aceb-9f387c279a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:16.041750 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-86be7cd8-8197-41e5-aceb-9f387c279a09 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:16.043134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-86be7cd8-8197-41e5-aceb-9f387c279a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:16.078364 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66e963-87ea-4b46-9f11-51d724ce0580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:16.079102 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66e963-87ea-4b46-9f11-51d724ce0580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:16.079635 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66e963-87ea-4b46-9f11-51d724ce0580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:16.079912 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66e963-87ea-4b46-9f11-51d724ce0580 admin admin] PATH_INFO: `/v3/projects/7037b61511d4444e9ed0fcf5208b533b` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:16.081090 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66e963-87ea-4b46-9f11-51d724ce0580 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7037b61511d4444e9ed0fcf5208b533b)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:16.083191 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66e963-87ea-4b46-9f11-51d724ce0580 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:16.127357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 913/1829] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:16.130156 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7cad3-9d18-4e2c-8011-fd2ddf61988b None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:16.130537 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7cad3-9d18-4e2c-8011-fd2ddf61988b None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:16.131396 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7cad3-9d18-4e2c-8011-fd2ddf61988b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:16.149982 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-6c66e963-87ea-4b46-9f11-51d724ce0580 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7037b61511d4444e9ed0fcf5208b533b', 'request_id': 'req-6c66e963-87ea-4b46-9f11-51d724ce0580'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:16.153686 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-cce7cad3-9d18-4e2c-8011-fd2ddf61988b None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:16.154933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-cce7cad3-9d18-4e2c-8011-fd2ddf61988b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:16.157924 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-6c66e963-87ea-4b46-9f11-51d724ce0580 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7037b61511d4444e9ed0fcf5208b533b', 'request_id': 'req-6c66e963-87ea-4b46-9f11-51d724ce0580'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:16.168110 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:16.171020 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-6c66e963-87ea-4b46-9f11-51d724ce0580 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7037b61511d4444e9ed0fcf5208b533b', 'request_id': 'req-6c66e963-87ea-4b46-9f11-51d724ce0580'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:16.192148 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-6c66e963-87ea-4b46-9f11-51d724ce0580 admin admin] The token cache is being invalidate because project 7037b61511d4444e9ed0fcf5208b533b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:05:16.192445 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-6c66e963-87ea-4b46-9f11-51d724ce0580 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:16.193109 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-6c66e963-87ea-4b46-9f11-51d724ce0580 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:16.195503 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 917/1830] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:05:15 2022] DELETE /identity/v3/projects/7037b61511d4444e9ed0fcf5208b533b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:16.203078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b00c9-501c-4ee5-9cc9-962243e5e4bf None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:16.203383 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b00c9-501c-4ee5-9cc9-962243e5e4bf None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:16.203668 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b00c9-501c-4ee5-9cc9-962243e5e4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:16.227947 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-4f5b00c9-501c-4ee5-9cc9-962243e5e4bf None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:16.228722 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4f5b00c9-501c-4ee5-9cc9-962243e5e4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:16.239905 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 914/1831] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:05:16.244802 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7cad3-9d18-4e2c-8011-fd2ddf61988b None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:16.245415 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 918/1832] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:16.253570 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240acb8-1e31-4fd3-8802-0c59c4911240 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:16.253869 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240acb8-1e31-4fd3-8802-0c59c4911240 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:16.254125 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240acb8-1e31-4fd3-8802-0c59c4911240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:16.256743 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7cad3-9d18-4e2c-8011-fd2ddf61988b None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:16.264921 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c159a-5df9-49d4-b98f-c4bcf4b6efa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:16.265073 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c159a-5df9-49d4-b98f-c4bcf4b6efa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:16.265337 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c159a-5df9-49d4-b98f-c4bcf4b6efa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:16.265729 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c159a-5df9-49d4-b98f-c4bcf4b6efa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:16.266479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c159a-5df9-49d4-b98f-c4bcf4b6efa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:05:16.266840 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c159a-5df9-49d4-b98f-c4bcf4b6efa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:16.268527 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c159a-5df9-49d4-b98f-c4bcf4b6efa1 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:16.275976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-6240acb8-1e31-4fd3-8802-0c59c4911240 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:16.277228 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6240acb8-1e31-4fd3-8802-0c59c4911240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:16.282852 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 915/1833] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 09:05:16.287169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c159a-5df9-49d4-b98f-c4bcf4b6efa1 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:16.290163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 919/1834] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:05:16.294421 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240acb8-1e31-4fd3-8802-0c59c4911240 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:16.300245 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c159a-5df9-49d4-b98f-c4bcf4b6efa1 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:16.304053 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240acb8-1e31-4fd3-8802-0c59c4911240 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:16.307355 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881922c-d000-408b-b1be-bf95e80c3092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:16.307986 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881922c-d000-408b-b1be-bf95e80c3092 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:16.308266 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881922c-d000-408b-b1be-bf95e80c3092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:16.308548 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881922c-d000-408b-b1be-bf95e80c3092 admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:16.309092 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b2aea-4d7c-459a-b68a-943f4a0a8030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:16.309351 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881922c-d000-408b-b1be-bf95e80c3092 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:16.309728 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b2aea-4d7c-459a-b68a-943f4a0a8030 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:16.310013 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b2aea-4d7c-459a-b68a-943f4a0a8030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:16.310293 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b2aea-4d7c-459a-b68a-943f4a0a8030 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:16.311043 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b2aea-4d7c-459a-b68a-943f4a0a8030 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:05:16.311307 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881922c-d000-408b-b1be-bf95e80c3092 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:16.311422 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b2aea-4d7c-459a-b68a-943f4a0a8030 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:16.312936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b2aea-4d7c-459a-b68a-943f4a0a8030 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:16.326431 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:16.331743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 920/1835] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 09:05:16.340251 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b2aea-4d7c-459a-b68a-943f4a0a8030 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:16.351653 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 916/1836] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:05:16 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:05:16.355842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881922c-d000-408b-b1be-bf95e80c3092 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:16.358733 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b2aea-4d7c-459a-b68a-943f4a0a8030 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:16.425493 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e155ced-b0c4-4c83-bdb6-d9cbf77d7ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:16.426238 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e155ced-b0c4-4c83-bdb6-d9cbf77d7ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:16.426552 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e155ced-b0c4-4c83-bdb6-d9cbf77d7ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:16.426859 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e155ced-b0c4-4c83-bdb6-d9cbf77d7ab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:16.427552 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e155ced-b0c4-4c83-bdb6-d9cbf77d7ab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:16.429721 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e155ced-b0c4-4c83-bdb6-d9cbf77d7ab3 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:16.443689 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881922c-d000-408b-b1be-bf95e80c3092 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:16.449247 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc46f7-7af4-4e41-853d-8bf6da0d7e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:16.449965 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc46f7-7af4-4e41-853d-8bf6da0d7e5c admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:16.450303 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc46f7-7af4-4e41-853d-8bf6da0d7e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:16.450902 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc46f7-7af4-4e41-853d-8bf6da0d7e5c admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:16.451591 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc46f7-7af4-4e41-853d-8bf6da0d7e5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:16.454179 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc46f7-7af4-4e41-853d-8bf6da0d7e5c admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:16.462597 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 921/1837] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:05:16 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:16.466792 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e155ced-b0c4-4c83-bdb6-d9cbf77d7ab3 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:16.482513 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 917/1838] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:05:16 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:05:16.486164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc46f7-7af4-4e41-853d-8bf6da0d7e5c admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:16.498244 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc46f7-7af4-4e41-853d-8bf6da0d7e5c admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:16.557472 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e155ced-b0c4-4c83-bdb6-d9cbf77d7ab3 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:16.562742 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef85b3-99d5-445e-9af1-cea209fcfb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:16.563867 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef85b3-99d5-445e-9af1-cea209fcfb29 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:16.564159 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef85b3-99d5-445e-9af1-cea209fcfb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:16.564437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef85b3-99d5-445e-9af1-cea209fcfb29 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:16.565515 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef85b3-99d5-445e-9af1-cea209fcfb29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:16.568096 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef85b3-99d5-445e-9af1-cea209fcfb29 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:16.572653 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e27db7-37ae-4050-906c-f49c2b4ee779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:16.574630 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e27db7-37ae-4050-906c-f49c2b4ee779 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:16.575072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e27db7-37ae-4050-906c-f49c2b4ee779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:16.575501 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e27db7-37ae-4050-906c-f49c2b4ee779 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:16.577865 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e27db7-37ae-4050-906c-f49c2b4ee779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:16.579975 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e27db7-37ae-4050-906c-f49c2b4ee779 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:16.595756 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 922/1839] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:05:16 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:16.600052 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef85b3-99d5-445e-9af1-cea209fcfb29 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:16.613393 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef85b3-99d5-445e-9af1-cea209fcfb29 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:16.614737 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 918/1840] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:05:16.620580 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e27db7-37ae-4050-906c-f49c2b4ee779 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:16.620796 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076045d-1532-459e-abfb-f1a05d775112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:16.621393 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076045d-1532-459e-abfb-f1a05d775112 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:16.622169 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076045d-1532-459e-abfb-f1a05d775112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:16.622169 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076045d-1532-459e-abfb-f1a05d775112 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:16.622700 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076045d-1532-459e-abfb-f1a05d775112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:16.624394 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076045d-1532-459e-abfb-f1a05d775112 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:16.639647 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e27db7-37ae-4050-906c-f49c2b4ee779 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:16.642114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 923/1841] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:16.645963 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076045d-1532-459e-abfb-f1a05d775112 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:16.650569 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85663bff-3bb3-4696-9463-179c646f1496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:16.652301 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85663bff-3bb3-4696-9463-179c646f1496 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:16.652592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85663bff-3bb3-4696-9463-179c646f1496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:16.654993 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85663bff-3bb3-4696-9463-179c646f1496 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:16.658434 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85663bff-3bb3-4696-9463-179c646f1496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:16.660094 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85663bff-3bb3-4696-9463-179c646f1496 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:16.660792 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076045d-1532-459e-abfb-f1a05d775112 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:16.668586 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae43be-f735-4e34-96e8-d67668725509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:16.669317 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae43be-f735-4e34-96e8-d67668725509 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:16.670029 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae43be-f735-4e34-96e8-d67668725509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:16.670456 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae43be-f735-4e34-96e8-d67668725509 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:16.671243 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae43be-f735-4e34-96e8-d67668725509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:16.673408 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae43be-f735-4e34-96e8-d67668725509 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:16.690457 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 919/1842] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:16.691893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85663bff-3bb3-4696-9463-179c646f1496 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:16.704010 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85663bff-3bb3-4696-9463-179c646f1496 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:16.710430 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08f8d4-dcdb-4341-a148-31e4e2cf7860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:16.711289 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08f8d4-dcdb-4341-a148-31e4e2cf7860 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:16.711575 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08f8d4-dcdb-4341-a148-31e4e2cf7860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:16.711923 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08f8d4-dcdb-4341-a148-31e4e2cf7860 admin admin] PATH_INFO: `/v3/projects/0e13312e5b2e411596dfe364477f2864/users/3c6a02443f6b4e08b7896e2ef9ed64b9/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:16.720660 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 924/1843] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:16.725426 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae43be-f735-4e34-96e8-d67668725509 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:16.735131 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08f8d4-dcdb-4341-a148-31e4e2cf7860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e13312e5b2e411596dfe364477f2864, user_id=3c6a02443f6b4e08b7896e2ef9ed64b9, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:16.740340 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08f8d4-dcdb-4341-a148-31e4e2cf7860 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:16.742539 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae43be-f735-4e34-96e8-d67668725509 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:16.747389 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba30f6-50a0-4c26-9d4e-f62afd642555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:16.748072 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba30f6-50a0-4c26-9d4e-f62afd642555 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:16.748379 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba30f6-50a0-4c26-9d4e-f62afd642555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:16.748633 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba30f6-50a0-4c26-9d4e-f62afd642555 admin admin] PATH_INFO: `/v3/projects/97c1a840d4164f529947ecabac60b542/users/0e3000deb12242a5a1c33098cc226077/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:16.764900 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:16.770501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba30f6-50a0-4c26-9d4e-f62afd642555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c1a840d4164f529947ecabac60b542, user_id=0e3000deb12242a5a1c33098cc226077, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:16.774045 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba30f6-50a0-4c26-9d4e-f62afd642555 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:16.777248 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 920/1844] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:16 2022] PUT /identity/v3/projects/0e13312e5b2e411596dfe364477f2864/users/3c6a02443f6b4e08b7896e2ef9ed64b9/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:16.781428 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b214b-1625-4d8e-848c-866593b74b57 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:16.781816 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b214b-1625-4d8e-848c-866593b74b57 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:16.782128 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b214b-1625-4d8e-848c-866593b74b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:16.802371 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 925/1845] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:16 2022] PUT /identity/v3/projects/97c1a840d4164f529947ecabac60b542/users/0e3000deb12242a5a1c33098cc226077/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:16.812152 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ab1a2-c6ae-417d-b6e7-3ff8136660a6 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:16.812721 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ab1a2-c6ae-417d-b6e7-3ff8136660a6 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:16.813164 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ab1a2-c6ae-417d-b6e7-3ff8136660a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:16.838838 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-8e2b214b-1625-4d8e-848c-866593b74b57 None None] MFA Rules not processed for user `3c6a02443f6b4e08b7896e2ef9ed64b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:16.840257 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-8e2b214b-1625-4d8e-848c-866593b74b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:16.877877 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-b18ab1a2-c6ae-417d-b6e7-3ff8136660a6 None None] MFA Rules not processed for user `0e3000deb12242a5a1c33098cc226077`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:16.879678 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b18ab1a2-c6ae-417d-b6e7-3ff8136660a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:16.884373 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:16.956190 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 921/1846] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:16.956628 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b214b-1625-4d8e-848c-866593b74b57 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:16.958520 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-8e2b214b-1625-4d8e-848c-866593b74b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:16.996113 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 926/1847] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:16.997174 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ab1a2-c6ae-417d-b6e7-3ff8136660a6 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:17.123550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b214b-1625-4d8e-848c-866593b74b57 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:17.126133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ab1a2-c6ae-417d-b6e7-3ff8136660a6 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:17.129479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17849d2f-c446-4194-ac6c-2e544716ef5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:17.130927 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17849d2f-c446-4194-ac6c-2e544716ef5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:17.132639 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17849d2f-c446-4194-ac6c-2e544716ef5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:17.133072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17849d2f-c446-4194-ac6c-2e544716ef5d admin admin] PATH_INFO: `/v3/users/a303cd5fd8a649d7846cebfc0443876b` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:17.134105 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26073aad-c36f-473f-9a0c-a87d56c6ce67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:17.134669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17849d2f-c446-4194-ac6c-2e544716ef5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a303cd5fd8a649d7846cebfc0443876b)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:17.134833 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26073aad-c36f-473f-9a0c-a87d56c6ce67 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:17.135124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26073aad-c36f-473f-9a0c-a87d56c6ce67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:17.135401 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26073aad-c36f-473f-9a0c-a87d56c6ce67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:17.136095 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26073aad-c36f-473f-9a0c-a87d56c6ce67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:17.137128 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17849d2f-c446-4194-ac6c-2e544716ef5d admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:17.138043 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26073aad-c36f-473f-9a0c-a87d56c6ce67 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:17.186248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 927/1848] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:05:16 2022] POST /identity/v3/projects => generated 373 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:17.187491 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26073aad-c36f-473f-9a0c-a87d56c6ce67 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:17.190438 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-26073aad-c36f-473f-9a0c-a87d56c6ce67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:17.223650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-17849d2f-c446-4194-ac6c-2e544716ef5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a303cd5fd8a649d7846cebfc0443876b'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:17.224785 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-17849d2f-c446-4194-ac6c-2e544716ef5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a303cd5fd8a649d7846cebfc0443876b'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:17.225582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-17849d2f-c446-4194-ac6c-2e544716ef5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a303cd5fd8a649d7846cebfc0443876b'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:17.237195 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-17849d2f-c446-4194-ac6c-2e544716ef5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a303cd5fd8a649d7846cebfc0443876b'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:17.266365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-17849d2f-c446-4194-ac6c-2e544716ef5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a303cd5fd8a649d7846cebfc0443876b'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:17.285213 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 922/1849] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:05:16 2022] DELETE /identity/v3/users/a303cd5fd8a649d7846cebfc0443876b => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:17.286493 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17849d2f-c446-4194-ac6c-2e544716ef5d admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:17.288385 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-17849d2f-c446-4194-ac6c-2e544716ef5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:17.335792 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26073aad-c36f-473f-9a0c-a87d56c6ce67 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:17.361365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:17.383221 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17849d2f-c446-4194-ac6c-2e544716ef5d admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:17.388810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c26ed1-e69c-46d7-bf22-b2bb9e8ad0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:17.389626 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c26ed1-e69c-46d7-bf22-b2bb9e8ad0c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:17.390006 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c26ed1-e69c-46d7-bf22-b2bb9e8ad0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:17.390279 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c26ed1-e69c-46d7-bf22-b2bb9e8ad0c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:17.391015 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c26ed1-e69c-46d7-bf22-b2bb9e8ad0c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:17.393301 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c26ed1-e69c-46d7-bf22-b2bb9e8ad0c8 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:17.411414 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:17.427803 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 923/1850] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:05:17 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:17.430239 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866af670-e25d-42f3-ace2-df5388cf9d88 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:17.430573 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866af670-e25d-42f3-ace2-df5388cf9d88 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:17.430964 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866af670-e25d-42f3-ace2-df5388cf9d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:17.480166 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-866af670-e25d-42f3-ace2-df5388cf9d88 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:17.481232 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8787241-5c56-49ee-bb15-9985b0059b5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:17.482827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-866af670-e25d-42f3-ace2-df5388cf9d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:17.484050 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8787241-5c56-49ee-bb15-9985b0059b5c service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:17.484050 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8787241-5c56-49ee-bb15-9985b0059b5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:17.484050 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8787241-5c56-49ee-bb15-9985b0059b5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:17.486111 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e8787241-5c56-49ee-bb15-9985b0059b5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:17.495896 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 924/1851] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:17.497396 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866af670-e25d-42f3-ace2-df5388cf9d88 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:17.511624 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866af670-e25d-42f3-ace2-df5388cf9d88 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:17.517585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c6f55-1093-47f2-b30b-5bccd4c100d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:17.519319 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c6f55-1093-47f2-b30b-5bccd4c100d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:17.520196 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c6f55-1093-47f2-b30b-5bccd4c100d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:17.520745 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c6f55-1093-47f2-b30b-5bccd4c100d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:17.522234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c6f55-1093-47f2-b30b-5bccd4c100d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:17.525534 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c6f55-1093-47f2-b30b-5bccd4c100d4 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:17.544275 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 925/1852] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:17.552460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c6f55-1093-47f2-b30b-5bccd4c100d4 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:17.557452 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-917c6f55-1093-47f2-b30b-5bccd4c100d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:17.592119 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8787241-5c56-49ee-bb15-9985b0059b5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:17.593687 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8787241-5c56-49ee-bb15-9985b0059b5c service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:17.610667 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 928/1853] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:17.611705 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8787241-5c56-49ee-bb15-9985b0059b5c service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:17.626188 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8787241-5c56-49ee-bb15-9985b0059b5c service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:17.633745 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efca4ea-f95a-4bad-b309-7dbe5fd726f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:17.636052 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efca4ea-f95a-4bad-b309-7dbe5fd726f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:17.636052 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efca4ea-f95a-4bad-b309-7dbe5fd726f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:17.636392 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efca4ea-f95a-4bad-b309-7dbe5fd726f4 admin admin] PATH_INFO: `/v3/projects/e099b2e6e62c4e3c97aeeffbd223d7da/users/183d71da403242dbad1d1ec3ca5ed3d0/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:17.648678 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c6f55-1093-47f2-b30b-5bccd4c100d4 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:17.652916 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566cd6b-25a7-487d-812b-d955f1b11056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:17.653639 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566cd6b-25a7-487d-812b-d955f1b11056 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:17.654010 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566cd6b-25a7-487d-812b-d955f1b11056 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:17.654512 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566cd6b-25a7-487d-812b-d955f1b11056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:17.658454 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efca4ea-f95a-4bad-b309-7dbe5fd726f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e099b2e6e62c4e3c97aeeffbd223d7da, user_id=183d71da403242dbad1d1ec3ca5ed3d0, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:17.661369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efca4ea-f95a-4bad-b309-7dbe5fd726f4 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:17.666773 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0566cd6b-25a7-487d-812b-d955f1b11056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:17.668193 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0566cd6b-25a7-487d-812b-d955f1b11056 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:17.687460 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 929/1854] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:17 2022] PUT /identity/v3/projects/e099b2e6e62c4e3c97aeeffbd223d7da/users/183d71da403242dbad1d1ec3ca5ed3d0/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:17.688175 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 926/1855] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:17.689480 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efca4ea-f95a-4bad-b309-7dbe5fd726f4 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:17.783893 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efca4ea-f95a-4bad-b309-7dbe5fd726f4 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:17.790450 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864939d2-b6c6-48ce-81c3-51cd5fb5e5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:17.791103 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864939d2-b6c6-48ce-81c3-51cd5fb5e5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:17.791416 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864939d2-b6c6-48ce-81c3-51cd5fb5e5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:17.791699 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864939d2-b6c6-48ce-81c3-51cd5fb5e5d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:17.792414 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864939d2-b6c6-48ce-81c3-51cd5fb5e5d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:17.794398 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864939d2-b6c6-48ce-81c3-51cd5fb5e5d2 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:17.807257 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 930/1856] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:17.811444 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566cd6b-25a7-487d-812b-d955f1b11056 service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:17.822561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566cd6b-25a7-487d-812b-d955f1b11056 service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:17.833113 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b911a-5869-452c-acb9-f0bbb1287b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:17.835085 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b911a-5869-452c-acb9-f0bbb1287b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:17.835560 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b911a-5869-452c-acb9-f0bbb1287b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:17.836455 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b911a-5869-452c-acb9-f0bbb1287b01 admin admin] PATH_INFO: `/v3/projects/e099b2e6e62c4e3c97aeeffbd223d7da/users/183d71da403242dbad1d1ec3ca5ed3d0/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:17.843395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b911a-5869-452c-acb9-f0bbb1287b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e099b2e6e62c4e3c97aeeffbd223d7da, user_id=183d71da403242dbad1d1ec3ca5ed3d0, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:17.850819 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b911a-5869-452c-acb9-f0bbb1287b01 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:17.865980 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 927/1857] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:17 2022] PUT /identity/v3/projects/e099b2e6e62c4e3c97aeeffbd223d7da/users/183d71da403242dbad1d1ec3ca5ed3d0/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:17.878249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0e4bc-9052-4dca-9a68-fc6bf14b3faf None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:17.879111 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0e4bc-9052-4dca-9a68-fc6bf14b3faf None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:17.879421 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0e4bc-9052-4dca-9a68-fc6bf14b3faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:17.919401 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-0bc0e4bc-9052-4dca-9a68-fc6bf14b3faf None None] MFA Rules not processed for user `183d71da403242dbad1d1ec3ca5ed3d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:17.920697 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-0bc0e4bc-9052-4dca-9a68-fc6bf14b3faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:17.973609 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:18.016015 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 931/1858] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:18.025459 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b911a-5869-452c-acb9-f0bbb1287b01 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:18.028358 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-5d2b911a-5869-452c-acb9-f0bbb1287b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:18.143888 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b911a-5869-452c-acb9-f0bbb1287b01 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:18.149033 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43b83b-ca76-4e50-bd1b-6369ef47cb41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:18.149688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43b83b-ca76-4e50-bd1b-6369ef47cb41 service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:18.149973 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43b83b-ca76-4e50-bd1b-6369ef47cb41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:18.150256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43b83b-ca76-4e50-bd1b-6369ef47cb41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:18.177240 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43b83b-ca76-4e50-bd1b-6369ef47cb41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:18.183281 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43b83b-ca76-4e50-bd1b-6369ef47cb41 service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:18.191814 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0e4bc-9052-4dca-9a68-fc6bf14b3faf None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:18.195045 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-0bc0e4bc-9052-4dca-9a68-fc6bf14b3faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:18.219264 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 928/1859] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:18 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:18.316069 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0e4bc-9052-4dca-9a68-fc6bf14b3faf None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:18.324163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed452ad-0335-45dd-9862-be73fd523454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:18.324673 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed452ad-0335-45dd-9862-be73fd523454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:18.325193 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed452ad-0335-45dd-9862-be73fd523454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:18.326446 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed452ad-0335-45dd-9862-be73fd523454 admin admin] PATH_INFO: `/v3/projects/f0b572e44f964e6c9d8fff583c320f4b` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:18.327204 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed452ad-0335-45dd-9862-be73fd523454 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0b572e44f964e6c9d8fff583c320f4b)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:18.330290 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed452ad-0335-45dd-9862-be73fd523454 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:18.397482 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-7ed452ad-0335-45dd-9862-be73fd523454 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0b572e44f964e6c9d8fff583c320f4b', 'request_id': 'req-7ed452ad-0335-45dd-9862-be73fd523454'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:18.405285 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-7ed452ad-0335-45dd-9862-be73fd523454 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0b572e44f964e6c9d8fff583c320f4b', 'request_id': 'req-7ed452ad-0335-45dd-9862-be73fd523454'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:18.411523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-7ed452ad-0335-45dd-9862-be73fd523454 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0b572e44f964e6c9d8fff583c320f4b', 'request_id': 'req-7ed452ad-0335-45dd-9862-be73fd523454'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:18.427183 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-7ed452ad-0335-45dd-9862-be73fd523454 admin admin] The token cache is being invalidate because project f0b572e44f964e6c9d8fff583c320f4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:05:18.427480 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-7ed452ad-0335-45dd-9862-be73fd523454 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:18.428337 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-7ed452ad-0335-45dd-9862-be73fd523454 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:18.429925 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 932/1860] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:05:18 2022] DELETE /identity/v3/projects/f0b572e44f964e6c9d8fff583c320f4b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:05:18.435573 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43b83b-ca76-4e50-bd1b-6369ef47cb41 service cinder] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:18.449944 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43b83b-ca76-4e50-bd1b-6369ef47cb41 service cinder] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:18.513787 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:18.523807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d5906-b527-4058-a6be-d2d59f26f8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:18.524790 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d5906-b527-4058-a6be-d2d59f26f8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:18.525071 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d5906-b527-4058-a6be-d2d59f26f8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:18.525353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d5906-b527-4058-a6be-d2d59f26f8fc admin admin] PATH_INFO: `/v3/users/c115de2c762e4399a8d47e543ff96dbc` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:18.526643 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d5906-b527-4058-a6be-d2d59f26f8fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c115de2c762e4399a8d47e543ff96dbc)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:18.528644 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d5906-b527-4058-a6be-d2d59f26f8fc admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:18.592632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-433d5906-b527-4058-a6be-d2d59f26f8fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c115de2c762e4399a8d47e543ff96dbc'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:18.593360 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-433d5906-b527-4058-a6be-d2d59f26f8fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c115de2c762e4399a8d47e543ff96dbc'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:18.595175 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-433d5906-b527-4058-a6be-d2d59f26f8fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c115de2c762e4399a8d47e543ff96dbc'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:18.604177 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-433d5906-b527-4058-a6be-d2d59f26f8fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c115de2c762e4399a8d47e543ff96dbc'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:18.633187 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-433d5906-b527-4058-a6be-d2d59f26f8fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c115de2c762e4399a8d47e543ff96dbc'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:18.652185 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 929/1861] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:05:18 2022] DELETE /identity/v3/users/c115de2c762e4399a8d47e543ff96dbc => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:18.689007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed452ad-0335-45dd-9862-be73fd523454 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:18.690480 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-7ed452ad-0335-45dd-9862-be73fd523454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:18.704463 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed452ad-0335-45dd-9862-be73fd523454 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:18.778792 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5fea1-acd2-47bb-832c-4da37ee08d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:18.779460 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5fea1-acd2-47bb-832c-4da37ee08d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:18.779750 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5fea1-acd2-47bb-832c-4da37ee08d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:18.780040 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5fea1-acd2-47bb-832c-4da37ee08d06 admin admin] PATH_INFO: `/v3/users/3c6a02443f6b4e08b7896e2ef9ed64b9` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:18.781274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5fea1-acd2-47bb-832c-4da37ee08d06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c6a02443f6b4e08b7896e2ef9ed64b9)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:18.783246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5fea1-acd2-47bb-832c-4da37ee08d06 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:18.788938 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:18.840822 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-fbc5fea1-acd2-47bb-832c-4da37ee08d06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c6a02443f6b4e08b7896e2ef9ed64b9'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:18.848952 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-fbc5fea1-acd2-47bb-832c-4da37ee08d06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c6a02443f6b4e08b7896e2ef9ed64b9'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:18.849629 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-fbc5fea1-acd2-47bb-832c-4da37ee08d06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c6a02443f6b4e08b7896e2ef9ed64b9'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:18.885184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-fbc5fea1-acd2-47bb-832c-4da37ee08d06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c6a02443f6b4e08b7896e2ef9ed64b9'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:18.886617 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-fbc5fea1-acd2-47bb-832c-4da37ee08d06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c6a02443f6b4e08b7896e2ef9ed64b9'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:18.912327 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 933/1862] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:05:18 2022] DELETE /identity/v3/users/3c6a02443f6b4e08b7896e2ef9ed64b9 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:18.917362 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1a1dd-73d4-456e-87fb-649b5c07353d None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:18.917892 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1a1dd-73d4-456e-87fb-649b5c07353d None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:18.918054 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1a1dd-73d4-456e-87fb-649b5c07353d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:18.939836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-b1d1a1dd-73d4-456e-87fb-649b5c07353d None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:18.941094 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-b1d1a1dd-73d4-456e-87fb-649b5c07353d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:19.035630 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5fea1-acd2-47bb-832c-4da37ee08d06 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:19.037168 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fbc5fea1-acd2-47bb-832c-4da37ee08d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:19.055384 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 930/1863] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:05:19.065702 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1a1dd-73d4-456e-87fb-649b5c07353d None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:19.067512 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-b1d1a1dd-73d4-456e-87fb-649b5c07353d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:19.126988 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5fea1-acd2-47bb-832c-4da37ee08d06 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:19.134634 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a87119-991f-4167-a7d4-29217282ab41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:19.135306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a87119-991f-4167-a7d4-29217282ab41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:19.135632 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a87119-991f-4167-a7d4-29217282ab41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:19.135860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a87119-991f-4167-a7d4-29217282ab41 admin admin] PATH_INFO: `/v3/projects/398f9d1fec4c49f2b35ff7c94c9658f7` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:19.138634 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a87119-991f-4167-a7d4-29217282ab41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=398f9d1fec4c49f2b35ff7c94c9658f7)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:19.140958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a87119-991f-4167-a7d4-29217282ab41 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:19.155590 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1a1dd-73d4-456e-87fb-649b5c07353d None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:19.168191 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e7a07-cb30-411e-9a94-f7f398145184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:19.171346 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e7a07-cb30-411e-9a94-f7f398145184 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:19.175014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e7a07-cb30-411e-9a94-f7f398145184 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:19.175695 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e7a07-cb30-411e-9a94-f7f398145184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:19.199515 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e7a07-cb30-411e-9a94-f7f398145184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:19.205579 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e7a07-cb30-411e-9a94-f7f398145184 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:19.229875 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 931/1864] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:19.236478 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c3a87119-991f-4167-a7d4-29217282ab41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '398f9d1fec4c49f2b35ff7c94c9658f7', 'request_id': 'req-c3a87119-991f-4167-a7d4-29217282ab41'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:19.245397 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c3a87119-991f-4167-a7d4-29217282ab41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '398f9d1fec4c49f2b35ff7c94c9658f7', 'request_id': 'req-c3a87119-991f-4167-a7d4-29217282ab41'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:19.255317 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c3a87119-991f-4167-a7d4-29217282ab41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '398f9d1fec4c49f2b35ff7c94c9658f7', 'request_id': 'req-c3a87119-991f-4167-a7d4-29217282ab41'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:19.285674 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c3a87119-991f-4167-a7d4-29217282ab41 admin admin] The token cache is being invalidate because project 398f9d1fec4c49f2b35ff7c94c9658f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:05:19.286019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c3a87119-991f-4167-a7d4-29217282ab41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:19.288327 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c3a87119-991f-4167-a7d4-29217282ab41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:19.294072 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 934/1865] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:05:19 2022] DELETE /identity/v3/projects/398f9d1fec4c49f2b35ff7c94c9658f7 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:19.300251 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63340ab-20d2-45ac-9f90-594f38acdcf4 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:19.300567 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63340ab-20d2-45ac-9f90-594f38acdcf4 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:19.300824 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63340ab-20d2-45ac-9f90-594f38acdcf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:19.323128 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-f63340ab-20d2-45ac-9f90-594f38acdcf4 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:19.324362 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-f63340ab-20d2-45ac-9f90-594f38acdcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:19.339101 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:19.450170 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 932/1866] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:19.459636 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6fee3-612a-4cba-b505-91294f60dbdb None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:19.460092 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6fee3-612a-4cba-b505-91294f60dbdb None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:19.460214 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6fee3-612a-4cba-b505-91294f60dbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:19.509510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-efb6fee3-612a-4cba-b505-91294f60dbdb None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:19.511156 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-efb6fee3-612a-4cba-b505-91294f60dbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:19.527477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 935/1867] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:19.531660 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63340ab-20d2-45ac-9f90-594f38acdcf4 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:19.546392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63340ab-20d2-45ac-9f90-594f38acdcf4 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:19.559693 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51796b-49f7-4190-ba17-8784afda171a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:19.561045 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51796b-49f7-4190-ba17-8784afda171a admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:19.561501 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51796b-49f7-4190-ba17-8784afda171a admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:19.562412 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51796b-49f7-4190-ba17-8784afda171a admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:19.563878 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51796b-49f7-4190-ba17-8784afda171a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:05:19.564795 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51796b-49f7-4190-ba17-8784afda171a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:19.567192 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51796b-49f7-4190-ba17-8784afda171a admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:19.582924 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 933/1868] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:05:19.588123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6fee3-612a-4cba-b505-91294f60dbdb None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:19.598099 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6fee3-612a-4cba-b505-91294f60dbdb None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:19.603627 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ff706-75f2-45e7-b704-5b7cfebc36cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:19.604254 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ff706-75f2-45e7-b704-5b7cfebc36cb admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:19.604541 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ff706-75f2-45e7-b704-5b7cfebc36cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:19.604822 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ff706-75f2-45e7-b704-5b7cfebc36cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:19.605506 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ff706-75f2-45e7-b704-5b7cfebc36cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:19.607523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ff706-75f2-45e7-b704-5b7cfebc36cb admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:19.612604 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:19.644142 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 936/1869] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:05:19 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:19.649076 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51796b-49f7-4190-ba17-8784afda171a admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:19.660899 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51796b-49f7-4190-ba17-8784afda171a admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:19.748910 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0ba58-b792-4e08-a411-5c3a83422a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:19.750544 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0ba58-b792-4e08-a411-5c3a83422a15 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:19.751108 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0ba58-b792-4e08-a411-5c3a83422a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:19.751560 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0ba58-b792-4e08-a411-5c3a83422a15 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:19.752393 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0ba58-b792-4e08-a411-5c3a83422a15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:19.755260 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0ba58-b792-4e08-a411-5c3a83422a15 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:19.789341 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 934/1870] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:05:19 2022] POST /identity/v3/users => generated 294 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:19.798892 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ff706-75f2-45e7-b704-5b7cfebc36cb admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:19.817605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ff706-75f2-45e7-b704-5b7cfebc36cb admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:19.823603 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeefb33-dd5c-4cac-952a-26d3b7fc17d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:19.827426 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeefb33-dd5c-4cac-952a-26d3b7fc17d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:19.827782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeefb33-dd5c-4cac-952a-26d3b7fc17d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:19.828068 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeefb33-dd5c-4cac-952a-26d3b7fc17d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:19.828829 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeefb33-dd5c-4cac-952a-26d3b7fc17d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:19.829163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0ba58-b792-4e08-a411-5c3a83422a15 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:19.831019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeefb33-dd5c-4cac-952a-26d3b7fc17d5 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:19.831677 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-9da0ba58-b792-4e08-a411-5c3a83422a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:19.847742 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 937/1871] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:19.848298 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeefb33-dd5c-4cac-952a-26d3b7fc17d5 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:19.849146 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0ba58-b792-4e08-a411-5c3a83422a15 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:19.855355 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af054b12-61ed-4e18-813f-2776dad85b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:19.856022 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af054b12-61ed-4e18-813f-2776dad85b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:19.856294 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af054b12-61ed-4e18-813f-2776dad85b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:19.856572 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af054b12-61ed-4e18-813f-2776dad85b08 admin admin] PATH_INFO: `/v3/projects/0e13312e5b2e411596dfe364477f2864` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:19.858206 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af054b12-61ed-4e18-813f-2776dad85b08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e13312e5b2e411596dfe364477f2864)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:19.860966 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af054b12-61ed-4e18-813f-2776dad85b08 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:19.864937 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeefb33-dd5c-4cac-952a-26d3b7fc17d5 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:19.880384 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a7e76-cc78-46b9-acfb-4ed7c33c746f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:19.881760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a7e76-cc78-46b9-acfb-4ed7c33c746f admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:19.882365 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a7e76-cc78-46b9-acfb-4ed7c33c746f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:19.882722 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a7e76-cc78-46b9-acfb-4ed7c33c746f admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:19.883441 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a7e76-cc78-46b9-acfb-4ed7c33c746f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:19.885466 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a7e76-cc78-46b9-acfb-4ed7c33c746f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:19.898441 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 938/1872] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:19.900824 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a7e76-cc78-46b9-acfb-4ed7c33c746f admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:19.913083 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a7e76-cc78-46b9-acfb-4ed7c33c746f admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:19.919423 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237aa0e-e051-4d5e-ba8a-cea2ab00db2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:19.920293 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237aa0e-e051-4d5e-ba8a-cea2ab00db2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:19.920577 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237aa0e-e051-4d5e-ba8a-cea2ab00db2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:19.920874 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237aa0e-e051-4d5e-ba8a-cea2ab00db2c admin admin] PATH_INFO: `/v3/projects/b6c05f89540d4a719e7968409f9db59e/users/cd688fce8a9646d89a1c743722a913a9/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:19.945141 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237aa0e-e051-4d5e-ba8a-cea2ab00db2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c05f89540d4a719e7968409f9db59e, user_id=cd688fce8a9646d89a1c743722a913a9, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:19.949131 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237aa0e-e051-4d5e-ba8a-cea2ab00db2c admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:19.958192 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-af054b12-61ed-4e18-813f-2776dad85b08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e13312e5b2e411596dfe364477f2864', 'request_id': 'req-af054b12-61ed-4e18-813f-2776dad85b08'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:19.966145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-af054b12-61ed-4e18-813f-2776dad85b08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e13312e5b2e411596dfe364477f2864', 'request_id': 'req-af054b12-61ed-4e18-813f-2776dad85b08'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:19.970035 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 939/1873] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:19 2022] PUT /identity/v3/projects/b6c05f89540d4a719e7968409f9db59e/users/cd688fce8a9646d89a1c743722a913a9/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:05:19.978084 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-af054b12-61ed-4e18-813f-2776dad85b08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e13312e5b2e411596dfe364477f2864', 'request_id': 'req-af054b12-61ed-4e18-813f-2776dad85b08'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:19.982806 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce268b27-81b7-42de-9534-7b7eebb7bade None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:19.983447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce268b27-81b7-42de-9534-7b7eebb7bade None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:19.983932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce268b27-81b7-42de-9534-7b7eebb7bade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:19.993186 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-af054b12-61ed-4e18-813f-2776dad85b08 admin admin] The token cache is being invalidate because project 0e13312e5b2e411596dfe364477f2864 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:05:19.993530 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-af054b12-61ed-4e18-813f-2776dad85b08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:19.994415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-af054b12-61ed-4e18-813f-2776dad85b08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:19.999642 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 935/1874] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:05:19 2022] DELETE /identity/v3/projects/0e13312e5b2e411596dfe364477f2864 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:05:20.000668 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af054b12-61ed-4e18-813f-2776dad85b08 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:20.002271 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-af054b12-61ed-4e18-813f-2776dad85b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:20.025998 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-ce268b27-81b7-42de-9534-7b7eebb7bade None None] MFA Rules not processed for user `cd688fce8a9646d89a1c743722a913a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:20.028926 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ce268b27-81b7-42de-9534-7b7eebb7bade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:20.048527 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:20.111471 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 940/1875] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:05:20.116552 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce268b27-81b7-42de-9534-7b7eebb7bade None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:20.117975 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af054b12-61ed-4e18-813f-2776dad85b08 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:20.118237 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ce268b27-81b7-42de-9534-7b7eebb7bade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:20.196688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6ad43-b68b-49be-ba24-cae7b52c72b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:20.197445 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6ad43-b68b-49be-ba24-cae7b52c72b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:20.197789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6ad43-b68b-49be-ba24-cae7b52c72b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:20.198173 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6ad43-b68b-49be-ba24-cae7b52c72b5 admin admin] PATH_INFO: `/v3/users/183d71da403242dbad1d1ec3ca5ed3d0` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:20.199529 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6ad43-b68b-49be-ba24-cae7b52c72b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=183d71da403242dbad1d1ec3ca5ed3d0)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:20.201606 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6ad43-b68b-49be-ba24-cae7b52c72b5 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:20.201769 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce268b27-81b7-42de-9534-7b7eebb7bade None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:20.207525 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57804319-43e5-4dca-b7e8-2c243ab535b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:20.210168 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57804319-43e5-4dca-b7e8-2c243ab535b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:20.210168 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57804319-43e5-4dca-b7e8-2c243ab535b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:20.210168 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57804319-43e5-4dca-b7e8-2c243ab535b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:20.210168 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57804319-43e5-4dca-b7e8-2c243ab535b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:20.212306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57804319-43e5-4dca-b7e8-2c243ab535b8 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:20.245829 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 941/1876] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:05:20 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:20.250262 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57804319-43e5-4dca-b7e8-2c243ab535b8 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:20.263988 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-18b6ad43-b68b-49be-ba24-cae7b52c72b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '183d71da403242dbad1d1ec3ca5ed3d0'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:20.265256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-18b6ad43-b68b-49be-ba24-cae7b52c72b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '183d71da403242dbad1d1ec3ca5ed3d0'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:20.265677 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-18b6ad43-b68b-49be-ba24-cae7b52c72b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '183d71da403242dbad1d1ec3ca5ed3d0'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:20.270286 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:20.276373 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-18b6ad43-b68b-49be-ba24-cae7b52c72b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '183d71da403242dbad1d1ec3ca5ed3d0'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:20.302662 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-18b6ad43-b68b-49be-ba24-cae7b52c72b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '183d71da403242dbad1d1ec3ca5ed3d0'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:20.321345 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 936/1877] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:05:19 2022] DELETE /identity/v3/users/183d71da403242dbad1d1ec3ca5ed3d0 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:20.340487 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57804319-43e5-4dca-b7e8-2c243ab535b8 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:20.434447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4ae53-2a55-470d-8651-f056a71bc94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:20.435030 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4ae53-2a55-470d-8651-f056a71bc94c admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:20.435720 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4ae53-2a55-470d-8651-f056a71bc94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:20.435720 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4ae53-2a55-470d-8651-f056a71bc94c admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:20.436317 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4ae53-2a55-470d-8651-f056a71bc94c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:20.438435 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4ae53-2a55-470d-8651-f056a71bc94c admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:20.471712 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 942/1878] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:05:20 2022] POST /identity/v3/users => generated 299 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:05:20.472985 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6ad43-b68b-49be-ba24-cae7b52c72b5 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:20.475622 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-18b6ad43-b68b-49be-ba24-cae7b52c72b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:20.495990 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6ad43-b68b-49be-ba24-cae7b52c72b5 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:20.502996 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a61da8-b09d-49bd-9611-09c1733fc1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:20.503911 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a61da8-b09d-49bd-9611-09c1733fc1a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:20.504397 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a61da8-b09d-49bd-9611-09c1733fc1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:20.504949 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a61da8-b09d-49bd-9611-09c1733fc1a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:20.505851 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a61da8-b09d-49bd-9611-09c1733fc1a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:20.507942 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a61da8-b09d-49bd-9611-09c1733fc1a6 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:20.522589 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 937/1879] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:20.523265 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4ae53-2a55-470d-8651-f056a71bc94c admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:20.534237 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4ae53-2a55-470d-8651-f056a71bc94c admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:20.541211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33356e-21ab-485a-af50-189682562e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:20.542464 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33356e-21ab-485a-af50-189682562e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:20.542845 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33356e-21ab-485a-af50-189682562e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:20.543244 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33356e-21ab-485a-af50-189682562e50 admin admin] PATH_INFO: `/v3/projects/ba6b5f0244a04da0b5bec8a05403d4ca/users/6271a6b4cbf74cb28b895b88a4159079/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:20.573887 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c33356e-21ab-485a-af50-189682562e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba6b5f0244a04da0b5bec8a05403d4ca, user_id=6271a6b4cbf74cb28b895b88a4159079, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:20.577634 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c33356e-21ab-485a-af50-189682562e50 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:20.598178 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 943/1880] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:20 2022] PUT /identity/v3/projects/ba6b5f0244a04da0b5bec8a05403d4ca/users/6271a6b4cbf74cb28b895b88a4159079/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:05:20.603807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a61da8-b09d-49bd-9611-09c1733fc1a6 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:20.617299 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a61da8-b09d-49bd-9611-09c1733fc1a6 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:20.656771 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:20.749915 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e78bf-a7c5-4626-95bf-b011b4a2f347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:20.750899 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e78bf-a7c5-4626-95bf-b011b4a2f347 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:20.751336 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e78bf-a7c5-4626-95bf-b011b4a2f347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:20.751823 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e78bf-a7c5-4626-95bf-b011b4a2f347 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:20.752943 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e78bf-a7c5-4626-95bf-b011b4a2f347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:20.761347 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e78bf-a7c5-4626-95bf-b011b4a2f347 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:20.793908 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 938/1881] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:20.795178 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33356e-21ab-485a-af50-189682562e50 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:20.809914 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33356e-21ab-485a-af50-189682562e50 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:20.817054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804639c-f1ca-4c7b-9e4d-6cbb95be1463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:20.817923 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804639c-f1ca-4c7b-9e4d-6cbb95be1463 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:20.818353 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804639c-f1ca-4c7b-9e4d-6cbb95be1463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:20.818848 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804639c-f1ca-4c7b-9e4d-6cbb95be1463 admin admin] PATH_INFO: `/v3/projects/ba6b5f0244a04da0b5bec8a05403d4ca/users/6271a6b4cbf74cb28b895b88a4159079/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:20.821467 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804639c-f1ca-4c7b-9e4d-6cbb95be1463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba6b5f0244a04da0b5bec8a05403d4ca, user_id=6271a6b4cbf74cb28b895b88a4159079, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:20.826282 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804639c-f1ca-4c7b-9e4d-6cbb95be1463 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:20.842843 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 944/1882] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:20 2022] PUT /identity/v3/projects/ba6b5f0244a04da0b5bec8a05403d4ca/users/6271a6b4cbf74cb28b895b88a4159079/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:05:20.856853 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ee3e7-1ae2-4424-bc0b-80649666875d None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:20.857373 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ee3e7-1ae2-4424-bc0b-80649666875d None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:20.857801 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ee3e7-1ae2-4424-bc0b-80649666875d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:20.901589 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-e65ee3e7-1ae2-4424-bc0b-80649666875d None None] MFA Rules not processed for user `6271a6b4cbf74cb28b895b88a4159079`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:20.903813 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-e65ee3e7-1ae2-4424-bc0b-80649666875d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:21.040733 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 939/1883] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:21.050967 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804639c-f1ca-4c7b-9e4d-6cbb95be1463 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:21.054515 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-5804639c-f1ca-4c7b-9e4d-6cbb95be1463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:21.219972 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804639c-f1ca-4c7b-9e4d-6cbb95be1463 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:21.232984 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f935a1-e389-4b6b-84b7-708cbf0e3589 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:21.233638 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f935a1-e389-4b6b-84b7-708cbf0e3589 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:21.233925 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f935a1-e389-4b6b-84b7-708cbf0e3589 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:21.234206 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f935a1-e389-4b6b-84b7-708cbf0e3589 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:21.270388 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f935a1-e389-4b6b-84b7-708cbf0e3589 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:21.279391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f935a1-e389-4b6b-84b7-708cbf0e3589 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:21.310348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 945/1884] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:21.462989 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ee3e7-1ae2-4424-bc0b-80649666875d None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:21.615175 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7df6a-9b4e-46ea-95f7-211cf24d4db5 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:21.616066 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7df6a-9b4e-46ea-95f7-211cf24d4db5 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:21.616473 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7df6a-9b4e-46ea-95f7-211cf24d4db5 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:21.618581 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 946/1885] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 09:05:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 09:05:21.630781 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb65f5d-8711-4120-8a5a-db7dc60425ca None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:21.631211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb65f5d-8711-4120-8a5a-db7dc60425ca None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:21.631610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb65f5d-8711-4120-8a5a-db7dc60425ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:21.644770 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ee3e7-1ae2-4424-bc0b-80649666875d None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:21.658019 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c57a57-129a-4f8d-89d7-4258b9ad035a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:21.658933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c57a57-129a-4f8d-89d7-4258b9ad035a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:21.659182 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c57a57-129a-4f8d-89d7-4258b9ad035a admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:21.659624 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c57a57-129a-4f8d-89d7-4258b9ad035a admin admin] PATH_INFO: `/v3/users/cd688fce8a9646d89a1c743722a913a9` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:21.660710 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c57a57-129a-4f8d-89d7-4258b9ad035a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd688fce8a9646d89a1c743722a913a9)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:21.663226 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c57a57-129a-4f8d-89d7-4258b9ad035a admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:21.674189 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-bfb65f5d-8711-4120-8a5a-db7dc60425ca None None] MFA Rules not processed for user `c30bc55c6a1348bb961f0d010422da87`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:21.678514 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-bfb65f5d-8711-4120-8a5a-db7dc60425ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:21.706391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:21.799194 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-b6c57a57-129a-4f8d-89d7-4258b9ad035a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd688fce8a9646d89a1c743722a913a9'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:21.799457 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-b6c57a57-129a-4f8d-89d7-4258b9ad035a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd688fce8a9646d89a1c743722a913a9'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:21.800156 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-b6c57a57-129a-4f8d-89d7-4258b9ad035a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd688fce8a9646d89a1c743722a913a9'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:21.822347 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-b6c57a57-129a-4f8d-89d7-4258b9ad035a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd688fce8a9646d89a1c743722a913a9'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:21.827757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:21.842669 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 947/1886] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 09:05:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:05:21.866244 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-b6c57a57-129a-4f8d-89d7-4258b9ad035a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd688fce8a9646d89a1c743722a913a9'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:21.900682 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 940/1887] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:05:21 2022] DELETE /identity/v3/users/cd688fce8a9646d89a1c743722a913a9 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:21.907422 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96b65d-adb8-4111-91bf-53f1ea12bcd3 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:21.908215 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96b65d-adb8-4111-91bf-53f1ea12bcd3 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:21.908672 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96b65d-adb8-4111-91bf-53f1ea12bcd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:21.946498 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-2d96b65d-adb8-4111-91bf-53f1ea12bcd3 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:21.947009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c57a57-129a-4f8d-89d7-4258b9ad035a admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:21.948441 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-2d96b65d-adb8-4111-91bf-53f1ea12bcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:21.949187 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-b6c57a57-129a-4f8d-89d7-4258b9ad035a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:22.027372 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 948/1888] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:22.042537 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96b65d-adb8-4111-91bf-53f1ea12bcd3 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:22.044144 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-2d96b65d-adb8-4111-91bf-53f1ea12bcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:22.111475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c57a57-129a-4f8d-89d7-4258b9ad035a admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:22.121726 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462dcad1-c586-45da-94bb-973913af68d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:22.122468 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462dcad1-c586-45da-94bb-973913af68d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:22.123593 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462dcad1-c586-45da-94bb-973913af68d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:22.123593 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462dcad1-c586-45da-94bb-973913af68d1 admin admin] PATH_INFO: `/v3/projects/e099b2e6e62c4e3c97aeeffbd223d7da` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:22.125013 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462dcad1-c586-45da-94bb-973913af68d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e099b2e6e62c4e3c97aeeffbd223d7da)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:22.130492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462dcad1-c586-45da-94bb-973913af68d1 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:22.147076 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96b65d-adb8-4111-91bf-53f1ea12bcd3 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:22.151501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c3766-2e39-4364-8161-bd4708137bf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:22.152264 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c3766-2e39-4364-8161-bd4708137bf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:22.152608 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c3766-2e39-4364-8161-bd4708137bf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:22.152949 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c3766-2e39-4364-8161-bd4708137bf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:22.165745 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c3766-2e39-4364-8161-bd4708137bf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:22.167950 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c3766-2e39-4364-8161-bd4708137bf2 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:22.178674 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 949/1889] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:22.179842 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c3766-2e39-4364-8161-bd4708137bf2 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:22.181328 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a63c3766-2e39-4364-8161-bd4708137bf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:22.189573 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-462dcad1-c586-45da-94bb-973913af68d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e099b2e6e62c4e3c97aeeffbd223d7da', 'request_id': 'req-462dcad1-c586-45da-94bb-973913af68d1'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:22.197948 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-462dcad1-c586-45da-94bb-973913af68d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e099b2e6e62c4e3c97aeeffbd223d7da', 'request_id': 'req-462dcad1-c586-45da-94bb-973913af68d1'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:22.207609 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-462dcad1-c586-45da-94bb-973913af68d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e099b2e6e62c4e3c97aeeffbd223d7da', 'request_id': 'req-462dcad1-c586-45da-94bb-973913af68d1'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:22.223721 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-462dcad1-c586-45da-94bb-973913af68d1 admin admin] The token cache is being invalidate because project e099b2e6e62c4e3c97aeeffbd223d7da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:05:22.224103 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-462dcad1-c586-45da-94bb-973913af68d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:22.226134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-462dcad1-c586-45da-94bb-973913af68d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:22.229804 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 941/1890] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:05:21 2022] DELETE /identity/v3/projects/e099b2e6e62c4e3c97aeeffbd223d7da => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:05:22.236209 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d929d8-132b-487a-8d81-d00b43be6ce7 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:22.236447 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d929d8-132b-487a-8d81-d00b43be6ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:22.236725 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d929d8-132b-487a-8d81-d00b43be6ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:22.252207 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:22.259491 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-33d929d8-132b-487a-8d81-d00b43be6ce7 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:22.260747 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-33d929d8-132b-487a-8d81-d00b43be6ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:22.277724 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c3766-2e39-4364-8161-bd4708137bf2 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:22.371124 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 942/1891] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:22.371124 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad55b2-ce1a-4fed-a166-eedaa43135a5 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:22.371124 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad55b2-ce1a-4fed-a166-eedaa43135a5 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:22.371124 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad55b2-ce1a-4fed-a166-eedaa43135a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:22.378569 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:22.387657 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acecc4d-9809-46c5-bd2b-15b52d50c66e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:22.387657 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acecc4d-9809-46c5-bd2b-15b52d50c66e service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:22.387900 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acecc4d-9809-46c5-bd2b-15b52d50c66e service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:22.388116 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acecc4d-9809-46c5-bd2b-15b52d50c66e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:22.390100 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1acecc4d-9809-46c5-bd2b-15b52d50c66e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:22.392796 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-cdad55b2-ce1a-4fed-a166-eedaa43135a5 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:22.394117 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-cdad55b2-ce1a-4fed-a166-eedaa43135a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:22.404179 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acecc4d-9809-46c5-bd2b-15b52d50c66e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:22.405793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acecc4d-9809-46c5-bd2b-15b52d50c66e service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:22.411633 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 943/1892] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:22.416123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad55b2-ce1a-4fed-a166-eedaa43135a5 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:22.420928 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 950/1893] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:22.428995 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad55b2-ce1a-4fed-a166-eedaa43135a5 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:22.436108 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2328cd3-3316-44d4-9a08-867a1c29ef61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:22.436923 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2328cd3-3316-44d4-9a08-867a1c29ef61 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:22.437344 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2328cd3-3316-44d4-9a08-867a1c29ef61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:22.437792 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2328cd3-3316-44d4-9a08-867a1c29ef61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:22.438664 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2328cd3-3316-44d4-9a08-867a1c29ef61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:05:22.439725 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2328cd3-3316-44d4-9a08-867a1c29ef61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:22.453509 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2328cd3-3316-44d4-9a08-867a1c29ef61 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:22.471918 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 944/1894] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 09:05:22.476350 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acecc4d-9809-46c5-bd2b-15b52d50c66e service nova] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:22.489724 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acecc4d-9809-46c5-bd2b-15b52d50c66e service nova] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:22.496432 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98559951-da08-4b50-9039-5b063ea53dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:22.497066 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98559951-da08-4b50-9039-5b063ea53dfd admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:22.497349 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98559951-da08-4b50-9039-5b063ea53dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:22.497755 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98559951-da08-4b50-9039-5b063ea53dfd admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:22.498465 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98559951-da08-4b50-9039-5b063ea53dfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:22.500592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98559951-da08-4b50-9039-5b063ea53dfd admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:22.532922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 951/1895] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:05:22 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:22.547286 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2328cd3-3316-44d4-9a08-867a1c29ef61 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:22.558600 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2328cd3-3316-44d4-9a08-867a1c29ef61 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:22.564522 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98559951-da08-4b50-9039-5b063ea53dfd admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:22.566450 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-98559951-da08-4b50-9039-5b063ea53dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:22.635060 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b7367-dc9d-4bdb-be85-07120db3133b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:22.635686 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b7367-dc9d-4bdb-be85-07120db3133b admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:22.635963 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b7367-dc9d-4bdb-be85-07120db3133b admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:22.636234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b7367-dc9d-4bdb-be85-07120db3133b admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:22.636796 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98559951-da08-4b50-9039-5b063ea53dfd admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:22.636922 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b7367-dc9d-4bdb-be85-07120db3133b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:22.638934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b7367-dc9d-4bdb-be85-07120db3133b admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:22.641759 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fed4d0-048d-49f1-9a54-4dd20a3cb9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:22.642465 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fed4d0-048d-49f1-9a54-4dd20a3cb9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:22.642748 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fed4d0-048d-49f1-9a54-4dd20a3cb9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:22.643023 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fed4d0-048d-49f1-9a54-4dd20a3cb9ce admin admin] PATH_INFO: `/v3/projects/b6c05f89540d4a719e7968409f9db59e` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:22.644186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fed4d0-048d-49f1-9a54-4dd20a3cb9ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6c05f89540d4a719e7968409f9db59e)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:22.646100 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fed4d0-048d-49f1-9a54-4dd20a3cb9ce admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:22.664364 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 945/1896] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:05:22 2022] POST /identity/v3/users => generated 290 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:05:22.668585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b7367-dc9d-4bdb-be85-07120db3133b admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:22.680070 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b7367-dc9d-4bdb-be85-07120db3133b admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:22.685536 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b127727-1ec1-4b5e-a7d9-07a7ebd12fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:22.686169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b127727-1ec1-4b5e-a7d9-07a7ebd12fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:22.686496 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b127727-1ec1-4b5e-a7d9-07a7ebd12fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:22.686779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b127727-1ec1-4b5e-a7d9-07a7ebd12fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:22.687489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b127727-1ec1-4b5e-a7d9-07a7ebd12fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:22.689091 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b127727-1ec1-4b5e-a7d9-07a7ebd12fe1 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:22.701054 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 946/1897] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:22.704648 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b127727-1ec1-4b5e-a7d9-07a7ebd12fe1 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:22.705793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a8fed4d0-048d-49f1-9a54-4dd20a3cb9ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6c05f89540d4a719e7968409f9db59e', 'request_id': 'req-a8fed4d0-048d-49f1-9a54-4dd20a3cb9ce'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:22.712996 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a8fed4d0-048d-49f1-9a54-4dd20a3cb9ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6c05f89540d4a719e7968409f9db59e', 'request_id': 'req-a8fed4d0-048d-49f1-9a54-4dd20a3cb9ce'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:22.714434 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:22.715314 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b127727-1ec1-4b5e-a7d9-07a7ebd12fe1 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:22.721614 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a8fed4d0-048d-49f1-9a54-4dd20a3cb9ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6c05f89540d4a719e7968409f9db59e', 'request_id': 'req-a8fed4d0-048d-49f1-9a54-4dd20a3cb9ce'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:22.740506 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a8fed4d0-048d-49f1-9a54-4dd20a3cb9ce admin admin] The token cache is being invalidate because project b6c05f89540d4a719e7968409f9db59e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:05:22.741652 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a8fed4d0-048d-49f1-9a54-4dd20a3cb9ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:22.742736 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a8fed4d0-048d-49f1-9a54-4dd20a3cb9ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:22.747431 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 952/1898] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:05:22 2022] DELETE /identity/v3/projects/b6c05f89540d4a719e7968409f9db59e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:05:22.748555 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fed4d0-048d-49f1-9a54-4dd20a3cb9ce admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:22.749975 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a8fed4d0-048d-49f1-9a54-4dd20a3cb9ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:22.779444 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12456fd5-2163-485c-94b1-7dc644b7d8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:22.779981 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12456fd5-2163-485c-94b1-7dc644b7d8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:22.780266 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12456fd5-2163-485c-94b1-7dc644b7d8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:22.780545 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12456fd5-2163-485c-94b1-7dc644b7d8d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:22.781278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12456fd5-2163-485c-94b1-7dc644b7d8d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:22.782967 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12456fd5-2163-485c-94b1-7dc644b7d8d8 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:22.795099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 947/1899] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:22.799415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12456fd5-2163-485c-94b1-7dc644b7d8d8 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:22.801100 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-12456fd5-2163-485c-94b1-7dc644b7d8d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:22.815157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12456fd5-2163-485c-94b1-7dc644b7d8d8 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:22.821356 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487545b-509c-4f4e-a25b-d69136abee9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:22.822075 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487545b-509c-4f4e-a25b-d69136abee9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:22.822394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487545b-509c-4f4e-a25b-d69136abee9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:22.822673 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487545b-509c-4f4e-a25b-d69136abee9f admin admin] PATH_INFO: `/v3/projects/e0854d0e43db4747a711fb75971253c0/users/0fccb6b833844e7b9b4bbe70345717ae/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:22.825799 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fed4d0-048d-49f1-9a54-4dd20a3cb9ce admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:22.836733 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970f381-7c5e-41ab-bb64-14975890f1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:22.837405 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970f381-7c5e-41ab-bb64-14975890f1d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:22.837680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970f381-7c5e-41ab-bb64-14975890f1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:22.837962 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970f381-7c5e-41ab-bb64-14975890f1d6 admin admin] PATH_INFO: `/v3/users/6271a6b4cbf74cb28b895b88a4159079` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:22.839810 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d970f381-7c5e-41ab-bb64-14975890f1d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6271a6b4cbf74cb28b895b88a4159079)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:22.841875 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d970f381-7c5e-41ab-bb64-14975890f1d6 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:22.847432 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487545b-509c-4f4e-a25b-d69136abee9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0854d0e43db4747a711fb75971253c0, user_id=0fccb6b833844e7b9b4bbe70345717ae, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:22.851718 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487545b-509c-4f4e-a25b-d69136abee9f admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:22.901526 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 948/1900] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:22 2022] PUT /identity/v3/projects/e0854d0e43db4747a711fb75971253c0/users/0fccb6b833844e7b9b4bbe70345717ae/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:22.914234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c9056-8a98-47ca-a6cb-50e0d083135f None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:22.914793 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c9056-8a98-47ca-a6cb-50e0d083135f None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:22.928506 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c9056-8a98-47ca-a6cb-50e0d083135f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:22.941098 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d970f381-7c5e-41ab-bb64-14975890f1d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6271a6b4cbf74cb28b895b88a4159079'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:22.953681 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d970f381-7c5e-41ab-bb64-14975890f1d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6271a6b4cbf74cb28b895b88a4159079'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:22.955318 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d970f381-7c5e-41ab-bb64-14975890f1d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6271a6b4cbf74cb28b895b88a4159079'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:22.969448 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-2b6c9056-8a98-47ca-a6cb-50e0d083135f None None] MFA Rules not processed for user `0fccb6b833844e7b9b4bbe70345717ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:22.970719 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-2b6c9056-8a98-47ca-a6cb-50e0d083135f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:22.976348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d970f381-7c5e-41ab-bb64-14975890f1d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6271a6b4cbf74cb28b895b88a4159079'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:22.977244 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d970f381-7c5e-41ab-bb64-14975890f1d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6271a6b4cbf74cb28b895b88a4159079'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:23.002970 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 953/1901] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:05:22 2022] DELETE /identity/v3/users/6271a6b4cbf74cb28b895b88a4159079 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:23.011296 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:23.118359 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 949/1902] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:05:23.123423 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970f381-7c5e-41ab-bb64-14975890f1d6 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:23.125095 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d970f381-7c5e-41ab-bb64-14975890f1d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:23.221577 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970f381-7c5e-41ab-bb64-14975890f1d6 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:23.228316 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d80ba-ce52-4d3b-b3d9-5aba81986ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:23.229596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d80ba-ce52-4d3b-b3d9-5aba81986ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:23.230894 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d80ba-ce52-4d3b-b3d9-5aba81986ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:23.230894 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d80ba-ce52-4d3b-b3d9-5aba81986ce7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:23.232282 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d80ba-ce52-4d3b-b3d9-5aba81986ce7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:23.234416 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d80ba-ce52-4d3b-b3d9-5aba81986ce7 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:23.249011 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:23.296624 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c9056-8a98-47ca-a6cb-50e0d083135f None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:23.299307 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 954/1903] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:05:23 2022] POST /identity/v3/projects => generated 379 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:23.383075 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c9056-8a98-47ca-a6cb-50e0d083135f None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:23.447956 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ec107-1f09-4e62-8206-6f6eb27ac139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:23.448621 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ec107-1f09-4e62-8206-6f6eb27ac139 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:23.448905 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ec107-1f09-4e62-8206-6f6eb27ac139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:23.449188 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ec107-1f09-4e62-8206-6f6eb27ac139 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:23.449920 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ec107-1f09-4e62-8206-6f6eb27ac139 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:23.451941 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ec107-1f09-4e62-8206-6f6eb27ac139 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:23.488540 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 950/1904] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:05:23 2022] POST /identity/v3/users => generated 296 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:05:23.493864 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d80ba-ce52-4d3b-b3d9-5aba81986ce7 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:23.533835 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ec107-1f09-4e62-8206-6f6eb27ac139 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:23.535871 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-1b7ec107-1f09-4e62-8206-6f6eb27ac139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:23.537206 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d80ba-ce52-4d3b-b3d9-5aba81986ce7 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:23.548537 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50ea34-3432-40d8-bb0b-e707a31ed779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:23.549293 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50ea34-3432-40d8-bb0b-e707a31ed779 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:23.549651 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50ea34-3432-40d8-bb0b-e707a31ed779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:23.550006 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50ea34-3432-40d8-bb0b-e707a31ed779 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:23.550872 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50ea34-3432-40d8-bb0b-e707a31ed779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:23.552841 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50ea34-3432-40d8-bb0b-e707a31ed779 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:23.554993 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ec107-1f09-4e62-8206-6f6eb27ac139 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:23.561417 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f595107-8c47-4a1c-8403-fdf9d84ea7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:23.563090 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f595107-8c47-4a1c-8403-fdf9d84ea7f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:23.563616 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f595107-8c47-4a1c-8403-fdf9d84ea7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:23.564122 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f595107-8c47-4a1c-8403-fdf9d84ea7f1 admin admin] PATH_INFO: `/v3/projects/ba6b5f0244a04da0b5bec8a05403d4ca` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:23.565749 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f595107-8c47-4a1c-8403-fdf9d84ea7f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba6b5f0244a04da0b5bec8a05403d4ca)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:23.568335 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 955/1905] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:05:23.571661 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f595107-8c47-4a1c-8403-fdf9d84ea7f1 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:23.574016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50ea34-3432-40d8-bb0b-e707a31ed779 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:23.592285 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50ea34-3432-40d8-bb0b-e707a31ed779 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:23.597872 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a44c8b-6d9d-43da-8200-83b1b1388edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:23.598644 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a44c8b-6d9d-43da-8200-83b1b1388edf admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:23.598928 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a44c8b-6d9d-43da-8200-83b1b1388edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:23.599209 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a44c8b-6d9d-43da-8200-83b1b1388edf admin admin] PATH_INFO: `/v3/projects/4027a864512349e1bed741d262281554/users/c5c176d7b1dc4d7f84126abf10a035da/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:23.620012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a44c8b-6d9d-43da-8200-83b1b1388edf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4027a864512349e1bed741d262281554, user_id=c5c176d7b1dc4d7f84126abf10a035da, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:23.624342 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a44c8b-6d9d-43da-8200-83b1b1388edf admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:23.644142 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 956/1906] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:23 2022] PUT /identity/v3/projects/4027a864512349e1bed741d262281554/users/c5c176d7b1dc4d7f84126abf10a035da/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:23.644456 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-7f595107-8c47-4a1c-8403-fdf9d84ea7f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba6b5f0244a04da0b5bec8a05403d4ca', 'request_id': 'req-7f595107-8c47-4a1c-8403-fdf9d84ea7f1'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:23.649408 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a44c8b-6d9d-43da-8200-83b1b1388edf admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:23.653643 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:23.656389 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-7f595107-8c47-4a1c-8403-fdf9d84ea7f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba6b5f0244a04da0b5bec8a05403d4ca', 'request_id': 'req-7f595107-8c47-4a1c-8403-fdf9d84ea7f1'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:23.669692 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-7f595107-8c47-4a1c-8403-fdf9d84ea7f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba6b5f0244a04da0b5bec8a05403d4ca', 'request_id': 'req-7f595107-8c47-4a1c-8403-fdf9d84ea7f1'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:23.688580 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-7f595107-8c47-4a1c-8403-fdf9d84ea7f1 admin admin] The token cache is being invalidate because project ba6b5f0244a04da0b5bec8a05403d4ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:05:23.688995 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-7f595107-8c47-4a1c-8403-fdf9d84ea7f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:23.690245 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-7f595107-8c47-4a1c-8403-fdf9d84ea7f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:23.694474 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 951/1907] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:05:23 2022] DELETE /identity/v3/projects/ba6b5f0244a04da0b5bec8a05403d4ca => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:05:23.697612 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78f64f-527d-4dc1-93eb-53aee6e8fee3 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:23.698080 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78f64f-527d-4dc1-93eb-53aee6e8fee3 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:23.698382 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78f64f-527d-4dc1-93eb-53aee6e8fee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:23.721564 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-be78f64f-527d-4dc1-93eb-53aee6e8fee3 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:23.723929 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-be78f64f-527d-4dc1-93eb-53aee6e8fee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:23.771924 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a44c8b-6d9d-43da-8200-83b1b1388edf admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:23.782136 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670b1a5-a1d9-4ffe-ba39-2bbc304f16f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:23.783275 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670b1a5-a1d9-4ffe-ba39-2bbc304f16f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:23.783918 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670b1a5-a1d9-4ffe-ba39-2bbc304f16f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:23.784427 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670b1a5-a1d9-4ffe-ba39-2bbc304f16f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:23.786234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670b1a5-a1d9-4ffe-ba39-2bbc304f16f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:23.790396 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670b1a5-a1d9-4ffe-ba39-2bbc304f16f4 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:23.812849 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 957/1908] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:23.818874 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670b1a5-a1d9-4ffe-ba39-2bbc304f16f4 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:23.821857 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d670b1a5-a1d9-4ffe-ba39-2bbc304f16f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:23.844579 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670b1a5-a1d9-4ffe-ba39-2bbc304f16f4 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:23.851524 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 952/1909] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:05:23.854582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423c10d-4f46-40a3-b45f-8fb78b342e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:23.854582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423c10d-4f46-40a3-b45f-8fb78b342e4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:23.854582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423c10d-4f46-40a3-b45f-8fb78b342e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:23.854582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423c10d-4f46-40a3-b45f-8fb78b342e4d admin admin] PATH_INFO: `/v3/projects/4027a864512349e1bed741d262281554/users/c5c176d7b1dc4d7f84126abf10a035da/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:23.855785 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423c10d-4f46-40a3-b45f-8fb78b342e4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4027a864512349e1bed741d262281554, user_id=c5c176d7b1dc4d7f84126abf10a035da, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:23.858913 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423c10d-4f46-40a3-b45f-8fb78b342e4d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:23.860066 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39275c1-dbc9-435a-badf-a1edfd5a2501 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:23.860364 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39275c1-dbc9-435a-badf-a1edfd5a2501 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:23.860645 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39275c1-dbc9-435a-badf-a1edfd5a2501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:23.872281 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 958/1910] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:23 2022] PUT /identity/v3/projects/4027a864512349e1bed741d262281554/users/c5c176d7b1dc4d7f84126abf10a035da/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:23.884428 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf814b50-ef92-4c6c-bc06-3ac76218fe89 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:23.884719 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf814b50-ef92-4c6c-bc06-3ac76218fe89 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:23.885025 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf814b50-ef92-4c6c-bc06-3ac76218fe89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:23.885269 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-e39275c1-dbc9-435a-badf-a1edfd5a2501 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:23.887034 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-e39275c1-dbc9-435a-badf-a1edfd5a2501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:23.922041 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-bf814b50-ef92-4c6c-bc06-3ac76218fe89 None None] MFA Rules not processed for user `c5c176d7b1dc4d7f84126abf10a035da`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:23.923454 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-bf814b50-ef92-4c6c-bc06-3ac76218fe89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:23.965435 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 953/1911] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:05:23.969004 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39275c1-dbc9-435a-badf-a1edfd5a2501 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:23.979763 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39275c1-dbc9-435a-badf-a1edfd5a2501 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:23.986106 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd663d03-e1b4-4737-a641-4dfa7ee1f14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:23.987528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd663d03-e1b4-4737-a641-4dfa7ee1f14f admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:23.987528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd663d03-e1b4-4737-a641-4dfa7ee1f14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:23.987528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd663d03-e1b4-4737-a641-4dfa7ee1f14f admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:23.988298 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd663d03-e1b4-4737-a641-4dfa7ee1f14f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:05:23.988643 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd663d03-e1b4-4737-a641-4dfa7ee1f14f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:23.991934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd663d03-e1b4-4737-a641-4dfa7ee1f14f admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:24.011152 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 954/1912] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:05:24.013210 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd663d03-e1b4-4737-a641-4dfa7ee1f14f admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:24.028623 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 959/1913] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:05:24.033876 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd663d03-e1b4-4737-a641-4dfa7ee1f14f admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:24.040723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11a48c-8463-4f7e-a458-e10bfd94ce75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:24.041738 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11a48c-8463-4f7e-a458-e10bfd94ce75 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:24.042062 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11a48c-8463-4f7e-a458-e10bfd94ce75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:24.042518 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11a48c-8463-4f7e-a458-e10bfd94ce75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:24.043959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11a48c-8463-4f7e-a458-e10bfd94ce75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:24.044497 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf814b50-ef92-4c6c-bc06-3ac76218fe89 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:24.046020 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-bf814b50-ef92-4c6c-bc06-3ac76218fe89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:24.046163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11a48c-8463-4f7e-a458-e10bfd94ce75 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:24.060965 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf814b50-ef92-4c6c-bc06-3ac76218fe89 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:24.067824 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfbc88-7080-4151-a921-7b991236ce04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:24.068936 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfbc88-7080-4151-a921-7b991236ce04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:24.069436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfbc88-7080-4151-a921-7b991236ce04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:24.069969 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfbc88-7080-4151-a921-7b991236ce04 admin admin] PATH_INFO: `/v3/users/0e3000deb12242a5a1c33098cc226077` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:24.071637 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bfbc88-7080-4151-a921-7b991236ce04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e3000deb12242a5a1c33098cc226077)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:24.073879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bfbc88-7080-4151-a921-7b991236ce04 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:24.090358 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 955/1914] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:05:24 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:24.090358 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11a48c-8463-4f7e-a458-e10bfd94ce75 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:24.092406 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-1a11a48c-8463-4f7e-a458-e10bfd94ce75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:24.094416 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:24.145339 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-83bfbc88-7080-4151-a921-7b991236ce04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e3000deb12242a5a1c33098cc226077'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:24.153943 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-83bfbc88-7080-4151-a921-7b991236ce04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e3000deb12242a5a1c33098cc226077'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:24.154681 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-83bfbc88-7080-4151-a921-7b991236ce04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e3000deb12242a5a1c33098cc226077'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:24.160679 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11a48c-8463-4f7e-a458-e10bfd94ce75 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:24.165253 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b5c84-8e5b-44ff-9b75-f16517568363 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:24.166002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b5c84-8e5b-44ff-9b75-f16517568363 service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:24.166234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b5c84-8e5b-44ff-9b75-f16517568363 service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:24.167765 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b5c84-8e5b-44ff-9b75-f16517568363 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:24.168002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-83bfbc88-7080-4151-a921-7b991236ce04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e3000deb12242a5a1c33098cc226077'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:24.168771 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-83bfbc88-7080-4151-a921-7b991236ce04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e3000deb12242a5a1c33098cc226077'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:24.170535 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-399b5c84-8e5b-44ff-9b75-f16517568363 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:24.176256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:24.183693 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 960/1915] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:05:24 2022] DELETE /identity/v3/users/0e3000deb12242a5a1c33098cc226077 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:24.185029 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfbc88-7080-4151-a921-7b991236ce04 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:24.186529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-83bfbc88-7080-4151-a921-7b991236ce04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:24.241710 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b5c84-8e5b-44ff-9b75-f16517568363 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:24.243278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b5c84-8e5b-44ff-9b75-f16517568363 service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:24.252724 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 956/1916] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:24.253808 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875932c4-dfa9-4f68-9367-d86b1b718230 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:24.253921 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfbc88-7080-4151-a921-7b991236ce04 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:24.254098 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875932c4-dfa9-4f68-9367-d86b1b718230 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:24.254409 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875932c4-dfa9-4f68-9367-d86b1b718230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:24.258970 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c50f09-357a-459f-9544-7d37bb1f1492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:24.259514 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c50f09-357a-459f-9544-7d37bb1f1492 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:24.259793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c50f09-357a-459f-9544-7d37bb1f1492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:24.260089 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c50f09-357a-459f-9544-7d37bb1f1492 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:24.260723 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c50f09-357a-459f-9544-7d37bb1f1492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:24.262734 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c50f09-357a-459f-9544-7d37bb1f1492 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:24.288373 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-875932c4-dfa9-4f68-9367-d86b1b718230 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:24.289925 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-875932c4-dfa9-4f68-9367-d86b1b718230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:24.293565 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 961/1917] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:05:24 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:24.294771 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c50f09-357a-459f-9544-7d37bb1f1492 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:24.302697 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 957/1918] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:24.309832 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c50f09-357a-459f-9544-7d37bb1f1492 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:24.315507 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3052d-4d03-4b58-8326-acbea5361837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:24.316117 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3052d-4d03-4b58-8326-acbea5361837 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:24.316411 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3052d-4d03-4b58-8326-acbea5361837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:24.316678 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3052d-4d03-4b58-8326-acbea5361837 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:24.317180 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875932c4-dfa9-4f68-9367-d86b1b718230 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:24.317387 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3052d-4d03-4b58-8326-acbea5361837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:24.319377 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-875932c4-dfa9-4f68-9367-d86b1b718230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:24.319504 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3052d-4d03-4b58-8326-acbea5361837 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:24.332788 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 962/1919] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:24.338151 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3052d-4d03-4b58-8326-acbea5361837 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:24.349589 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3052d-4d03-4b58-8326-acbea5361837 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:24.355893 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653dcc4-68fa-4403-bb61-5bae3289832b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:24.356646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653dcc4-68fa-4403-bb61-5bae3289832b admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:24.357051 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653dcc4-68fa-4403-bb61-5bae3289832b admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:24.357432 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653dcc4-68fa-4403-bb61-5bae3289832b admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:24.358249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653dcc4-68fa-4403-bb61-5bae3289832b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:24.360135 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653dcc4-68fa-4403-bb61-5bae3289832b admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:24.373915 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 963/1920] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:24.378738 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653dcc4-68fa-4403-bb61-5bae3289832b admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:24.392044 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653dcc4-68fa-4403-bb61-5bae3289832b admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:24.398584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71a757-d711-4bcd-b1c7-c004066f6e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:24.399403 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71a757-d711-4bcd-b1c7-c004066f6e02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:24.399784 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71a757-d711-4bcd-b1c7-c004066f6e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:24.400471 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71a757-d711-4bcd-b1c7-c004066f6e02 admin admin] PATH_INFO: `/v3/projects/45031b65905c4a86a6f262b3b28d4242/users/ac76c685a94f429e8d1572885c9adce8/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:24.421350 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875932c4-dfa9-4f68-9367-d86b1b718230 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:24.423047 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71a757-d711-4bcd-b1c7-c004066f6e02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45031b65905c4a86a6f262b3b28d4242, user_id=ac76c685a94f429e8d1572885c9adce8, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:24.425355 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ce0cf-ab58-46ab-830f-a726500fce11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:24.425736 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71a757-d711-4bcd-b1c7-c004066f6e02 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:24.426043 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ce0cf-ab58-46ab-830f-a726500fce11 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:24.427081 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ce0cf-ab58-46ab-830f-a726500fce11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:24.427370 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ce0cf-ab58-46ab-830f-a726500fce11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:24.444404 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ce0cf-ab58-46ab-830f-a726500fce11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:24.446019 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ce0cf-ab58-46ab-830f-a726500fce11 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:24.449939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 964/1921] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:24 2022] PUT /identity/v3/projects/45031b65905c4a86a6f262b3b28d4242/users/ac76c685a94f429e8d1572885c9adce8/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:05:24.464650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 958/1922] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:24.464847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0389e65-bda0-4609-a767-f619ea1435c6 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:24.464847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0389e65-bda0-4609-a767-f619ea1435c6 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:24.465011 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0389e65-bda0-4609-a767-f619ea1435c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:24.500204 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-e0389e65-bda0-4609-a767-f619ea1435c6 None None] MFA Rules not processed for user `ac76c685a94f429e8d1572885c9adce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:24.501721 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e0389e65-bda0-4609-a767-f619ea1435c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:24.538715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=86,keystone:DELETE=9,keystone:INSERT=5 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:24.684595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 965/1923] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:05:24.690142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ce0cf-ab58-46ab-830f-a726500fce11 service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:24.718357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ce0cf-ab58-46ab-830f-a726500fce11 service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:24.851182 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e8aad-be93-46f4-9249-0ead8812e4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:24.852047 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e8aad-be93-46f4-9249-0ead8812e4df admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:24.852340 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e8aad-be93-46f4-9249-0ead8812e4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:24.852981 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e8aad-be93-46f4-9249-0ead8812e4df admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:24.853829 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e8aad-be93-46f4-9249-0ead8812e4df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:24.855532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e8aad-be93-46f4-9249-0ead8812e4df admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:24.893610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 959/1924] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:05:24 2022] POST /identity/v3/projects => generated 387 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:24.897393 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0389e65-bda0-4609-a767-f619ea1435c6 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:24.918876 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0389e65-bda0-4609-a767-f619ea1435c6 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:24.977235 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e8aad-be93-46f4-9249-0ead8812e4df admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:24.979106 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-9b4e8aad-be93-46f4-9249-0ead8812e4df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:25.023521 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:25.028517 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c91ae7-1acc-4b21-a1be-7c369d348fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:25.029176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c91ae7-1acc-4b21-a1be-7c369d348fdc admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:25.029502 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c91ae7-1acc-4b21-a1be-7c369d348fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:25.029800 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c91ae7-1acc-4b21-a1be-7c369d348fdc admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:25.030504 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c91ae7-1acc-4b21-a1be-7c369d348fdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:25.032486 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c91ae7-1acc-4b21-a1be-7c369d348fdc admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:25.067058 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e8aad-be93-46f4-9249-0ead8812e4df admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:25.069038 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 966/1925] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:05:24 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:25.072512 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19d555-e7c5-46eb-9e25-825477474402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:25.073222 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19d555-e7c5-46eb-9e25-825477474402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:25.073543 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19d555-e7c5-46eb-9e25-825477474402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:25.074311 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c91ae7-1acc-4b21-a1be-7c369d348fdc admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:25.074629 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19d555-e7c5-46eb-9e25-825477474402 admin admin] PATH_INFO: `/v3/projects/97c1a840d4164f529947ecabac60b542` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:25.075883 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19d555-e7c5-46eb-9e25-825477474402 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97c1a840d4164f529947ecabac60b542)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:25.077921 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19d555-e7c5-46eb-9e25-825477474402 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:25.088493 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c91ae7-1acc-4b21-a1be-7c369d348fdc admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:25.106353 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831afd6-f606-47f5-97b9-08ac21906e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:25.107011 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831afd6-f606-47f5-97b9-08ac21906e49 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:25.107290 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831afd6-f606-47f5-97b9-08ac21906e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:25.107565 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831afd6-f606-47f5-97b9-08ac21906e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:25.108336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a831afd6-f606-47f5-97b9-08ac21906e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:25.110484 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a831afd6-f606-47f5-97b9-08ac21906e49 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:25.143908 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 967/1926] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:25.148485 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831afd6-f606-47f5-97b9-08ac21906e49 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:25.165165 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831afd6-f606-47f5-97b9-08ac21906e49 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:25.169338 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-de19d555-e7c5-46eb-9e25-825477474402 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97c1a840d4164f529947ecabac60b542', 'request_id': 'req-de19d555-e7c5-46eb-9e25-825477474402'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:25.180040 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-de19d555-e7c5-46eb-9e25-825477474402 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97c1a840d4164f529947ecabac60b542', 'request_id': 'req-de19d555-e7c5-46eb-9e25-825477474402'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:25.190871 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-de19d555-e7c5-46eb-9e25-825477474402 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97c1a840d4164f529947ecabac60b542', 'request_id': 'req-de19d555-e7c5-46eb-9e25-825477474402'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:25.210967 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-de19d555-e7c5-46eb-9e25-825477474402 admin admin] The token cache is being invalidate because project 97c1a840d4164f529947ecabac60b542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:05:25.211561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-de19d555-e7c5-46eb-9e25-825477474402 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:25.212542 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-de19d555-e7c5-46eb-9e25-825477474402 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:25.218894 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 960/1927] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:05:24 2022] DELETE /identity/v3/projects/97c1a840d4164f529947ecabac60b542 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:05:25.221807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fea7cd-6dd4-4a87-b77e-e56b9567fa8f None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:25.222412 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fea7cd-6dd4-4a87-b77e-e56b9567fa8f None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:25.222931 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fea7cd-6dd4-4a87-b77e-e56b9567fa8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:25.241996 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a1cf1-d93f-4a6d-8125-ab5d34112ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:25.243271 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a1cf1-d93f-4a6d-8125-ab5d34112ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:25.243497 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a1cf1-d93f-4a6d-8125-ab5d34112ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:25.243781 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a1cf1-d93f-4a6d-8125-ab5d34112ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:25.244660 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a1cf1-d93f-4a6d-8125-ab5d34112ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:25.246301 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a1cf1-d93f-4a6d-8125-ab5d34112ff5 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:25.261480 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-e0fea7cd-6dd4-4a87-b77e-e56b9567fa8f None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:25.262846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-e0fea7cd-6dd4-4a87-b77e-e56b9567fa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:25.267734 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 968/1928] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:05:25.272378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a1cf1-d93f-4a6d-8125-ab5d34112ff5 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:25.274029 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-945a1cf1-d93f-4a6d-8125-ab5d34112ff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:25.280824 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 961/1929] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:25.288625 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d84cd4-1a93-4de0-ab57-6e0c97ee8329 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:25.288959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d84cd4-1a93-4de0-ab57-6e0c97ee8329 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:25.289214 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d84cd4-1a93-4de0-ab57-6e0c97ee8329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:25.295739 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a1cf1-d93f-4a6d-8125-ab5d34112ff5 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:25.303764 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e2178-77f2-4cf8-a1ff-730c8a6b056f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:25.304732 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e2178-77f2-4cf8-a1ff-730c8a6b056f admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:25.305290 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e2178-77f2-4cf8-a1ff-730c8a6b056f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:25.305722 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e2178-77f2-4cf8-a1ff-730c8a6b056f admin admin] PATH_INFO: `/v3/projects/8518ee8de92848dab231dfb494dbe49e/users/e8abb62eb6cd4b7cbcf8487416eb8ed1/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:25.315856 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-e4d84cd4-1a93-4de0-ab57-6e0c97ee8329 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:25.317418 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-e4d84cd4-1a93-4de0-ab57-6e0c97ee8329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:25.328204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 962/1930] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:25.332617 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d84cd4-1a93-4de0-ab57-6e0c97ee8329 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:25.333316 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e2178-77f2-4cf8-a1ff-730c8a6b056f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8518ee8de92848dab231dfb494dbe49e, user_id=e8abb62eb6cd4b7cbcf8487416eb8ed1, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:25.341790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e2178-77f2-4cf8-a1ff-730c8a6b056f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:25.346531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d84cd4-1a93-4de0-ab57-6e0c97ee8329 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:25.352080 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9288f1-14d7-4b7a-8d2d-c4d628cb71a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:25.352771 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9288f1-14d7-4b7a-8d2d-c4d628cb71a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:25.353136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9288f1-14d7-4b7a-8d2d-c4d628cb71a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:25.353422 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9288f1-14d7-4b7a-8d2d-c4d628cb71a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:25.354505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9288f1-14d7-4b7a-8d2d-c4d628cb71a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:05:25.354617 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9288f1-14d7-4b7a-8d2d-c4d628cb71a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:25.356326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9288f1-14d7-4b7a-8d2d-c4d628cb71a2 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:25.359971 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 969/1931] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:25 2022] PUT /identity/v3/projects/8518ee8de92848dab231dfb494dbe49e/users/e8abb62eb6cd4b7cbcf8487416eb8ed1/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:05:25.371023 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3f892-8a4c-4f4e-b5d0-3896283ea976 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:25.371400 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3f892-8a4c-4f4e-b5d0-3896283ea976 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:25.371565 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3f892-8a4c-4f4e-b5d0-3896283ea976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:25.375651 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 963/1932] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 09:05:25.377000 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9288f1-14d7-4b7a-8d2d-c4d628cb71a2 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:25.390592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9288f1-14d7-4b7a-8d2d-c4d628cb71a2 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:25.405758 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-ebc3f892-8a4c-4f4e-b5d0-3896283ea976 None None] MFA Rules not processed for user `e8abb62eb6cd4b7cbcf8487416eb8ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:25.407221 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ebc3f892-8a4c-4f4e-b5d0-3896283ea976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:25.411452 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:25.456950 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e514a92-3684-49ce-b85a-ee04d9c4b86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:25.457979 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e514a92-3684-49ce-b85a-ee04d9c4b86f admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:25.458519 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e514a92-3684-49ce-b85a-ee04d9c4b86f admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:25.459009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e514a92-3684-49ce-b85a-ee04d9c4b86f admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:25.460669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e514a92-3684-49ce-b85a-ee04d9c4b86f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:25.464293 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e514a92-3684-49ce-b85a-ee04d9c4b86f admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:25.488230 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 970/1933] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:05:25.493969 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3f892-8a4c-4f4e-b5d0-3896283ea976 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:25.507550 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3f892-8a4c-4f4e-b5d0-3896283ea976 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:25.514141 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 964/1934] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:05:25 2022] POST /identity/v3/projects => generated 365 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:05:25.515237 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e514a92-3684-49ce-b85a-ee04d9c4b86f admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:25.544660 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:25.607009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e514a92-3684-49ce-b85a-ee04d9c4b86f admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:25.609701 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cea91-1d20-41cc-80ff-bafb03e434af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:25.610705 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cea91-1d20-41cc-80ff-bafb03e434af admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:25.611143 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cea91-1d20-41cc-80ff-bafb03e434af admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:25.611560 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cea91-1d20-41cc-80ff-bafb03e434af admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:25.612671 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797cea91-1d20-41cc-80ff-bafb03e434af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:25.613496 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd52c0-5c0e-46c2-a053-daeab5a13995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:25.614254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd52c0-5c0e-46c2-a053-daeab5a13995 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:25.614698 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd52c0-5c0e-46c2-a053-daeab5a13995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:25.615102 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd52c0-5c0e-46c2-a053-daeab5a13995 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:25.616459 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd52c0-5c0e-46c2-a053-daeab5a13995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:25.616674 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797cea91-1d20-41cc-80ff-bafb03e434af admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:25.618829 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd52c0-5c0e-46c2-a053-daeab5a13995 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:25.646005 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 965/1935] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:05:25 2022] POST /identity/v3/users => generated 283 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:05:25.661064 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd52c0-5c0e-46c2-a053-daeab5a13995 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:25.666173 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 971/1936] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:05:25 2022] POST /identity/v3/projects => generated 387 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:25.667528 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cea91-1d20-41cc-80ff-bafb03e434af admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:25.671508 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd52c0-5c0e-46c2-a053-daeab5a13995 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:25.753834 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4a1ff-55fc-46a5-905a-3d0c27114f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:25.754617 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4a1ff-55fc-46a5-905a-3d0c27114f2e admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:25.755106 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4a1ff-55fc-46a5-905a-3d0c27114f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:25.755286 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4a1ff-55fc-46a5-905a-3d0c27114f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:25.756615 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc4a1ff-55fc-46a5-905a-3d0c27114f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:25.758297 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc4a1ff-55fc-46a5-905a-3d0c27114f2e admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:25.764278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cea91-1d20-41cc-80ff-bafb03e434af admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:25.771976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fffc6-a74a-4a94-8fab-8857c956b5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:25.773654 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fffc6-a74a-4a94-8fab-8857c956b5d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:25.774135 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fffc6-a74a-4a94-8fab-8857c956b5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:25.774451 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fffc6-a74a-4a94-8fab-8857c956b5d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:25.775131 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fffc6-a74a-4a94-8fab-8857c956b5d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:25.777738 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fffc6-a74a-4a94-8fab-8857c956b5d3 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:25.782528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 966/1937] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:25.786560 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4a1ff-55fc-46a5-905a-3d0c27114f2e admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:25.808999 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 972/1938] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:05:25 2022] POST /identity/v3/users => generated 300 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:25.813745 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4a1ff-55fc-46a5-905a-3d0c27114f2e admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:25.814016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fffc6-a74a-4a94-8fab-8857c956b5d3 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:25.825575 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3c510-5a77-49e0-b9da-1c77bb1cc6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:25.826354 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3c510-5a77-49e0-b9da-1c77bb1cc6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:25.826656 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3c510-5a77-49e0-b9da-1c77bb1cc6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:25.826940 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3c510-5a77-49e0-b9da-1c77bb1cc6e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:25.827511 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fffc6-a74a-4a94-8fab-8857c956b5d3 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:25.827677 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3c510-5a77-49e0-b9da-1c77bb1cc6e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:25.833480 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9e166-9b5b-421b-a9e0-4a258592d6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:25.833731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3c510-5a77-49e0-b9da-1c77bb1cc6e6 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:25.834112 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9e166-9b5b-421b-a9e0-4a258592d6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:25.834481 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9e166-9b5b-421b-a9e0-4a258592d6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:25.834763 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9e166-9b5b-421b-a9e0-4a258592d6b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:25.836175 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9e166-9b5b-421b-a9e0-4a258592d6b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:25.837983 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9e166-9b5b-421b-a9e0-4a258592d6b7 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:25.862402 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 967/1939] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:05:25.862618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 973/1940] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:25.862702 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3c510-5a77-49e0-b9da-1c77bb1cc6e6 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:25.864932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9e166-9b5b-421b-a9e0-4a258592d6b7 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:25.873977 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3c510-5a77-49e0-b9da-1c77bb1cc6e6 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:25.879063 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569edae-cf71-4b19-b840-4cc8674214f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:25.893293 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569edae-cf71-4b19-b840-4cc8674214f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:25.893858 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569edae-cf71-4b19-b840-4cc8674214f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:25.894423 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569edae-cf71-4b19-b840-4cc8674214f5 admin admin] PATH_INFO: `/v3/projects/34caf3c110e84247a55128ea45da3ef5/users/6a57d63631fd4da8b3d998e1b2a842da/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:25.894837 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9e166-9b5b-421b-a9e0-4a258592d6b7 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:25.910559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac31885-a447-464c-9b37-c384eedd4c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:25.910559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac31885-a447-464c-9b37-c384eedd4c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:25.910559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac31885-a447-464c-9b37-c384eedd4c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:25.910559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac31885-a447-464c-9b37-c384eedd4c45 admin admin] PATH_INFO: `/v3/projects/7e46d3d9aefe4f54b773a020b2312b57/users/452bc9c8b4674c78bea3faf09da4dc95/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:25.910942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:25.936519 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9569edae-cf71-4b19-b840-4cc8674214f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34caf3c110e84247a55128ea45da3ef5, user_id=6a57d63631fd4da8b3d998e1b2a842da, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:25.938905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac31885-a447-464c-9b37-c384eedd4c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e46d3d9aefe4f54b773a020b2312b57, user_id=452bc9c8b4674c78bea3faf09da4dc95, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:25.939987 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9569edae-cf71-4b19-b840-4cc8674214f5 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:25.947433 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac31885-a447-464c-9b37-c384eedd4c45 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:25.968623 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 968/1941] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:25 2022] PUT /identity/v3/projects/34caf3c110e84247a55128ea45da3ef5/users/6a57d63631fd4da8b3d998e1b2a842da/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:25.969690 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569edae-cf71-4b19-b840-4cc8674214f5 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:25.971490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-9569edae-cf71-4b19-b840-4cc8674214f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:25.975669 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 974/1942] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:25 2022] PUT /identity/v3/projects/7e46d3d9aefe4f54b773a020b2312b57/users/452bc9c8b4674c78bea3faf09da4dc95/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:25.976810 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac31885-a447-464c-9b37-c384eedd4c45 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:26.070732 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569edae-cf71-4b19-b840-4cc8674214f5 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:26.093615 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:26.106473 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac31885-a447-464c-9b37-c384eedd4c45 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:26.111585 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213526b-0372-4a96-9bdf-bb5f84fba529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:26.112082 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213526b-0372-4a96-9bdf-bb5f84fba529 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:26.112837 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213526b-0372-4a96-9bdf-bb5f84fba529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:26.113120 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213526b-0372-4a96-9bdf-bb5f84fba529 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:26.114533 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213526b-0372-4a96-9bdf-bb5f84fba529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:26.115667 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213526b-0372-4a96-9bdf-bb5f84fba529 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:26.134184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 975/1943] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:26.135891 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02c471-21ab-48d4-a630-38efe85f607b None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:26.136184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02c471-21ab-48d4-a630-38efe85f607b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:26.136475 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02c471-21ab-48d4-a630-38efe85f607b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:26.139941 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d907a-6b63-45fb-b6b4-6d3ecb1d2ddb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:26.141066 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d907a-6b63-45fb-b6b4-6d3ecb1d2ddb service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:26.141066 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d907a-6b63-45fb-b6b4-6d3ecb1d2ddb service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:26.141242 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d907a-6b63-45fb-b6b4-6d3ecb1d2ddb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:26.143835 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-119d907a-6b63-45fb-b6b4-6d3ecb1d2ddb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:26.169098 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-1a02c471-21ab-48d4-a630-38efe85f607b None None] MFA Rules not processed for user `452bc9c8b4674c78bea3faf09da4dc95`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:26.171834 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1a02c471-21ab-48d4-a630-38efe85f607b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:26.237333 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d907a-6b63-45fb-b6b4-6d3ecb1d2ddb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:26.238105 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d907a-6b63-45fb-b6b4-6d3ecb1d2ddb service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:26.250615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 976/1944] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:26.251797 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02c471-21ab-48d4-a630-38efe85f607b None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:26.256246 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 969/1945] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:26.263851 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d907a-6b63-45fb-b6b4-6d3ecb1d2ddb service cinder] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:26.264311 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02c471-21ab-48d4-a630-38efe85f607b None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:26.266391 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-119d907a-6b63-45fb-b6b4-6d3ecb1d2ddb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:26.269061 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1c4f7-3d14-4011-a8ac-042c88d1b91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:26.269746 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1c4f7-3d14-4011-a8ac-042c88d1b91b admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:26.270036 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1c4f7-3d14-4011-a8ac-042c88d1b91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:26.270326 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1c4f7-3d14-4011-a8ac-042c88d1b91b admin admin] PATH_INFO: `/v3/projects/34caf3c110e84247a55128ea45da3ef5/users/6a57d63631fd4da8b3d998e1b2a842da/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:26.272812 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c1c4f7-3d14-4011-a8ac-042c88d1b91b admin admin] RBAC: Authorizing `identity:create_grant(project_id=34caf3c110e84247a55128ea45da3ef5, user_id=6a57d63631fd4da8b3d998e1b2a842da, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:26.276327 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c1c4f7-3d14-4011-a8ac-042c88d1b91b admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:26.280714 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d907a-6b63-45fb-b6b4-6d3ecb1d2ddb service cinder] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:26.287611 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 977/1946] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:26 2022] PUT /identity/v3/projects/34caf3c110e84247a55128ea45da3ef5/users/6a57d63631fd4da8b3d998e1b2a842da/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:26.298278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0645b3-fed4-46ad-bbcc-19dd04c5bf2b None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:26.298690 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0645b3-fed4-46ad-bbcc-19dd04c5bf2b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:26.299336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0645b3-fed4-46ad-bbcc-19dd04c5bf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:26.332785 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-3f0645b3-fed4-46ad-bbcc-19dd04c5bf2b None None] MFA Rules not processed for user `6a57d63631fd4da8b3d998e1b2a842da`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:26.334124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-3f0645b3-fed4-46ad-bbcc-19dd04c5bf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:26.360835 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63c2c0-6afd-47cc-af0d-9366b9703037 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:26.361575 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63c2c0-6afd-47cc-af0d-9366b9703037 service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:26.361956 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63c2c0-6afd-47cc-af0d-9366b9703037 service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:26.362373 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63c2c0-6afd-47cc-af0d-9366b9703037 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:26.416492 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:26.448608 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 978/1947] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:26.462198 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63c2c0-6afd-47cc-af0d-9366b9703037 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:26.465157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63c2c0-6afd-47cc-af0d-9366b9703037 service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:26.478981 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 970/1948] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:26 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:26.505287 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0645b3-fed4-46ad-bbcc-19dd04c5bf2b None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:26.518930 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0645b3-fed4-46ad-bbcc-19dd04c5bf2b None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:26.524484 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7de49-06ee-4982-bd3a-938c81df4d7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:26.525554 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7de49-06ee-4982-bd3a-938c81df4d7f service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:26.525939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7de49-06ee-4982-bd3a-938c81df4d7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:26.526692 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7de49-06ee-4982-bd3a-938c81df4d7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:26.540729 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7de49-06ee-4982-bd3a-938c81df4d7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:26.543499 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7de49-06ee-4982-bd3a-938c81df4d7f service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:26.561032 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 979/1949] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:27.418800 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63c2c0-6afd-47cc-af0d-9366b9703037 service cinder] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:27.432850 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63c2c0-6afd-47cc-af0d-9366b9703037 service cinder] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:27.438897 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0685519-949b-4d40-88c9-db8898ed33a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:27.439910 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0685519-949b-4d40-88c9-db8898ed33a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:27.440508 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0685519-949b-4d40-88c9-db8898ed33a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:27.440963 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0685519-949b-4d40-88c9-db8898ed33a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:27.444522 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-d0685519-949b-4d40-88c9-db8898ed33a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:27.482500 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:27.525057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0685519-949b-4d40-88c9-db8898ed33a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:27.526585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0685519-949b-4d40-88c9-db8898ed33a6 service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:27.537371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 971/1950] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:30.483478 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7de49-06ee-4982-bd3a-938c81df4d7f service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:30.485090 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-74b7de49-06ee-4982-bd3a-938c81df4d7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:30.573249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7de49-06ee-4982-bd3a-938c81df4d7f service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:30.577888 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4252d2e-69ff-48f8-8e68-b85267c357f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:30.578603 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4252d2e-69ff-48f8-8e68-b85267c357f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:30.578886 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4252d2e-69ff-48f8-8e68-b85267c357f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:30.579160 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4252d2e-69ff-48f8-8e68-b85267c357f2 admin admin] PATH_INFO: `/v3/users/0fccb6b833844e7b9b4bbe70345717ae` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:30.580983 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4252d2e-69ff-48f8-8e68-b85267c357f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fccb6b833844e7b9b4bbe70345717ae)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:30.583071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4252d2e-69ff-48f8-8e68-b85267c357f2 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:30.663384 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f4252d2e-69ff-48f8-8e68-b85267c357f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fccb6b833844e7b9b4bbe70345717ae'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:30.680822 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f4252d2e-69ff-48f8-8e68-b85267c357f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fccb6b833844e7b9b4bbe70345717ae'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:30.681630 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f4252d2e-69ff-48f8-8e68-b85267c357f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fccb6b833844e7b9b4bbe70345717ae'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:30.699025 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f4252d2e-69ff-48f8-8e68-b85267c357f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fccb6b833844e7b9b4bbe70345717ae'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:30.699992 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f4252d2e-69ff-48f8-8e68-b85267c357f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fccb6b833844e7b9b4bbe70345717ae'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:30.722555 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 980/1951] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:05:30 2022] DELETE /identity/v3/users/0fccb6b833844e7b9b4bbe70345717ae => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:05:30.728584 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c6e79-672c-44da-9d2a-1009112c6861 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:30.729137 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c6e79-672c-44da-9d2a-1009112c6861 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:30.729137 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c6e79-672c-44da-9d2a-1009112c6861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:30.753951 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-7f9c6e79-672c-44da-9d2a-1009112c6861 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:30.755774 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-7f9c6e79-672c-44da-9d2a-1009112c6861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:30.843465 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 972/1952] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:30.867190 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4252d2e-69ff-48f8-8e68-b85267c357f2 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:30.870339 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f4252d2e-69ff-48f8-8e68-b85267c357f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:30.994744 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:31.023603 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4252d2e-69ff-48f8-8e68-b85267c357f2 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:31.043040 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6377f4-b75a-4c22-a069-63fa5830dfc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:31.043609 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6377f4-b75a-4c22-a069-63fa5830dfc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:31.043895 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6377f4-b75a-4c22-a069-63fa5830dfc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:31.044171 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6377f4-b75a-4c22-a069-63fa5830dfc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:31.061001 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6377f4-b75a-4c22-a069-63fa5830dfc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:31.063727 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6377f4-b75a-4c22-a069-63fa5830dfc2 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:31.083923 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 981/1953] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:32.095355 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c6e79-672c-44da-9d2a-1009112c6861 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:32.097183 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-7f9c6e79-672c-44da-9d2a-1009112c6861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:32.177159 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c6e79-672c-44da-9d2a-1009112c6861 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:32.182992 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81beff50-de90-468c-9881-33c4de0b5136 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:32.184217 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81beff50-de90-468c-9881-33c4de0b5136 service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:32.184217 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81beff50-de90-468c-9881-33c4de0b5136 service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:32.184520 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81beff50-de90-468c-9881-33c4de0b5136 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:32.187892 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-81beff50-de90-468c-9881-33c4de0b5136 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:32.272806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81beff50-de90-468c-9881-33c4de0b5136 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:32.274267 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81beff50-de90-468c-9881-33c4de0b5136 service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:32.285535 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 973/1954] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:32.291522 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6377f4-b75a-4c22-a069-63fa5830dfc2 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:32.294224 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ae6377f4-b75a-4c22-a069-63fa5830dfc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:32.315684 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6377f4-b75a-4c22-a069-63fa5830dfc2 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:32.321642 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c84d9-acd2-4c17-9d55-230bc956bef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:32.322304 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c84d9-acd2-4c17-9d55-230bc956bef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:32.322681 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c84d9-acd2-4c17-9d55-230bc956bef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:32.323070 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c84d9-acd2-4c17-9d55-230bc956bef4 admin admin] PATH_INFO: `/v3/projects/e0854d0e43db4747a711fb75971253c0` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:32.339682 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c84d9-acd2-4c17-9d55-230bc956bef4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0854d0e43db4747a711fb75971253c0)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:32.343469 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c84d9-acd2-4c17-9d55-230bc956bef4 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:32.416285 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-7d2c84d9-acd2-4c17-9d55-230bc956bef4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0854d0e43db4747a711fb75971253c0', 'request_id': 'req-7d2c84d9-acd2-4c17-9d55-230bc956bef4'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:32.429496 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-7d2c84d9-acd2-4c17-9d55-230bc956bef4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0854d0e43db4747a711fb75971253c0', 'request_id': 'req-7d2c84d9-acd2-4c17-9d55-230bc956bef4'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:32.437238 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-7d2c84d9-acd2-4c17-9d55-230bc956bef4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0854d0e43db4747a711fb75971253c0', 'request_id': 'req-7d2c84d9-acd2-4c17-9d55-230bc956bef4'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:32.485316 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-7d2c84d9-acd2-4c17-9d55-230bc956bef4 admin admin] The token cache is being invalidate because project e0854d0e43db4747a711fb75971253c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:05:32.490577 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-7d2c84d9-acd2-4c17-9d55-230bc956bef4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:32.493737 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-7d2c84d9-acd2-4c17-9d55-230bc956bef4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:32.497905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 982/1955] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:05:32 2022] DELETE /identity/v3/projects/e0854d0e43db4747a711fb75971253c0 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:32.504764 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81beff50-de90-468c-9881-33c4de0b5136 service cinder] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:32.535548 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81beff50-de90-468c-9881-33c4de0b5136 service cinder] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:32.581606 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:32.691501 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1c95f-1509-4eb0-a2b1-7b5203ccafd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:32.692160 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1c95f-1509-4eb0-a2b1-7b5203ccafd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:32.692453 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1c95f-1509-4eb0-a2b1-7b5203ccafd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:32.692725 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1c95f-1509-4eb0-a2b1-7b5203ccafd7 admin admin] PATH_INFO: `/v3/users/c5c176d7b1dc4d7f84126abf10a035da` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:32.695458 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1c95f-1509-4eb0-a2b1-7b5203ccafd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5c176d7b1dc4d7f84126abf10a035da)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:32.697457 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1c95f-1509-4eb0-a2b1-7b5203ccafd7 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:32.787359 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-e8d1c95f-1509-4eb0-a2b1-7b5203ccafd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5c176d7b1dc4d7f84126abf10a035da'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:32.788366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-e8d1c95f-1509-4eb0-a2b1-7b5203ccafd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5c176d7b1dc4d7f84126abf10a035da'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:32.789526 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-e8d1c95f-1509-4eb0-a2b1-7b5203ccafd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5c176d7b1dc4d7f84126abf10a035da'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:32.800289 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-e8d1c95f-1509-4eb0-a2b1-7b5203ccafd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5c176d7b1dc4d7f84126abf10a035da'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:32.821757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-e8d1c95f-1509-4eb0-a2b1-7b5203ccafd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5c176d7b1dc4d7f84126abf10a035da'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:32.848383 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 974/1956] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:05:32 2022] DELETE /identity/v3/users/c5c176d7b1dc4d7f84126abf10a035da => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:33.605402 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c84d9-acd2-4c17-9d55-230bc956bef4 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:33.607865 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-7d2c84d9-acd2-4c17-9d55-230bc956bef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:33.635247 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c84d9-acd2-4c17-9d55-230bc956bef4 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:33.787348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b13ffd-fbe1-4912-94cf-aac0c0ed3cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:33.790177 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b13ffd-fbe1-4912-94cf-aac0c0ed3cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:33.792133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b13ffd-fbe1-4912-94cf-aac0c0ed3cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:33.792617 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b13ffd-fbe1-4912-94cf-aac0c0ed3cc5 admin admin] PATH_INFO: `/v3/projects/4027a864512349e1bed741d262281554` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:33.795080 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b13ffd-fbe1-4912-94cf-aac0c0ed3cc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4027a864512349e1bed741d262281554)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:33.800433 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b13ffd-fbe1-4912-94cf-aac0c0ed3cc5 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:33.899016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-67b13ffd-fbe1-4912-94cf-aac0c0ed3cc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4027a864512349e1bed741d262281554', 'request_id': 'req-67b13ffd-fbe1-4912-94cf-aac0c0ed3cc5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:33.916681 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-67b13ffd-fbe1-4912-94cf-aac0c0ed3cc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4027a864512349e1bed741d262281554', 'request_id': 'req-67b13ffd-fbe1-4912-94cf-aac0c0ed3cc5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:33.927306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-67b13ffd-fbe1-4912-94cf-aac0c0ed3cc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4027a864512349e1bed741d262281554', 'request_id': 'req-67b13ffd-fbe1-4912-94cf-aac0c0ed3cc5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:33.949105 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-67b13ffd-fbe1-4912-94cf-aac0c0ed3cc5 admin admin] The token cache is being invalidate because project 4027a864512349e1bed741d262281554 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:05:33.949582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-67b13ffd-fbe1-4912-94cf-aac0c0ed3cc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:33.950903 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-67b13ffd-fbe1-4912-94cf-aac0c0ed3cc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:33.952984 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 983/1957] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:05:33 2022] DELETE /identity/v3/projects/4027a864512349e1bed741d262281554 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:33.960575 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62020353-5787-43bd-bd61-20099490cda1 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:33.961208 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62020353-5787-43bd-bd61-20099490cda1 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:33.961208 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62020353-5787-43bd-bd61-20099490cda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:33.983343 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-62020353-5787-43bd-bd61-20099490cda1 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:33.988835 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-62020353-5787-43bd-bd61-20099490cda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:34.076729 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 975/1958] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:34.085757 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57809ef4-022b-4c81-8897-fbde5ee1c295 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:34.086188 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57809ef4-022b-4c81-8897-fbde5ee1c295 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:34.086402 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57809ef4-022b-4c81-8897-fbde5ee1c295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:34.116595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:34.136679 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-57809ef4-022b-4c81-8897-fbde5ee1c295 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:34.138637 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-57809ef4-022b-4c81-8897-fbde5ee1c295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:34.154071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 984/1959] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:34.158490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62020353-5787-43bd-bd61-20099490cda1 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:34.173268 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62020353-5787-43bd-bd61-20099490cda1 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:34.182068 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938d53f-c434-4ad2-89a0-665e18979ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:34.183546 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938d53f-c434-4ad2-89a0-665e18979ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:34.184887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938d53f-c434-4ad2-89a0-665e18979ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:34.185346 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938d53f-c434-4ad2-89a0-665e18979ba5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:34.187249 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938d53f-c434-4ad2-89a0-665e18979ba5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:05:34.187977 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938d53f-c434-4ad2-89a0-665e18979ba5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:34.189660 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938d53f-c434-4ad2-89a0-665e18979ba5 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:34.206028 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 976/1960] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:05:34.213365 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57809ef4-022b-4c81-8897-fbde5ee1c295 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:34.228247 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57809ef4-022b-4c81-8897-fbde5ee1c295 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:34.248314 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d44f2a-0f3e-47a1-9d93-11612a484e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:34.248995 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d44f2a-0f3e-47a1-9d93-11612a484e89 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:34.249274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d44f2a-0f3e-47a1-9d93-11612a484e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:34.249548 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d44f2a-0f3e-47a1-9d93-11612a484e89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:34.250229 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d44f2a-0f3e-47a1-9d93-11612a484e89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:34.252497 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d44f2a-0f3e-47a1-9d93-11612a484e89 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:34.315001 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 985/1961] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:05:34 2022] POST /identity/v3/projects => generated 393 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:34.316676 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938d53f-c434-4ad2-89a0-665e18979ba5 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:34.333666 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938d53f-c434-4ad2-89a0-665e18979ba5 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:34.404275 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:34.446074 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f51e6-dddb-4357-90c2-58eb4f29b832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:34.447123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f51e6-dddb-4357-90c2-58eb4f29b832 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:34.447123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f51e6-dddb-4357-90c2-58eb4f29b832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:34.447328 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f51e6-dddb-4357-90c2-58eb4f29b832 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:34.447856 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f51e6-dddb-4357-90c2-58eb4f29b832 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:34.450063 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f51e6-dddb-4357-90c2-58eb4f29b832 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:34.479851 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 977/1962] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:05:34 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:05:34.484626 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d44f2a-0f3e-47a1-9d93-11612a484e89 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:34.496813 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d44f2a-0f3e-47a1-9d93-11612a484e89 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:34.503925 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14a33c-1942-4800-88a3-363f68e118c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:34.504728 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14a33c-1942-4800-88a3-363f68e118c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:34.505072 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14a33c-1942-4800-88a3-363f68e118c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:34.505474 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14a33c-1942-4800-88a3-363f68e118c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:34.506257 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14a33c-1942-4800-88a3-363f68e118c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:34.509354 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14a33c-1942-4800-88a3-363f68e118c5 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:34.530925 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 986/1963] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:34.533776 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f51e6-dddb-4357-90c2-58eb4f29b832 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:34.559934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f51e6-dddb-4357-90c2-58eb4f29b832 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:34.566783 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686a1a0-e1b1-456b-987c-f54b5cc535d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:34.567488 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686a1a0-e1b1-456b-987c-f54b5cc535d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:34.567909 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686a1a0-e1b1-456b-987c-f54b5cc535d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:34.568257 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686a1a0-e1b1-456b-987c-f54b5cc535d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:34.569663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686a1a0-e1b1-456b-987c-f54b5cc535d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:34.571499 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686a1a0-e1b1-456b-987c-f54b5cc535d6 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:34.584380 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 978/1964] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:34.589723 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14a33c-1942-4800-88a3-363f68e118c5 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:34.601670 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14a33c-1942-4800-88a3-363f68e118c5 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:34.607226 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c163373-5549-43b5-a9f7-05a9e963db2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:34.608318 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c163373-5549-43b5-a9f7-05a9e963db2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:34.608811 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c163373-5549-43b5-a9f7-05a9e963db2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:34.609157 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c163373-5549-43b5-a9f7-05a9e963db2b admin admin] PATH_INFO: `/v3/projects/343a9e550963433495b39eb532626a3e/users/6d46a44b81b0443a8e1a18e87eddc8a1/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:34.628544 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c163373-5549-43b5-a9f7-05a9e963db2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=343a9e550963433495b39eb532626a3e, user_id=6d46a44b81b0443a8e1a18e87eddc8a1, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:34.632120 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c163373-5549-43b5-a9f7-05a9e963db2b admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:34.649286 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 987/1965] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:34 2022] PUT /identity/v3/projects/343a9e550963433495b39eb532626a3e/users/6d46a44b81b0443a8e1a18e87eddc8a1/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:05:34.660600 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637ec5f-276d-4d09-8ff2-858a7024b6cd None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:34.660886 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637ec5f-276d-4d09-8ff2-858a7024b6cd None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:34.661165 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637ec5f-276d-4d09-8ff2-858a7024b6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:34.692783 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-7637ec5f-276d-4d09-8ff2-858a7024b6cd None None] MFA Rules not processed for user `6d46a44b81b0443a8e1a18e87eddc8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:34.694067 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-7637ec5f-276d-4d09-8ff2-858a7024b6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:34.771420 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 979/1966] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:34.777958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c163373-5549-43b5-a9f7-05a9e963db2b admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:34.877006 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c163373-5549-43b5-a9f7-05a9e963db2b admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:34.891419 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac912e-e554-4662-938a-adaf4a1bc964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:34.892294 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac912e-e554-4662-938a-adaf4a1bc964 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:34.892652 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac912e-e554-4662-938a-adaf4a1bc964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:34.893165 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac912e-e554-4662-938a-adaf4a1bc964 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:34.895068 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac912e-e554-4662-938a-adaf4a1bc964 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:34.897820 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac912e-e554-4662-938a-adaf4a1bc964 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:34.939636 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 988/1967] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:05:34 2022] POST /identity/v3/projects => generated 393 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:34.946372 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637ec5f-276d-4d09-8ff2-858a7024b6cd None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:34.962415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637ec5f-276d-4d09-8ff2-858a7024b6cd None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:35.044971 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51c8ba-8969-4931-91ec-704e729e05be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:35.045609 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51c8ba-8969-4931-91ec-704e729e05be admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:35.045887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51c8ba-8969-4931-91ec-704e729e05be admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:35.046159 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51c8ba-8969-4931-91ec-704e729e05be admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:35.046858 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51c8ba-8969-4931-91ec-704e729e05be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:35.049001 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51c8ba-8969-4931-91ec-704e729e05be admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:35.077047 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 980/1968] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:05:34 2022] POST /identity/v3/users => generated 303 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:35.083438 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac912e-e554-4662-938a-adaf4a1bc964 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:35.095798 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac912e-e554-4662-938a-adaf4a1bc964 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:35.102570 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e4d0d-6912-4c97-a4ae-99690fe63756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:35.103306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e4d0d-6912-4c97-a4ae-99690fe63756 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:35.103745 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e4d0d-6912-4c97-a4ae-99690fe63756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:35.103924 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e4d0d-6912-4c97-a4ae-99690fe63756 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:35.104633 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e4d0d-6912-4c97-a4ae-99690fe63756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:35.106305 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e4d0d-6912-4c97-a4ae-99690fe63756 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:35.125525 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 989/1969] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:35.130104 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51c8ba-8969-4931-91ec-704e729e05be admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:35.142440 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51c8ba-8969-4931-91ec-704e729e05be admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:35.147794 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0422a5e-6ca8-4234-abce-b10b59228571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:35.148479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0422a5e-6ca8-4234-abce-b10b59228571 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:35.148779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0422a5e-6ca8-4234-abce-b10b59228571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:35.149053 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0422a5e-6ca8-4234-abce-b10b59228571 admin admin] PATH_INFO: `/v3/projects/e46d1388d33f4f7a9376f89b93845c68/users/36b2e04c806c43009fc478ca8e1b25a2/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:35.167837 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0422a5e-6ca8-4234-abce-b10b59228571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e46d1388d33f4f7a9376f89b93845c68, user_id=36b2e04c806c43009fc478ca8e1b25a2, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:35.170530 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0422a5e-6ca8-4234-abce-b10b59228571 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:35.181786 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:35.188126 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 981/1970] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:35 2022] PUT /identity/v3/projects/e46d1388d33f4f7a9376f89b93845c68/users/36b2e04c806c43009fc478ca8e1b25a2/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:05:35.192257 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e4d0d-6912-4c97-a4ae-99690fe63756 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:35.202728 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e4d0d-6912-4c97-a4ae-99690fe63756 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:35.268963 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abec9f4-233f-4d90-a9b1-447f5bc8cd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:35.269698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abec9f4-233f-4d90-a9b1-447f5bc8cd79 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:35.269980 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abec9f4-233f-4d90-a9b1-447f5bc8cd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:35.270257 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abec9f4-233f-4d90-a9b1-447f5bc8cd79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:35.271026 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abec9f4-233f-4d90-a9b1-447f5bc8cd79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:35.273463 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abec9f4-233f-4d90-a9b1-447f5bc8cd79 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:35.285266 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 990/1971] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:35.290758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0422a5e-6ca8-4234-abce-b10b59228571 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:35.301445 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0422a5e-6ca8-4234-abce-b10b59228571 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:35.307211 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359da89c-5761-4a33-ba5f-ad761546570b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:35.307913 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359da89c-5761-4a33-ba5f-ad761546570b admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:35.308191 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359da89c-5761-4a33-ba5f-ad761546570b admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:35.308470 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359da89c-5761-4a33-ba5f-ad761546570b admin admin] PATH_INFO: `/v3/projects/e46d1388d33f4f7a9376f89b93845c68/users/36b2e04c806c43009fc478ca8e1b25a2/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:35.310969 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359da89c-5761-4a33-ba5f-ad761546570b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e46d1388d33f4f7a9376f89b93845c68, user_id=36b2e04c806c43009fc478ca8e1b25a2, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:35.313722 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359da89c-5761-4a33-ba5f-ad761546570b admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:35.334162 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 982/1972] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:35 2022] PUT /identity/v3/projects/e46d1388d33f4f7a9376f89b93845c68/users/36b2e04c806c43009fc478ca8e1b25a2/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:35.344477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de4fb7-788d-435f-bb6d-6079dd16da40 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:35.344772 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de4fb7-788d-435f-bb6d-6079dd16da40 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:35.345122 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de4fb7-788d-435f-bb6d-6079dd16da40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:35.371559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:35.381909 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-69de4fb7-788d-435f-bb6d-6079dd16da40 None None] MFA Rules not processed for user `36b2e04c806c43009fc478ca8e1b25a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:35.383754 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-69de4fb7-788d-435f-bb6d-6079dd16da40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:35.391873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359da89c-5761-4a33-ba5f-ad761546570b admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:35.393973 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-359da89c-5761-4a33-ba5f-ad761546570b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:35.474379 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 991/1973] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:35.483771 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de4fb7-788d-435f-bb6d-6079dd16da40 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:35.489075 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359da89c-5761-4a33-ba5f-ad761546570b admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:35.495416 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62475e-fb3a-4603-8679-11c900d58ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:35.496176 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62475e-fb3a-4603-8679-11c900d58ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:35.496365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62475e-fb3a-4603-8679-11c900d58ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:35.496725 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62475e-fb3a-4603-8679-11c900d58ff9 admin admin] PATH_INFO: `/v3/users/ac76c685a94f429e8d1572885c9adce8` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:35.497875 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62475e-fb3a-4603-8679-11c900d58ff9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac76c685a94f429e8d1572885c9adce8)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:35.500099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62475e-fb3a-4603-8679-11c900d58ff9 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:35.500809 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-69de4fb7-788d-435f-bb6d-6079dd16da40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:35.590162 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-db62475e-fb3a-4603-8679-11c900d58ff9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac76c685a94f429e8d1572885c9adce8'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:35.591001 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-db62475e-fb3a-4603-8679-11c900d58ff9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac76c685a94f429e8d1572885c9adce8'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:35.591637 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-db62475e-fb3a-4603-8679-11c900d58ff9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac76c685a94f429e8d1572885c9adce8'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:35.606997 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-db62475e-fb3a-4603-8679-11c900d58ff9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac76c685a94f429e8d1572885c9adce8'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:35.612709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de4fb7-788d-435f-bb6d-6079dd16da40 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:35.621751 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48658ae-ca93-4a19-b35f-05c7be946101 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:35.622894 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48658ae-ca93-4a19-b35f-05c7be946101 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:35.623394 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48658ae-ca93-4a19-b35f-05c7be946101 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:35.623819 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48658ae-ca93-4a19-b35f-05c7be946101 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:35.626523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c48658ae-ca93-4a19-b35f-05c7be946101 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:35.630103 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-db62475e-fb3a-4603-8679-11c900d58ff9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac76c685a94f429e8d1572885c9adce8'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:35.644991 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48658ae-ca93-4a19-b35f-05c7be946101 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:35.646732 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48658ae-ca93-4a19-b35f-05c7be946101 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:35.658638 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 992/1974] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:35.682363 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 983/1975] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:05:35 2022] DELETE /identity/v3/users/ac76c685a94f429e8d1572885c9adce8 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:35.687084 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114efca-5471-4f3a-845c-142786515d2e None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:35.687583 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114efca-5471-4f3a-845c-142786515d2e None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:35.688063 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114efca-5471-4f3a-845c-142786515d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:35.758942 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62475e-fb3a-4603-8679-11c900d58ff9 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:35.760474 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-db62475e-fb3a-4603-8679-11c900d58ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:35.764113 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-b114efca-5471-4f3a-845c-142786515d2e None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:35.765349 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b114efca-5471-4f3a-845c-142786515d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:35.886530 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 993/1976] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:35.896871 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114efca-5471-4f3a-845c-142786515d2e None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:35.899278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b114efca-5471-4f3a-845c-142786515d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:35.948716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62475e-fb3a-4603-8679-11c900d58ff9 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:35.959775 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba6805-7e27-462d-a379-ede5c10c8826 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:35.960578 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba6805-7e27-462d-a379-ede5c10c8826 service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:35.960867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba6805-7e27-462d-a379-ede5c10c8826 service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:35.961146 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba6805-7e27-462d-a379-ede5c10c8826 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:35.964821 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-e3ba6805-7e27-462d-a379-ede5c10c8826 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:36.021309 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:36.046136 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114efca-5471-4f3a-845c-142786515d2e None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:36.051787 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce528ade-b85b-4c02-8e46-58434cf10d68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:36.052793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce528ade-b85b-4c02-8e46-58434cf10d68 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:36.053636 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce528ade-b85b-4c02-8e46-58434cf10d68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:36.054735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce528ade-b85b-4c02-8e46-58434cf10d68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:36.058250 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:36.069221 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce528ade-b85b-4c02-8e46-58434cf10d68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:36.072017 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce528ade-b85b-4c02-8e46-58434cf10d68 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:36.088523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 994/1977] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:05:36.236576 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba6805-7e27-462d-a379-ede5c10c8826 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:36.239602 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba6805-7e27-462d-a379-ede5c10c8826 service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:36.307057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 984/1978] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:05:37.083068 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce528ade-b85b-4c02-8e46-58434cf10d68 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:37.086969 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ce528ade-b85b-4c02-8e46-58434cf10d68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:37.129714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce528ade-b85b-4c02-8e46-58434cf10d68 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:37.139044 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99804e2d-150a-4bf0-b1e1-e2341971f8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:37.140151 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99804e2d-150a-4bf0-b1e1-e2341971f8ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:37.140151 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99804e2d-150a-4bf0-b1e1-e2341971f8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:37.140482 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99804e2d-150a-4bf0-b1e1-e2341971f8ca admin admin] PATH_INFO: `/v3/projects/45031b65905c4a86a6f262b3b28d4242` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:37.148706 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99804e2d-150a-4bf0-b1e1-e2341971f8ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=45031b65905c4a86a6f262b3b28d4242)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:37.149857 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99804e2d-150a-4bf0-b1e1-e2341971f8ca admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:37.233733 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-99804e2d-150a-4bf0-b1e1-e2341971f8ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45031b65905c4a86a6f262b3b28d4242', 'request_id': 'req-99804e2d-150a-4bf0-b1e1-e2341971f8ca'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:37.242982 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-99804e2d-150a-4bf0-b1e1-e2341971f8ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45031b65905c4a86a6f262b3b28d4242', 'request_id': 'req-99804e2d-150a-4bf0-b1e1-e2341971f8ca'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:37.253225 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-99804e2d-150a-4bf0-b1e1-e2341971f8ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45031b65905c4a86a6f262b3b28d4242', 'request_id': 'req-99804e2d-150a-4bf0-b1e1-e2341971f8ca'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:37.276140 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-99804e2d-150a-4bf0-b1e1-e2341971f8ca admin admin] The token cache is being invalidate because project 45031b65905c4a86a6f262b3b28d4242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:05:37.276641 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-99804e2d-150a-4bf0-b1e1-e2341971f8ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:37.277712 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-99804e2d-150a-4bf0-b1e1-e2341971f8ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:37.283553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 995/1979] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:05:37 2022] DELETE /identity/v3/projects/45031b65905c4a86a6f262b3b28d4242 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:37.284124 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba6805-7e27-462d-a379-ede5c10c8826 service cinder] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:37.298207 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba6805-7e27-462d-a379-ede5c10c8826 service cinder] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:37.436174 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446d4f3-0dbd-4f85-a70e-08939abae40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:37.437616 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446d4f3-0dbd-4f85-a70e-08939abae40d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:37.437908 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446d4f3-0dbd-4f85-a70e-08939abae40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:37.438242 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446d4f3-0dbd-4f85-a70e-08939abae40d admin admin] PATH_INFO: `/v3/users/e8abb62eb6cd4b7cbcf8487416eb8ed1` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:37.439911 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446d4f3-0dbd-4f85-a70e-08939abae40d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8abb62eb6cd4b7cbcf8487416eb8ed1)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:37.442251 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446d4f3-0dbd-4f85-a70e-08939abae40d admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:37.536497 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-3446d4f3-0dbd-4f85-a70e-08939abae40d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8abb62eb6cd4b7cbcf8487416eb8ed1'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:37.537192 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-3446d4f3-0dbd-4f85-a70e-08939abae40d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8abb62eb6cd4b7cbcf8487416eb8ed1'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:37.537883 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-3446d4f3-0dbd-4f85-a70e-08939abae40d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8abb62eb6cd4b7cbcf8487416eb8ed1'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:37.549513 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-3446d4f3-0dbd-4f85-a70e-08939abae40d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8abb62eb6cd4b7cbcf8487416eb8ed1'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:37.567617 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-3446d4f3-0dbd-4f85-a70e-08939abae40d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8abb62eb6cd4b7cbcf8487416eb8ed1'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:37.589344 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 985/1980] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:05:37 2022] DELETE /identity/v3/users/e8abb62eb6cd4b7cbcf8487416eb8ed1 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:05:38.320240 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99804e2d-150a-4bf0-b1e1-e2341971f8ca admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:38.320240 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-99804e2d-150a-4bf0-b1e1-e2341971f8ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:38.345286 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99804e2d-150a-4bf0-b1e1-e2341971f8ca admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:38.462188 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645daa5-4043-4d53-9ace-1981261228bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:38.463090 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645daa5-4043-4d53-9ace-1981261228bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:38.463377 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645daa5-4043-4d53-9ace-1981261228bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:38.463652 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645daa5-4043-4d53-9ace-1981261228bd admin admin] PATH_INFO: `/v3/projects/8518ee8de92848dab231dfb494dbe49e` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:38.464850 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645daa5-4043-4d53-9ace-1981261228bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8518ee8de92848dab231dfb494dbe49e)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:38.466812 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645daa5-4043-4d53-9ace-1981261228bd admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:38.558908 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d645daa5-4043-4d53-9ace-1981261228bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8518ee8de92848dab231dfb494dbe49e', 'request_id': 'req-d645daa5-4043-4d53-9ace-1981261228bd'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:38.573078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d645daa5-4043-4d53-9ace-1981261228bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8518ee8de92848dab231dfb494dbe49e', 'request_id': 'req-d645daa5-4043-4d53-9ace-1981261228bd'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:38.584022 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d645daa5-4043-4d53-9ace-1981261228bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8518ee8de92848dab231dfb494dbe49e', 'request_id': 'req-d645daa5-4043-4d53-9ace-1981261228bd'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:38.590995 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:38.607962 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d645daa5-4043-4d53-9ace-1981261228bd admin admin] The token cache is being invalidate because project 8518ee8de92848dab231dfb494dbe49e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:05:38.609202 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d645daa5-4043-4d53-9ace-1981261228bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:38.610974 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d645daa5-4043-4d53-9ace-1981261228bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:38.612984 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 996/1981] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:05:38 2022] DELETE /identity/v3/projects/8518ee8de92848dab231dfb494dbe49e => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:38.619667 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446d4f3-0dbd-4f85-a70e-08939abae40d admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:38.623103 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-3446d4f3-0dbd-4f85-a70e-08939abae40d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:38.644662 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446d4f3-0dbd-4f85-a70e-08939abae40d admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:38.727977 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:38.759109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0af1d-9ae8-4749-92c3-c11d7515db4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:38.764544 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0af1d-9ae8-4749-92c3-c11d7515db4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:38.764847 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0af1d-9ae8-4749-92c3-c11d7515db4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:38.765243 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0af1d-9ae8-4749-92c3-c11d7515db4f admin admin] PATH_INFO: `/v3/users/6a57d63631fd4da8b3d998e1b2a842da` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:38.770411 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed0af1d-9ae8-4749-92c3-c11d7515db4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a57d63631fd4da8b3d998e1b2a842da)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:38.772448 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed0af1d-9ae8-4749-92c3-c11d7515db4f admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:38.862465 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-9ed0af1d-9ae8-4749-92c3-c11d7515db4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a57d63631fd4da8b3d998e1b2a842da'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:38.863204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-9ed0af1d-9ae8-4749-92c3-c11d7515db4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a57d63631fd4da8b3d998e1b2a842da'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:38.865151 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-9ed0af1d-9ae8-4749-92c3-c11d7515db4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a57d63631fd4da8b3d998e1b2a842da'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:38.875587 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-9ed0af1d-9ae8-4749-92c3-c11d7515db4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a57d63631fd4da8b3d998e1b2a842da'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:38.896962 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-9ed0af1d-9ae8-4749-92c3-c11d7515db4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a57d63631fd4da8b3d998e1b2a842da'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:38.922418 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 986/1982] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:05:38 2022] DELETE /identity/v3/users/6a57d63631fd4da8b3d998e1b2a842da => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:39.345459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645daa5-4043-4d53-9ace-1981261228bd admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:39.349341 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d645daa5-4043-4d53-9ace-1981261228bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:39.378350 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645daa5-4043-4d53-9ace-1981261228bd admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:39.461488 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6977f76-dd9f-4b5b-a653-1ec0a31ca304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:39.462228 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6977f76-dd9f-4b5b-a653-1ec0a31ca304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:39.462621 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6977f76-dd9f-4b5b-a653-1ec0a31ca304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:39.462898 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6977f76-dd9f-4b5b-a653-1ec0a31ca304 admin admin] PATH_INFO: `/v3/projects/34caf3c110e84247a55128ea45da3ef5` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:39.464143 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6977f76-dd9f-4b5b-a653-1ec0a31ca304 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34caf3c110e84247a55128ea45da3ef5)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:39.466063 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6977f76-dd9f-4b5b-a653-1ec0a31ca304 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:39.517553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b6977f76-dd9f-4b5b-a653-1ec0a31ca304 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34caf3c110e84247a55128ea45da3ef5', 'request_id': 'req-b6977f76-dd9f-4b5b-a653-1ec0a31ca304'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:39.527351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b6977f76-dd9f-4b5b-a653-1ec0a31ca304 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34caf3c110e84247a55128ea45da3ef5', 'request_id': 'req-b6977f76-dd9f-4b5b-a653-1ec0a31ca304'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:39.535053 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b6977f76-dd9f-4b5b-a653-1ec0a31ca304 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34caf3c110e84247a55128ea45da3ef5', 'request_id': 'req-b6977f76-dd9f-4b5b-a653-1ec0a31ca304'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:39.557820 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b6977f76-dd9f-4b5b-a653-1ec0a31ca304 admin admin] The token cache is being invalidate because project 34caf3c110e84247a55128ea45da3ef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:05:39.558447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b6977f76-dd9f-4b5b-a653-1ec0a31ca304 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:39.559264 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b6977f76-dd9f-4b5b-a653-1ec0a31ca304 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:39.563504 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 997/1983] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:05:39 2022] DELETE /identity/v3/projects/34caf3c110e84247a55128ea45da3ef5 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:39.570420 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93452dd2-5bab-4daa-a132-1c5f329e9d94 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:39.571206 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93452dd2-5bab-4daa-a132-1c5f329e9d94 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:39.571602 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93452dd2-5bab-4daa-a132-1c5f329e9d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:39.595071 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-93452dd2-5bab-4daa-a132-1c5f329e9d94 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:39.596386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-93452dd2-5bab-4daa-a132-1c5f329e9d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:39.686569 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 987/1984] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:39.690025 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a740d7-f30d-4c06-8881-87fb6e358727 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:39.690365 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a740d7-f30d-4c06-8881-87fb6e358727 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:39.690644 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a740d7-f30d-4c06-8881-87fb6e358727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:39.715382 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-48a740d7-f30d-4c06-8881-87fb6e358727 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:39.717025 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-48a740d7-f30d-4c06-8881-87fb6e358727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:39.729279 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 998/1985] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:05:39.734512 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93452dd2-5bab-4daa-a132-1c5f329e9d94 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:39.753138 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93452dd2-5bab-4daa-a132-1c5f329e9d94 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:39.760337 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849476e-f8ce-4214-93c0-2efb913de9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:39.760987 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849476e-f8ce-4214-93c0-2efb913de9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:39.761268 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849476e-f8ce-4214-93c0-2efb913de9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:39.761546 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849476e-f8ce-4214-93c0-2efb913de9d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:39.762395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849476e-f8ce-4214-93c0-2efb913de9d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:05:39.762711 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849476e-f8ce-4214-93c0-2efb913de9d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:39.764791 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849476e-f8ce-4214-93c0-2efb913de9d2 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:39.785503 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 988/1986] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:05:39.786803 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a740d7-f30d-4c06-8881-87fb6e358727 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:39.797820 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a740d7-f30d-4c06-8881-87fb6e358727 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:39.803271 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5c5b3-c13a-43a5-996f-d117706187ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:39.804663 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5c5b3-c13a-43a5-996f-d117706187ba admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:39.805229 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5c5b3-c13a-43a5-996f-d117706187ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:39.805575 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5c5b3-c13a-43a5-996f-d117706187ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:39.806420 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5c5b3-c13a-43a5-996f-d117706187ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:39.808712 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5c5b3-c13a-43a5-996f-d117706187ba admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:39.847132 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 999/1987] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:05:39 2022] POST /identity/v3/projects => generated 401 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:05:39.852243 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849476e-f8ce-4214-93c0-2efb913de9d2 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:39.863246 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849476e-f8ce-4214-93c0-2efb913de9d2 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:39.930664 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:39.949292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f644d-40a6-4330-a41e-3ad22743653b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:39.950548 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f644d-40a6-4330-a41e-3ad22743653b admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:39.951235 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f644d-40a6-4330-a41e-3ad22743653b admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:39.951700 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f644d-40a6-4330-a41e-3ad22743653b admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:39.952694 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f644d-40a6-4330-a41e-3ad22743653b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:39.955641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f644d-40a6-4330-a41e-3ad22743653b admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:39.988725 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 989/1988] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:05:39 2022] POST /identity/v3/users => generated 301 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:05:39.989267 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5c5b3-c13a-43a5-996f-d117706187ba admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:40.005317 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5c5b3-c13a-43a5-996f-d117706187ba admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:40.012070 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c5578-82cc-4f00-9ea1-451928b58ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:40.012788 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c5578-82cc-4f00-9ea1-451928b58ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:40.017016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c5578-82cc-4f00-9ea1-451928b58ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:40.017503 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c5578-82cc-4f00-9ea1-451928b58ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:40.018375 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c5578-82cc-4f00-9ea1-451928b58ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:40.020253 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c5578-82cc-4f00-9ea1-451928b58ee7 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:40.034250 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1000/1989] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:05:40.039284 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f644d-40a6-4330-a41e-3ad22743653b admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:40.052348 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f644d-40a6-4330-a41e-3ad22743653b admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:40.057977 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5247c7-b83c-4521-983d-3fde8511b0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:40.058773 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5247c7-b83c-4521-983d-3fde8511b0ad admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:40.059147 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5247c7-b83c-4521-983d-3fde8511b0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:40.059452 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5247c7-b83c-4521-983d-3fde8511b0ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:40.060219 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5247c7-b83c-4521-983d-3fde8511b0ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:40.062612 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5247c7-b83c-4521-983d-3fde8511b0ad admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:40.078936 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 990/1990] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:40.080133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c5578-82cc-4f00-9ea1-451928b58ee7 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:40.095795 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c5578-82cc-4f00-9ea1-451928b58ee7 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:40.121505 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5566c-3a40-4404-bdc9-ddafe6c7eb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:40.123065 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5566c-3a40-4404-bdc9-ddafe6c7eb7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:40.129295 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5566c-3a40-4404-bdc9-ddafe6c7eb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:40.129796 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5566c-3a40-4404-bdc9-ddafe6c7eb7f admin admin] PATH_INFO: `/v3/projects/b51c3bde8d4d4eabbcd9b3412a64795f/users/1d9d7df288b94e45b3646f453b47d2f2/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:40.160774 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5566c-3a40-4404-bdc9-ddafe6c7eb7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b51c3bde8d4d4eabbcd9b3412a64795f, user_id=1d9d7df288b94e45b3646f453b47d2f2, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:40.165446 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5566c-3a40-4404-bdc9-ddafe6c7eb7f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:40.198903 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1001/1991] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:40 2022] PUT /identity/v3/projects/b51c3bde8d4d4eabbcd9b3412a64795f/users/1d9d7df288b94e45b3646f453b47d2f2/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:40.200773 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3a250-91e3-4133-9c0c-668d046dccb8 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:40.201387 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3a250-91e3-4133-9c0c-668d046dccb8 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:40.201669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3a250-91e3-4133-9c0c-668d046dccb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:40.266702 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-48d3a250-91e3-4133-9c0c-668d046dccb8 None None] MFA Rules not processed for user `1d9d7df288b94e45b3646f453b47d2f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:40.268084 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-48d3a250-91e3-4133-9c0c-668d046dccb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:40.453232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 991/1992] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:40.457662 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5566c-3a40-4404-bdc9-ddafe6c7eb7f admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:40.499745 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:40.576527 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5566c-3a40-4404-bdc9-ddafe6c7eb7f admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:40.583384 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd5d32-8ca0-4771-843a-e6dfb7255423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:40.584176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd5d32-8ca0-4771-843a-e6dfb7255423 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:40.584565 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd5d32-8ca0-4771-843a-e6dfb7255423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:40.585510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd5d32-8ca0-4771-843a-e6dfb7255423 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:40.586294 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd5d32-8ca0-4771-843a-e6dfb7255423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:40.588588 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd5d32-8ca0-4771-843a-e6dfb7255423 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:40.651892 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1002/1993] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:05:40 2022] POST /identity/v3/projects => generated 401 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:40.655230 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3a250-91e3-4133-9c0c-668d046dccb8 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:40.672935 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3a250-91e3-4133-9c0c-668d046dccb8 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:40.852543 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebe8f5-1bc2-42ab-821e-b575b0cfaeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:40.853545 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebe8f5-1bc2-42ab-821e-b575b0cfaeba admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:40.853825 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebe8f5-1bc2-42ab-821e-b575b0cfaeba admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:40.854206 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebe8f5-1bc2-42ab-821e-b575b0cfaeba admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:40.855225 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aebe8f5-1bc2-42ab-821e-b575b0cfaeba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:40.858893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aebe8f5-1bc2-42ab-821e-b575b0cfaeba admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:40.896892 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 992/1994] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:05:40 2022] POST /identity/v3/users => generated 307 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:05:40.902669 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd5d32-8ca0-4771-843a-e6dfb7255423 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:40.922468 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd5d32-8ca0-4771-843a-e6dfb7255423 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:40.924660 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebe8f5-1bc2-42ab-821e-b575b0cfaeba admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:40.927371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-1aebe8f5-1bc2-42ab-821e-b575b0cfaeba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:40.931990 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732d213-cbfe-4764-b825-edf5a7009380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:40.935888 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732d213-cbfe-4764-b825-edf5a7009380 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:40.935888 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732d213-cbfe-4764-b825-edf5a7009380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:40.936081 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732d213-cbfe-4764-b825-edf5a7009380 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:40.936988 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732d213-cbfe-4764-b825-edf5a7009380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:40.939168 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732d213-cbfe-4764-b825-edf5a7009380 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:40.947402 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebe8f5-1bc2-42ab-821e-b575b0cfaeba admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:40.959368 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14457cfd-2b2b-49e8-bfd0-18a3383b29f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:40.960719 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1003/1995] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:40.961387 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14457cfd-2b2b-49e8-bfd0-18a3383b29f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:40.962160 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14457cfd-2b2b-49e8-bfd0-18a3383b29f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:40.962542 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14457cfd-2b2b-49e8-bfd0-18a3383b29f4 admin admin] PATH_INFO: `/v3/users/6d46a44b81b0443a8e1a18e87eddc8a1` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:40.963966 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14457cfd-2b2b-49e8-bfd0-18a3383b29f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d46a44b81b0443a8e1a18e87eddc8a1)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:40.966089 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14457cfd-2b2b-49e8-bfd0-18a3383b29f4 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:40.966602 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732d213-cbfe-4764-b825-edf5a7009380 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:40.991199 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732d213-cbfe-4764-b825-edf5a7009380 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:41.005496 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db852a-8853-43bb-bb8d-55227cca8f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:41.006292 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db852a-8853-43bb-bb8d-55227cca8f57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:41.006583 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db852a-8853-43bb-bb8d-55227cca8f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:41.006996 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db852a-8853-43bb-bb8d-55227cca8f57 admin admin] PATH_INFO: `/v3/projects/575331fa2c674008b22967643a309a9c/users/e27229d1f28343de854fa7a78aa4bcf7/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:41.054704 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db852a-8853-43bb-bb8d-55227cca8f57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=575331fa2c674008b22967643a309a9c, user_id=e27229d1f28343de854fa7a78aa4bcf7, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:41.056871 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:41.057446 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db852a-8853-43bb-bb8d-55227cca8f57 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:41.074430 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-14457cfd-2b2b-49e8-bfd0-18a3383b29f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d46a44b81b0443a8e1a18e87eddc8a1'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:41.075226 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-14457cfd-2b2b-49e8-bfd0-18a3383b29f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d46a44b81b0443a8e1a18e87eddc8a1'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:41.075644 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1004/1996] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:40 2022] PUT /identity/v3/projects/575331fa2c674008b22967643a309a9c/users/e27229d1f28343de854fa7a78aa4bcf7/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:05:41.076727 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-14457cfd-2b2b-49e8-bfd0-18a3383b29f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d46a44b81b0443a8e1a18e87eddc8a1'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:41.079822 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db852a-8853-43bb-bb8d-55227cca8f57 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:41.082601 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-18db852a-8853-43bb-bb8d-55227cca8f57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:41.088292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-14457cfd-2b2b-49e8-bfd0-18a3383b29f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d46a44b81b0443a8e1a18e87eddc8a1'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:41.109669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-14457cfd-2b2b-49e8-bfd0-18a3383b29f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d46a44b81b0443a8e1a18e87eddc8a1'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:41.132986 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 993/1997] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:05:40 2022] DELETE /identity/v3/users/6d46a44b81b0443a8e1a18e87eddc8a1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:05:41.135022 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d62f7-81e3-4df4-9aeb-2818a7d0c8e7 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:41.135798 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d62f7-81e3-4df4-9aeb-2818a7d0c8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:41.136468 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d62f7-81e3-4df4-9aeb-2818a7d0c8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:41.167990 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-b47d62f7-81e3-4df4-9aeb-2818a7d0c8e7 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:41.170523 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-b47d62f7-81e3-4df4-9aeb-2818a7d0c8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:41.175769 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db852a-8853-43bb-bb8d-55227cca8f57 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:41.271004 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 994/1998] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:41.272124 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8428c65-85be-42d8-a89d-8a60addf5055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:41.273400 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8428c65-85be-42d8-a89d-8a60addf5055 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:41.273712 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8428c65-85be-42d8-a89d-8a60addf5055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:41.273993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8428c65-85be-42d8-a89d-8a60addf5055 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:41.274744 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8428c65-85be-42d8-a89d-8a60addf5055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:41.276362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8428c65-85be-42d8-a89d-8a60addf5055 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:41.278985 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d62f7-81e3-4df4-9aeb-2818a7d0c8e7 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:41.280806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-b47d62f7-81e3-4df4-9aeb-2818a7d0c8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:41.290957 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1005/1999] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:41.296332 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8428c65-85be-42d8-a89d-8a60addf5055 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:41.315556 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8428c65-85be-42d8-a89d-8a60addf5055 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:41.331491 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b8a00-0582-420c-b702-5e285eea5c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:41.332392 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b8a00-0582-420c-b702-5e285eea5c9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:41.332743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b8a00-0582-420c-b702-5e285eea5c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:41.333108 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b8a00-0582-420c-b702-5e285eea5c9b admin admin] PATH_INFO: `/v3/projects/575331fa2c674008b22967643a309a9c/users/e27229d1f28343de854fa7a78aa4bcf7/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:41.337445 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b8a00-0582-420c-b702-5e285eea5c9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=575331fa2c674008b22967643a309a9c, user_id=e27229d1f28343de854fa7a78aa4bcf7, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:41.341137 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b8a00-0582-420c-b702-5e285eea5c9b admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:41.357312 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1006/2000] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:41 2022] PUT /identity/v3/projects/575331fa2c674008b22967643a309a9c/users/e27229d1f28343de854fa7a78aa4bcf7/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:41.373562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b2212-af43-46ba-9c3a-30c233dac8d7 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:41.374201 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b2212-af43-46ba-9c3a-30c233dac8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:41.374614 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b2212-af43-46ba-9c3a-30c233dac8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:41.389961 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:41.399044 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d62f7-81e3-4df4-9aeb-2818a7d0c8e7 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:41.458780 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-601b2212-af43-46ba-9c3a-30c233dac8d7 None None] MFA Rules not processed for user `e27229d1f28343de854fa7a78aa4bcf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:41.460837 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-601b2212-af43-46ba-9c3a-30c233dac8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:41.508669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd51ea2-665c-49df-9e95-896fb0c3364a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:41.509582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd51ea2-665c-49df-9e95-896fb0c3364a service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:41.510166 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd51ea2-665c-49df-9e95-896fb0c3364a service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:41.510544 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd51ea2-665c-49df-9e95-896fb0c3364a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:41.546922 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:41.602504 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd51ea2-665c-49df-9e95-896fb0c3364a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:41.606693 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd51ea2-665c-49df-9e95-896fb0c3364a service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:41.621645 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 995/2001] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:41.698266 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1007/2002] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:41 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:41.711525 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd51ea2-665c-49df-9e95-896fb0c3364a service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:41.713322 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-abd51ea2-665c-49df-9e95-896fb0c3364a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:41.930933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd51ea2-665c-49df-9e95-896fb0c3364a service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:41.937262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b26a67-58b9-4ffd-999d-13edaaaaaa79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:41.937943 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b26a67-58b9-4ffd-999d-13edaaaaaa79 service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:41.938227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b26a67-58b9-4ffd-999d-13edaaaaaa79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:41.938550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b26a67-58b9-4ffd-999d-13edaaaaaa79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:41.962231 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b26a67-58b9-4ffd-999d-13edaaaaaa79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:41.965005 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b26a67-58b9-4ffd-999d-13edaaaaaa79 service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:41.979763 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 996/2003] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:41 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:42.190869 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b2212-af43-46ba-9c3a-30c233dac8d7 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:42.192700 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-601b2212-af43-46ba-9c3a-30c233dac8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:42.246017 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b2212-af43-46ba-9c3a-30c233dac8d7 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:42.253208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1cf12-fe88-4ed8-a291-1b507dfdd118 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:42.253970 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1cf12-fe88-4ed8-a291-1b507dfdd118 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:42.254487 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1cf12-fe88-4ed8-a291-1b507dfdd118 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:42.254808 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1cf12-fe88-4ed8-a291-1b507dfdd118 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:42.262035 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-cea1cf12-fe88-4ed8-a291-1b507dfdd118 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:42.409548 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1cf12-fe88-4ed8-a291-1b507dfdd118 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:42.411252 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1cf12-fe88-4ed8-a291-1b507dfdd118 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:42.436568 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1008/2004] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:42 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:42.604384 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b26a67-58b9-4ffd-999d-13edaaaaaa79 service cinder] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:42.605954 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-33b26a67-58b9-4ffd-999d-13edaaaaaa79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:42.624551 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b26a67-58b9-4ffd-999d-13edaaaaaa79 service cinder] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:42.629977 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf18f1b-7e78-466a-b40a-6acd846e2b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:42.630533 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf18f1b-7e78-466a-b40a-6acd846e2b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:42.630831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf18f1b-7e78-466a-b40a-6acd846e2b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:42.631090 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf18f1b-7e78-466a-b40a-6acd846e2b57 admin admin] PATH_INFO: `/v3/projects/343a9e550963433495b39eb532626a3e` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:42.632770 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf18f1b-7e78-466a-b40a-6acd846e2b57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=343a9e550963433495b39eb532626a3e)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:42.635541 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf18f1b-7e78-466a-b40a-6acd846e2b57 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:42.754070 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-2cf18f1b-7e78-466a-b40a-6acd846e2b57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '343a9e550963433495b39eb532626a3e', 'request_id': 'req-2cf18f1b-7e78-466a-b40a-6acd846e2b57'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:42.786632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-2cf18f1b-7e78-466a-b40a-6acd846e2b57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '343a9e550963433495b39eb532626a3e', 'request_id': 'req-2cf18f1b-7e78-466a-b40a-6acd846e2b57'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:42.804723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-2cf18f1b-7e78-466a-b40a-6acd846e2b57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '343a9e550963433495b39eb532626a3e', 'request_id': 'req-2cf18f1b-7e78-466a-b40a-6acd846e2b57'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:42.837729 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-2cf18f1b-7e78-466a-b40a-6acd846e2b57 admin admin] The token cache is being invalidate because project 343a9e550963433495b39eb532626a3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:05:42.839959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-2cf18f1b-7e78-466a-b40a-6acd846e2b57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:42.842770 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-2cf18f1b-7e78-466a-b40a-6acd846e2b57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:42.871959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 997/2005] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:05:42 2022] DELETE /identity/v3/projects/343a9e550963433495b39eb532626a3e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:42.873635 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1cf12-fe88-4ed8-a291-1b507dfdd118 service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:42.903291 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1cf12-fe88-4ed8-a291-1b507dfdd118 service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:43.042832 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6878ea9-b890-434c-a907-f18e4d3d26c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:43.045939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6878ea9-b890-434c-a907-f18e4d3d26c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:43.045939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6878ea9-b890-434c-a907-f18e4d3d26c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:43.045939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6878ea9-b890-434c-a907-f18e4d3d26c3 admin admin] PATH_INFO: `/v3/users/36b2e04c806c43009fc478ca8e1b25a2` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:43.045939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6878ea9-b890-434c-a907-f18e4d3d26c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36b2e04c806c43009fc478ca8e1b25a2)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:43.047820 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6878ea9-b890-434c-a907-f18e4d3d26c3 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:43.093883 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:43.154873 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d6878ea9-b890-434c-a907-f18e4d3d26c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36b2e04c806c43009fc478ca8e1b25a2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:43.170182 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d6878ea9-b890-434c-a907-f18e4d3d26c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36b2e04c806c43009fc478ca8e1b25a2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:43.171673 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d6878ea9-b890-434c-a907-f18e4d3d26c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36b2e04c806c43009fc478ca8e1b25a2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:43.199719 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d6878ea9-b890-434c-a907-f18e4d3d26c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36b2e04c806c43009fc478ca8e1b25a2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:43.209016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d6878ea9-b890-434c-a907-f18e4d3d26c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36b2e04c806c43009fc478ca8e1b25a2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:43.240455 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1009/2006] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:05:42 2022] DELETE /identity/v3/users/36b2e04c806c43009fc478ca8e1b25a2 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:43.718136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf18f1b-7e78-466a-b40a-6acd846e2b57 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:43.719795 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-2cf18f1b-7e78-466a-b40a-6acd846e2b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:43.747933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf18f1b-7e78-466a-b40a-6acd846e2b57 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:43.803256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:43.818854 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d97ec-7dde-4562-8454-75ccf651366f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:43.820145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d97ec-7dde-4562-8454-75ccf651366f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:43.820586 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d97ec-7dde-4562-8454-75ccf651366f admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:43.820802 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d97ec-7dde-4562-8454-75ccf651366f admin admin] PATH_INFO: `/v3/projects/e46d1388d33f4f7a9376f89b93845c68` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:43.822087 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d97ec-7dde-4562-8454-75ccf651366f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e46d1388d33f4f7a9376f89b93845c68)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:43.824287 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d97ec-7dde-4562-8454-75ccf651366f admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:43.880952 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-c16d97ec-7dde-4562-8454-75ccf651366f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e46d1388d33f4f7a9376f89b93845c68', 'request_id': 'req-c16d97ec-7dde-4562-8454-75ccf651366f'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:43.887818 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-c16d97ec-7dde-4562-8454-75ccf651366f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e46d1388d33f4f7a9376f89b93845c68', 'request_id': 'req-c16d97ec-7dde-4562-8454-75ccf651366f'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:43.896306 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-c16d97ec-7dde-4562-8454-75ccf651366f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e46d1388d33f4f7a9376f89b93845c68', 'request_id': 'req-c16d97ec-7dde-4562-8454-75ccf651366f'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:43.908538 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-c16d97ec-7dde-4562-8454-75ccf651366f admin admin] The token cache is being invalidate because project e46d1388d33f4f7a9376f89b93845c68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:05:43.908857 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-c16d97ec-7dde-4562-8454-75ccf651366f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:43.910247 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-c16d97ec-7dde-4562-8454-75ccf651366f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:43.911791 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 998/2007] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:05:43 2022] DELETE /identity/v3/projects/e46d1388d33f4f7a9376f89b93845c68 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:43.916880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe0397-87f3-47eb-9672-38362da20df4 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:43.917416 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe0397-87f3-47eb-9672-38362da20df4 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:43.917530 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe0397-87f3-47eb-9672-38362da20df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:43.947409 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-59fe0397-87f3-47eb-9672-38362da20df4 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:43.948823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-59fe0397-87f3-47eb-9672-38362da20df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:44.012155 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1010/2008] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:44.020976 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387e39f-b175-444b-8757-36cabe643eba None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:44.021321 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387e39f-b175-444b-8757-36cabe643eba None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:44.021534 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387e39f-b175-444b-8757-36cabe643eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:44.050641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-2387e39f-b175-444b-8757-36cabe643eba None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:44.051877 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-2387e39f-b175-444b-8757-36cabe643eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:44.060905 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 999/2009] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:44.081514 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe0397-87f3-47eb-9672-38362da20df4 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:44.108524 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe0397-87f3-47eb-9672-38362da20df4 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:44.134979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c138a41-8a39-4b3b-8e04-afdca4ee5a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:44.135591 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c138a41-8a39-4b3b-8e04-afdca4ee5a7d admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:44.135952 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c138a41-8a39-4b3b-8e04-afdca4ee5a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:44.136304 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c138a41-8a39-4b3b-8e04-afdca4ee5a7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:44.137095 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c138a41-8a39-4b3b-8e04-afdca4ee5a7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:05:44.137475 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c138a41-8a39-4b3b-8e04-afdca4ee5a7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:44.139290 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c138a41-8a39-4b3b-8e04-afdca4ee5a7d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:44.170412 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1011/2010] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:05:44.173938 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387e39f-b175-444b-8757-36cabe643eba None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:44.187379 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387e39f-b175-444b-8757-36cabe643eba None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:44.195813 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261890fa-b703-4583-bf5d-df2a0fb89376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:44.196579 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261890fa-b703-4583-bf5d-df2a0fb89376 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:44.196938 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261890fa-b703-4583-bf5d-df2a0fb89376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:44.197281 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261890fa-b703-4583-bf5d-df2a0fb89376 admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:44.198042 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261890fa-b703-4583-bf5d-df2a0fb89376 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:44.201016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261890fa-b703-4583-bf5d-df2a0fb89376 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:44.266830 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1000/2011] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:05:44 2022] POST /identity/v3/projects => generated 367 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:05:44.270240 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c138a41-8a39-4b3b-8e04-afdca4ee5a7d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:44.293911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c138a41-8a39-4b3b-8e04-afdca4ee5a7d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:44.389191 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddef062-d0da-4cdb-bf3c-1834708b10c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:44.389782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddef062-d0da-4cdb-bf3c-1834708b10c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:44.390219 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddef062-d0da-4cdb-bf3c-1834708b10c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:44.390573 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddef062-d0da-4cdb-bf3c-1834708b10c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:44.391268 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddef062-d0da-4cdb-bf3c-1834708b10c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:44.393300 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddef062-d0da-4cdb-bf3c-1834708b10c3 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:44.433844 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1012/2012] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:05:44 2022] POST /identity/v3/users => generated 284 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:44.435455 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261890fa-b703-4583-bf5d-df2a0fb89376 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:44.450695 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261890fa-b703-4583-bf5d-df2a0fb89376 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:44.458227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161cc0a-8006-4e08-9b8c-0a6e4af2adcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:44.460588 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161cc0a-8006-4e08-9b8c-0a6e4af2adcf admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:44.461043 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161cc0a-8006-4e08-9b8c-0a6e4af2adcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:44.461483 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161cc0a-8006-4e08-9b8c-0a6e4af2adcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:44.462645 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161cc0a-8006-4e08-9b8c-0a6e4af2adcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:44.466954 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161cc0a-8006-4e08-9b8c-0a6e4af2adcf admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:44.490159 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1001/2013] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:05:44.491777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddef062-d0da-4cdb-bf3c-1834708b10c3 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:44.503044 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddef062-d0da-4cdb-bf3c-1834708b10c3 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:44.508617 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a65334-375e-410e-a80c-8f4eb58ff5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:44.509268 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a65334-375e-410e-a80c-8f4eb58ff5ed admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:44.509545 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a65334-375e-410e-a80c-8f4eb58ff5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:44.509821 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a65334-375e-410e-a80c-8f4eb58ff5ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:44.510792 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a65334-375e-410e-a80c-8f4eb58ff5ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:44.512674 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a65334-375e-410e-a80c-8f4eb58ff5ed admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:44.535157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161cc0a-8006-4e08-9b8c-0a6e4af2adcf admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:44.545283 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1013/2014] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:05:44.546716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161cc0a-8006-4e08-9b8c-0a6e4af2adcf admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:44.555808 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef3e71-0941-4cee-b0fa-c075ea697165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:44.557227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef3e71-0941-4cee-b0fa-c075ea697165 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:44.557663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef3e71-0941-4cee-b0fa-c075ea697165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:44.558099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef3e71-0941-4cee-b0fa-c075ea697165 admin admin] PATH_INFO: `/v3/projects/76283562eba0447b8b56e82f07b2c3c3/users/d9ff52bb140b43d3bd7731d8aeb5037b/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:44.577537 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef3e71-0941-4cee-b0fa-c075ea697165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76283562eba0447b8b56e82f07b2c3c3, user_id=d9ff52bb140b43d3bd7731d8aeb5037b, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:44.580637 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef3e71-0941-4cee-b0fa-c075ea697165 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:44.606621 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1002/2015] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:44 2022] PUT /identity/v3/projects/76283562eba0447b8b56e82f07b2c3c3/users/d9ff52bb140b43d3bd7731d8aeb5037b/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:44.617536 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a30047-180b-45c8-97f2-75abbb650422 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:44.617822 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a30047-180b-45c8-97f2-75abbb650422 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:44.618095 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a30047-180b-45c8-97f2-75abbb650422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:44.642110 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:44.653085 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-46a30047-180b-45c8-97f2-75abbb650422 None None] MFA Rules not processed for user `d9ff52bb140b43d3bd7731d8aeb5037b`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:44.655993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-46a30047-180b-45c8-97f2-75abbb650422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:44.757906 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1014/2016] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:44.762210 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef3e71-0941-4cee-b0fa-c075ea697165 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:44.864507 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef3e71-0941-4cee-b0fa-c075ea697165 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:44.870756 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5cbda7-e996-439d-8770-2e366c8cae08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:44.871551 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cbda7-e996-439d-8770-2e366c8cae08 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:44.872122 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cbda7-e996-439d-8770-2e366c8cae08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:44.872661 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cbda7-e996-439d-8770-2e366c8cae08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:44.873596 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5cbda7-e996-439d-8770-2e366c8cae08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:44.875869 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5cbda7-e996-439d-8770-2e366c8cae08 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:44.911454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:44.925863 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1003/2017] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:05:44 2022] POST /identity/v3/projects => generated 365 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:44.930353 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a30047-180b-45c8-97f2-75abbb650422 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:44.957135 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a30047-180b-45c8-97f2-75abbb650422 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:45.053625 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301540ed-8b51-4572-a517-503ceaa3bc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:45.054724 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301540ed-8b51-4572-a517-503ceaa3bc0f admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:45.055203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301540ed-8b51-4572-a517-503ceaa3bc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:45.056254 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301540ed-8b51-4572-a517-503ceaa3bc0f admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:45.057009 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301540ed-8b51-4572-a517-503ceaa3bc0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:45.060012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301540ed-8b51-4572-a517-503ceaa3bc0f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:45.094348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1015/2018] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:05:44 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:45.096880 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5cbda7-e996-439d-8770-2e366c8cae08 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:45.108890 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5cbda7-e996-439d-8770-2e366c8cae08 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:45.117837 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b081c-381f-417a-aa5b-fb78a1e4a7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:45.118791 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b081c-381f-417a-aa5b-fb78a1e4a7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:45.124149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b081c-381f-417a-aa5b-fb78a1e4a7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:45.124653 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b081c-381f-417a-aa5b-fb78a1e4a7a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:45.125694 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b081c-381f-417a-aa5b-fb78a1e4a7a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:45.127896 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b081c-381f-417a-aa5b-fb78a1e4a7a7 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:45.142975 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1004/2019] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:05:45.149785 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301540ed-8b51-4572-a517-503ceaa3bc0f admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:45.164949 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301540ed-8b51-4572-a517-503ceaa3bc0f admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:45.170261 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07e6f5-6e83-48f5-9037-d1b89c4e6747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:45.171015 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07e6f5-6e83-48f5-9037-d1b89c4e6747 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:45.171299 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07e6f5-6e83-48f5-9037-d1b89c4e6747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:45.171574 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07e6f5-6e83-48f5-9037-d1b89c4e6747 admin admin] PATH_INFO: `/v3/projects/cecf8bd257e84add9ed8559f5f02887b/users/3c282bcb937b41c096344ef70eac7970/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:45.209114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c07e6f5-6e83-48f5-9037-d1b89c4e6747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cecf8bd257e84add9ed8559f5f02887b, user_id=3c282bcb937b41c096344ef70eac7970, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:45.212708 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c07e6f5-6e83-48f5-9037-d1b89c4e6747 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:45.230369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1016/2020] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:45 2022] PUT /identity/v3/projects/cecf8bd257e84add9ed8559f5f02887b/users/3c282bcb937b41c096344ef70eac7970/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:45.235278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b081c-381f-417a-aa5b-fb78a1e4a7a7 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:45.249007 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b081c-381f-417a-aa5b-fb78a1e4a7a7 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:45.376958 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc4473-7c07-447b-891c-f4f35ecac0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:45.379957 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc4473-7c07-447b-891c-f4f35ecac0ab admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:45.380405 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc4473-7c07-447b-891c-f4f35ecac0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:45.380951 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc4473-7c07-447b-891c-f4f35ecac0ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:45.386205 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc4473-7c07-447b-891c-f4f35ecac0ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:45.388122 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc4473-7c07-447b-891c-f4f35ecac0ab admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:45.412414 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1005/2021] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:45.421586 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07e6f5-6e83-48f5-9037-d1b89c4e6747 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:45.442419 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07e6f5-6e83-48f5-9037-d1b89c4e6747 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:45.461813 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a233604-4d14-417a-a8f0-bf13723128fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:45.462776 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a233604-4d14-417a-a8f0-bf13723128fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:45.464408 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a233604-4d14-417a-a8f0-bf13723128fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:45.464408 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a233604-4d14-417a-a8f0-bf13723128fb admin admin] PATH_INFO: `/v3/projects/cecf8bd257e84add9ed8559f5f02887b/users/3c282bcb937b41c096344ef70eac7970/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:45.467000 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a233604-4d14-417a-a8f0-bf13723128fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cecf8bd257e84add9ed8559f5f02887b, user_id=3c282bcb937b41c096344ef70eac7970, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:45.470489 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a233604-4d14-417a-a8f0-bf13723128fb admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:45.494193 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1017/2022] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:45 2022] PUT /identity/v3/projects/cecf8bd257e84add9ed8559f5f02887b/users/3c282bcb937b41c096344ef70eac7970/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:45.505635 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f0285-e01c-4875-8bd7-c4cb83f40790 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:45.505927 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f0285-e01c-4875-8bd7-c4cb83f40790 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:45.506208 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f0285-e01c-4875-8bd7-c4cb83f40790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:45.553204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-973f0285-e01c-4875-8bd7-c4cb83f40790 None None] MFA Rules not processed for user `3c282bcb937b41c096344ef70eac7970`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:45.555875 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-973f0285-e01c-4875-8bd7-c4cb83f40790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:45.685215 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1006/2023] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:45 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:45.693108 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a233604-4d14-417a-a8f0-bf13723128fb admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:45.695026 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4a233604-4d14-417a-a8f0-bf13723128fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:45.777069 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a233604-4d14-417a-a8f0-bf13723128fb admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:45.781664 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e72c48-45a3-4d7b-9729-03f02d445d56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:45.782571 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e72c48-45a3-4d7b-9729-03f02d445d56 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:45.782802 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e72c48-45a3-4d7b-9729-03f02d445d56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:45.783146 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e72c48-45a3-4d7b-9729-03f02d445d56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:45.798172 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:45.813085 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e72c48-45a3-4d7b-9729-03f02d445d56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:45.818700 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e72c48-45a3-4d7b-9729-03f02d445d56 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:45.842185 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1018/2024] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:45 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:46.052318 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f0285-e01c-4875-8bd7-c4cb83f40790 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:46.075607 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f0285-e01c-4875-8bd7-c4cb83f40790 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:46.088296 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053dfef-15da-4990-b6a6-a2f3e4b1fd5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:46.089242 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053dfef-15da-4990-b6a6-a2f3e4b1fd5a service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:46.089720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053dfef-15da-4990-b6a6-a2f3e4b1fd5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:46.090139 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053dfef-15da-4990-b6a6-a2f3e4b1fd5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:46.233069 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8053dfef-15da-4990-b6a6-a2f3e4b1fd5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:46.235976 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8053dfef-15da-4990-b6a6-a2f3e4b1fd5a service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:46.264961 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1007/2025] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:46 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:47.479492 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e72c48-45a3-4d7b-9729-03f02d445d56 service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:47.483088 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e4e72c48-45a3-4d7b-9729-03f02d445d56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:47.578511 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e72c48-45a3-4d7b-9729-03f02d445d56 service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:47.583438 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08196b60-b89a-4491-9d7e-58a6fa1258cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:47.584174 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08196b60-b89a-4491-9d7e-58a6fa1258cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:47.584493 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08196b60-b89a-4491-9d7e-58a6fa1258cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:47.585289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08196b60-b89a-4491-9d7e-58a6fa1258cc admin admin] PATH_INFO: `/v3/users/1d9d7df288b94e45b3646f453b47d2f2` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:47.586512 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08196b60-b89a-4491-9d7e-58a6fa1258cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d9d7df288b94e45b3646f453b47d2f2)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:47.588463 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08196b60-b89a-4491-9d7e-58a6fa1258cc admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:47.638282 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-08196b60-b89a-4491-9d7e-58a6fa1258cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d9d7df288b94e45b3646f453b47d2f2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:47.645379 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-08196b60-b89a-4491-9d7e-58a6fa1258cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d9d7df288b94e45b3646f453b47d2f2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:47.646081 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-08196b60-b89a-4491-9d7e-58a6fa1258cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d9d7df288b94e45b3646f453b47d2f2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:47.659800 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-08196b60-b89a-4491-9d7e-58a6fa1258cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d9d7df288b94e45b3646f453b47d2f2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:47.660634 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-08196b60-b89a-4491-9d7e-58a6fa1258cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d9d7df288b94e45b3646f453b47d2f2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:47.674886 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1019/2026] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:05:47 2022] DELETE /identity/v3/users/1d9d7df288b94e45b3646f453b47d2f2 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:47.680783 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbf65e-bf81-4c34-bce3-b3a8dabd5027 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:47.681300 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbf65e-bf81-4c34-bce3-b3a8dabd5027 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:47.681394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbf65e-bf81-4c34-bce3-b3a8dabd5027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:47.707867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-c2fbf65e-bf81-4c34-bce3-b3a8dabd5027 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:47.709202 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-c2fbf65e-bf81-4c34-bce3-b3a8dabd5027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:47.714297 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:47.801978 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1008/2027] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:05:47.812501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08196b60-b89a-4491-9d7e-58a6fa1258cc admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:47.813910 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-08196b60-b89a-4491-9d7e-58a6fa1258cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:47.894460 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08196b60-b89a-4491-9d7e-58a6fa1258cc admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:47.899663 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4cea0-548d-4796-b3d1-c168bdcc10c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:47.900562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4cea0-548d-4796-b3d1-c168bdcc10c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:47.900974 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4cea0-548d-4796-b3d1-c168bdcc10c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:47.901239 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4cea0-548d-4796-b3d1-c168bdcc10c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:47.911453 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4cea0-548d-4796-b3d1-c168bdcc10c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:47.913638 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4cea0-548d-4796-b3d1-c168bdcc10c9 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:47.929977 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1020/2028] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:48.253462 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbf65e-bf81-4c34-bce3-b3a8dabd5027 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:48.254939 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-c2fbf65e-bf81-4c34-bce3-b3a8dabd5027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:48.267492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbf65e-bf81-4c34-bce3-b3a8dabd5027 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:48.272292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765524f-574f-4466-96f7-071c2676f986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:48.272960 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765524f-574f-4466-96f7-071c2676f986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:48.273436 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765524f-574f-4466-96f7-071c2676f986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:48.273711 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765524f-574f-4466-96f7-071c2676f986 admin admin] PATH_INFO: `/v3/projects/b51c3bde8d4d4eabbcd9b3412a64795f` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:48.274938 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765524f-574f-4466-96f7-071c2676f986 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b51c3bde8d4d4eabbcd9b3412a64795f)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:48.277224 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765524f-574f-4466-96f7-071c2676f986 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:48.329712 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-7765524f-574f-4466-96f7-071c2676f986 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b51c3bde8d4d4eabbcd9b3412a64795f', 'request_id': 'req-7765524f-574f-4466-96f7-071c2676f986'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:48.335564 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-7765524f-574f-4466-96f7-071c2676f986 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b51c3bde8d4d4eabbcd9b3412a64795f', 'request_id': 'req-7765524f-574f-4466-96f7-071c2676f986'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:48.344498 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-7765524f-574f-4466-96f7-071c2676f986 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b51c3bde8d4d4eabbcd9b3412a64795f', 'request_id': 'req-7765524f-574f-4466-96f7-071c2676f986'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:48.355871 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-7765524f-574f-4466-96f7-071c2676f986 admin admin] The token cache is being invalidate because project b51c3bde8d4d4eabbcd9b3412a64795f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:05:48.356166 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-7765524f-574f-4466-96f7-071c2676f986 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:48.356783 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-7765524f-574f-4466-96f7-071c2676f986 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:48.358281 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1009/2029] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:05:48 2022] DELETE /identity/v3/projects/b51c3bde8d4d4eabbcd9b3412a64795f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:05:48.362442 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4cea0-548d-4796-b3d1-c168bdcc10c9 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:48.373116 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4cea0-548d-4796-b3d1-c168bdcc10c9 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:48.387507 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:48.434191 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688dc4b-854b-4d1d-998c-5878cd5fcbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:48.434875 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688dc4b-854b-4d1d-998c-5878cd5fcbc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:48.435159 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688dc4b-854b-4d1d-998c-5878cd5fcbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:48.435437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688dc4b-854b-4d1d-998c-5878cd5fcbc2 admin admin] PATH_INFO: `/v3/users/e27229d1f28343de854fa7a78aa4bcf7` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:48.436648 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688dc4b-854b-4d1d-998c-5878cd5fcbc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e27229d1f28343de854fa7a78aa4bcf7)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:48.438819 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688dc4b-854b-4d1d-998c-5878cd5fcbc2 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:48.492752 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c688dc4b-854b-4d1d-998c-5878cd5fcbc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e27229d1f28343de854fa7a78aa4bcf7'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:48.501725 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c688dc4b-854b-4d1d-998c-5878cd5fcbc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e27229d1f28343de854fa7a78aa4bcf7'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:48.502411 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c688dc4b-854b-4d1d-998c-5878cd5fcbc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e27229d1f28343de854fa7a78aa4bcf7'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:48.515807 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c688dc4b-854b-4d1d-998c-5878cd5fcbc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e27229d1f28343de854fa7a78aa4bcf7'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:48.516532 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c688dc4b-854b-4d1d-998c-5878cd5fcbc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e27229d1f28343de854fa7a78aa4bcf7'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:48.531047 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1021/2030] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:05:48 2022] DELETE /identity/v3/users/e27229d1f28343de854fa7a78aa4bcf7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:48.971612 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765524f-574f-4466-96f7-071c2676f986 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:48.973259 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-7765524f-574f-4466-96f7-071c2676f986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:49.008994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765524f-574f-4466-96f7-071c2676f986 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:49.081081 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7d84a-d160-4b19-8440-ed646aabc689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:49.081988 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7d84a-d160-4b19-8440-ed646aabc689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:49.082264 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7d84a-d160-4b19-8440-ed646aabc689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:49.082571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7d84a-d160-4b19-8440-ed646aabc689 admin admin] PATH_INFO: `/v3/projects/575331fa2c674008b22967643a309a9c` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:49.083737 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7d84a-d160-4b19-8440-ed646aabc689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=575331fa2c674008b22967643a309a9c)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:49.086299 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7d84a-d160-4b19-8440-ed646aabc689 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:49.156229 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:49.171308 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-74f7d84a-d160-4b19-8440-ed646aabc689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '575331fa2c674008b22967643a309a9c', 'request_id': 'req-74f7d84a-d160-4b19-8440-ed646aabc689'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:49.184581 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-74f7d84a-d160-4b19-8440-ed646aabc689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '575331fa2c674008b22967643a309a9c', 'request_id': 'req-74f7d84a-d160-4b19-8440-ed646aabc689'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:49.199344 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-74f7d84a-d160-4b19-8440-ed646aabc689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '575331fa2c674008b22967643a309a9c', 'request_id': 'req-74f7d84a-d160-4b19-8440-ed646aabc689'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:49.220013 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-74f7d84a-d160-4b19-8440-ed646aabc689 admin admin] The token cache is being invalidate because project 575331fa2c674008b22967643a309a9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:05:49.220320 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-74f7d84a-d160-4b19-8440-ed646aabc689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:49.221076 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-74f7d84a-d160-4b19-8440-ed646aabc689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:49.223057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1010/2031] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:05:48 2022] DELETE /identity/v3/projects/575331fa2c674008b22967643a309a9c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:05:49.228589 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8f330-823d-468d-860b-8dc84204f66c None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:49.228876 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8f330-823d-468d-860b-8dc84204f66c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:49.229155 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8f330-823d-468d-860b-8dc84204f66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:49.265113 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-8fe8f330-823d-468d-860b-8dc84204f66c None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:49.265113 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-8fe8f330-823d-468d-860b-8dc84204f66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:49.352929 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1022/2032] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:49.361363 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44030c8-0d87-44b6-9d61-a2dd8b842ed3 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:49.361363 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44030c8-0d87-44b6-9d61-a2dd8b842ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:49.361671 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44030c8-0d87-44b6-9d61-a2dd8b842ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:49.386795 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-b44030c8-0d87-44b6-9d61-a2dd8b842ed3 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:49.388043 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-b44030c8-0d87-44b6-9d61-a2dd8b842ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:49.403572 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1011/2033] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:49.407316 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8f330-823d-468d-860b-8dc84204f66c None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:49.437968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8f330-823d-468d-860b-8dc84204f66c None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:49.446733 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4d1e9-324a-43ba-a3f0-2d8b0db29203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:49.450817 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4d1e9-324a-43ba-a3f0-2d8b0db29203 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:49.451325 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4d1e9-324a-43ba-a3f0-2d8b0db29203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:49.451814 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4d1e9-324a-43ba-a3f0-2d8b0db29203 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:49.453416 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4d1e9-324a-43ba-a3f0-2d8b0db29203 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:05:49.454030 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4d1e9-324a-43ba-a3f0-2d8b0db29203 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:49.457345 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4d1e9-324a-43ba-a3f0-2d8b0db29203 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:49.478596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1023/2034] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:05:49.485895 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44030c8-0d87-44b6-9d61-a2dd8b842ed3 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:49.508896 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44030c8-0d87-44b6-9d61-a2dd8b842ed3 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:49.518933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e3c69-92f6-41b0-bf13-21475b755d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:49.519986 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e3c69-92f6-41b0-bf13-21475b755d15 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:49.520356 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e3c69-92f6-41b0-bf13-21475b755d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:49.520815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e3c69-92f6-41b0-bf13-21475b755d15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:49.521954 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e3c69-92f6-41b0-bf13-21475b755d15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:49.525983 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e3c69-92f6-41b0-bf13-21475b755d15 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:49.622088 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1012/2035] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:05:49 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:49.626017 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4d1e9-324a-43ba-a3f0-2d8b0db29203 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:49.639997 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4d1e9-324a-43ba-a3f0-2d8b0db29203 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:49.692684 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:49.746603 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6431a1c-0b65-45ff-8515-4466567eba78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:49.749945 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6431a1c-0b65-45ff-8515-4466567eba78 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:49.751426 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6431a1c-0b65-45ff-8515-4466567eba78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:49.751901 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6431a1c-0b65-45ff-8515-4466567eba78 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:49.753664 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6431a1c-0b65-45ff-8515-4466567eba78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:49.755795 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6431a1c-0b65-45ff-8515-4466567eba78 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:49.782633 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1024/2036] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:05:49 2022] POST /identity/v3/users => generated 291 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:05:49.787014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e3c69-92f6-41b0-bf13-21475b755d15 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:49.799538 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e3c69-92f6-41b0-bf13-21475b755d15 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:49.805622 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219fe54-beef-4f5e-9406-742865204487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:49.806452 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219fe54-beef-4f5e-9406-742865204487 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:49.806810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219fe54-beef-4f5e-9406-742865204487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:49.807167 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219fe54-beef-4f5e-9406-742865204487 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:49.808023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8219fe54-beef-4f5e-9406-742865204487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:49.810150 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8219fe54-beef-4f5e-9406-742865204487 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:49.824312 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1013/2037] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:49.828243 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6431a1c-0b65-45ff-8515-4466567eba78 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:49.842032 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6431a1c-0b65-45ff-8515-4466567eba78 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:49.848343 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ee6b0-f0f4-4f52-9eb0-9ef4759a23d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:49.848997 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ee6b0-f0f4-4f52-9eb0-9ef4759a23d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:49.849344 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ee6b0-f0f4-4f52-9eb0-9ef4759a23d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:49.849613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ee6b0-f0f4-4f52-9eb0-9ef4759a23d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:49.850615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ee6b0-f0f4-4f52-9eb0-9ef4759a23d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:49.852501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ee6b0-f0f4-4f52-9eb0-9ef4759a23d5 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:49.869365 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1025/2038] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:05:49.873244 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219fe54-beef-4f5e-9406-742865204487 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:49.892984 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219fe54-beef-4f5e-9406-742865204487 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:49.903284 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91232fd0-accd-4502-bc92-4d04dd931890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:49.904307 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91232fd0-accd-4502-bc92-4d04dd931890 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:49.904751 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91232fd0-accd-4502-bc92-4d04dd931890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:49.905274 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91232fd0-accd-4502-bc92-4d04dd931890 admin admin] PATH_INFO: `/v3/projects/bba43fe0eb0f4d4fa6bce786c495cddc/users/c5f020c00cf94a0e9cf923d8c090a91e/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:49.925508 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91232fd0-accd-4502-bc92-4d04dd931890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba43fe0eb0f4d4fa6bce786c495cddc, user_id=c5f020c00cf94a0e9cf923d8c090a91e, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:49.928413 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91232fd0-accd-4502-bc92-4d04dd931890 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:49.946077 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1014/2039] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:49 2022] PUT /identity/v3/projects/bba43fe0eb0f4d4fa6bce786c495cddc/users/c5f020c00cf94a0e9cf923d8c090a91e/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:05:49.957285 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67dafe-31c2-4b2e-ba51-fa63953a3b6d None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:49.957589 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67dafe-31c2-4b2e-ba51-fa63953a3b6d None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:49.957859 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67dafe-31c2-4b2e-ba51-fa63953a3b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:50.001073 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-df67dafe-31c2-4b2e-ba51-fa63953a3b6d None None] MFA Rules not processed for user `c5f020c00cf94a0e9cf923d8c090a91e`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:50.003441 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-df67dafe-31c2-4b2e-ba51-fa63953a3b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:50.081894 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1026/2040] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:50.087760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91232fd0-accd-4502-bc92-4d04dd931890 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:50.184954 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91232fd0-accd-4502-bc92-4d04dd931890 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:50.189761 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8f6ae-4b10-4853-842e-be9d95bb650d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:50.190494 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8f6ae-4b10-4853-842e-be9d95bb650d admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:50.190834 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8f6ae-4b10-4853-842e-be9d95bb650d admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:50.191173 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8f6ae-4b10-4853-842e-be9d95bb650d admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:50.191964 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace8f6ae-4b10-4853-842e-be9d95bb650d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:50.193950 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace8f6ae-4b10-4853-842e-be9d95bb650d admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:50.228097 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1015/2041] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:05:50 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:50.229794 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67dafe-31c2-4b2e-ba51-fa63953a3b6d None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:50.240946 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67dafe-31c2-4b2e-ba51-fa63953a3b6d None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:50.307840 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bb53a-0750-47fc-a9c1-26e07360b344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:50.308388 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bb53a-0750-47fc-a9c1-26e07360b344 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:50.308661 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bb53a-0750-47fc-a9c1-26e07360b344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:50.308938 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bb53a-0750-47fc-a9c1-26e07360b344 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:50.309603 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bb53a-0750-47fc-a9c1-26e07360b344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:50.312299 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bb53a-0750-47fc-a9c1-26e07360b344 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:50.338443 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1027/2042] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:05:50 2022] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:50.339724 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8f6ae-4b10-4853-842e-be9d95bb650d admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:50.351604 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8f6ae-4b10-4853-842e-be9d95bb650d admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:50.358926 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681269c-5410-4f9d-9a16-b33e0734bd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:50.359532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681269c-5410-4f9d-9a16-b33e0734bd2c admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:50.360114 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681269c-5410-4f9d-9a16-b33e0734bd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:50.360226 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681269c-5410-4f9d-9a16-b33e0734bd2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:50.360886 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681269c-5410-4f9d-9a16-b33e0734bd2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:50.362563 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681269c-5410-4f9d-9a16-b33e0734bd2c admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:50.378615 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1016/2043] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:50.384646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bb53a-0750-47fc-a9c1-26e07360b344 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:50.396723 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bb53a-0750-47fc-a9c1-26e07360b344 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:50.402160 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259ef02-23f8-4c8d-944f-1f4848da581f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:50.402869 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259ef02-23f8-4c8d-944f-1f4848da581f admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:50.403154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259ef02-23f8-4c8d-944f-1f4848da581f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:50.403427 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259ef02-23f8-4c8d-944f-1f4848da581f admin admin] PATH_INFO: `/v3/projects/024e3b985b4345afaa794b89f80cb833/users/6da564e8b9ac4417a054bd2ca1e50fdc/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:50.419582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259ef02-23f8-4c8d-944f-1f4848da581f admin admin] RBAC: Authorizing `identity:create_grant(project_id=024e3b985b4345afaa794b89f80cb833, user_id=6da564e8b9ac4417a054bd2ca1e50fdc, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:50.422567 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259ef02-23f8-4c8d-944f-1f4848da581f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:50.432259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:50.440845 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1028/2044] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:50 2022] PUT /identity/v3/projects/024e3b985b4345afaa794b89f80cb833/users/6da564e8b9ac4417a054bd2ca1e50fdc/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:50.445220 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681269c-5410-4f9d-9a16-b33e0734bd2c admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:50.457588 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681269c-5410-4f9d-9a16-b33e0734bd2c admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:50.490000 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:50.521544 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48f68a-e107-4711-bfae-c2d1cbf7978c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:50.522222 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48f68a-e107-4711-bfae-c2d1cbf7978c admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:50.522720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48f68a-e107-4711-bfae-c2d1cbf7978c admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:50.523002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48f68a-e107-4711-bfae-c2d1cbf7978c admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:50.523708 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48f68a-e107-4711-bfae-c2d1cbf7978c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:50.525318 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48f68a-e107-4711-bfae-c2d1cbf7978c admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:50.539125 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1017/2045] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:50.540559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259ef02-23f8-4c8d-944f-1f4848da581f admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:50.552388 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259ef02-23f8-4c8d-944f-1f4848da581f admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:50.558464 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d436e-d10c-46e2-9b80-95d1d467fcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:50.559202 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d436e-d10c-46e2-9b80-95d1d467fcf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:50.559522 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d436e-d10c-46e2-9b80-95d1d467fcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:50.559772 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d436e-d10c-46e2-9b80-95d1d467fcf1 admin admin] PATH_INFO: `/v3/projects/024e3b985b4345afaa794b89f80cb833/users/6da564e8b9ac4417a054bd2ca1e50fdc/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:50.561935 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d436e-d10c-46e2-9b80-95d1d467fcf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=024e3b985b4345afaa794b89f80cb833, user_id=6da564e8b9ac4417a054bd2ca1e50fdc, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:50.564690 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d436e-d10c-46e2-9b80-95d1d467fcf1 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:50.577531 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1029/2046] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:50 2022] PUT /identity/v3/projects/024e3b985b4345afaa794b89f80cb833/users/6da564e8b9ac4417a054bd2ca1e50fdc/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:50.649452 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab37b1d-4857-4b6e-a951-3c2827d601be None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:50.649655 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab37b1d-4857-4b6e-a951-3c2827d601be None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:50.650017 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab37b1d-4857-4b6e-a951-3c2827d601be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:50.686183 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-dab37b1d-4857-4b6e-a951-3c2827d601be None None] MFA Rules not processed for user `6da564e8b9ac4417a054bd2ca1e50fdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:50.687781 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-dab37b1d-4857-4b6e-a951-3c2827d601be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:50.772234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1018/2047] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:50.785094 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d436e-d10c-46e2-9b80-95d1d467fcf1 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:50.787027 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-628d436e-d10c-46e2-9b80-95d1d467fcf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:50.853983 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d436e-d10c-46e2-9b80-95d1d467fcf1 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:50.857886 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e64685-f104-4817-8b8c-1398be371d21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:50.858562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e64685-f104-4817-8b8c-1398be371d21 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:50.858850 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e64685-f104-4817-8b8c-1398be371d21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:50.859129 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e64685-f104-4817-8b8c-1398be371d21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:50.869811 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e64685-f104-4817-8b8c-1398be371d21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:50.871317 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e64685-f104-4817-8b8c-1398be371d21 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:50.882586 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1030/2048] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:50.963895 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab37b1d-4857-4b6e-a951-3c2827d601be None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:50.974051 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab37b1d-4857-4b6e-a951-3c2827d601be None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:50.981571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a943f6-a98c-4b3b-aab4-93bfbf4ca373 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:50.982406 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a943f6-a98c-4b3b-aab4-93bfbf4ca373 service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:50.983062 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a943f6-a98c-4b3b-aab4-93bfbf4ca373 service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:50.983445 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a943f6-a98c-4b3b-aab4-93bfbf4ca373 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:51.064090 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a943f6-a98c-4b3b-aab4-93bfbf4ca373 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:51.065751 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a943f6-a98c-4b3b-aab4-93bfbf4ca373 service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:51.082988 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1019/2049] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:51.394241 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e64685-f104-4817-8b8c-1398be371d21 service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:51.459481 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e64685-f104-4817-8b8c-1398be371d21 service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:51.464793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169c2ff-1b3b-46a6-a05c-8fdbeecfe2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:51.465458 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169c2ff-1b3b-46a6-a05c-8fdbeecfe2f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:51.465751 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169c2ff-1b3b-46a6-a05c-8fdbeecfe2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:51.466030 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169c2ff-1b3b-46a6-a05c-8fdbeecfe2f7 admin admin] PATH_INFO: `/v3/users/c5f020c00cf94a0e9cf923d8c090a91e` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:51.467274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169c2ff-1b3b-46a6-a05c-8fdbeecfe2f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5f020c00cf94a0e9cf923d8c090a91e)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:51.469287 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169c2ff-1b3b-46a6-a05c-8fdbeecfe2f7 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:51.524592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4169c2ff-1b3b-46a6-a05c-8fdbeecfe2f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5f020c00cf94a0e9cf923d8c090a91e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:51.533296 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4169c2ff-1b3b-46a6-a05c-8fdbeecfe2f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5f020c00cf94a0e9cf923d8c090a91e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:51.534144 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4169c2ff-1b3b-46a6-a05c-8fdbeecfe2f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5f020c00cf94a0e9cf923d8c090a91e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:51.551238 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4169c2ff-1b3b-46a6-a05c-8fdbeecfe2f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5f020c00cf94a0e9cf923d8c090a91e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:51.552852 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4169c2ff-1b3b-46a6-a05c-8fdbeecfe2f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5f020c00cf94a0e9cf923d8c090a91e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:51.570907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1031/2050] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:05:51 2022] DELETE /identity/v3/users/c5f020c00cf94a0e9cf923d8c090a91e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:51.577196 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c486df7-0f63-4a39-a381-18606b40fad1 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:51.577768 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c486df7-0f63-4a39-a381-18606b40fad1 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:51.577998 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c486df7-0f63-4a39-a381-18606b40fad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:51.600002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-7c486df7-0f63-4a39-a381-18606b40fad1 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:51.601825 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-7c486df7-0f63-4a39-a381-18606b40fad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:51.659170 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:51.673891 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1020/2051] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:51.687374 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169c2ff-1b3b-46a6-a05c-8fdbeecfe2f7 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:51.688601 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4169c2ff-1b3b-46a6-a05c-8fdbeecfe2f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:51.693178 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c486df7-0f63-4a39-a381-18606b40fad1 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:51.695558 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-7c486df7-0f63-4a39-a381-18606b40fad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:51.700673 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:51.709612 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c486df7-0f63-4a39-a381-18606b40fad1 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:51.715149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abea2dd-eb94-461e-af9d-d6b6f87226be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:51.715798 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abea2dd-eb94-461e-af9d-d6b6f87226be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:51.716075 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abea2dd-eb94-461e-af9d-d6b6f87226be admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:51.716344 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abea2dd-eb94-461e-af9d-d6b6f87226be admin admin] PATH_INFO: `/v3/users/d9ff52bb140b43d3bd7731d8aeb5037b` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:51.717516 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abea2dd-eb94-461e-af9d-d6b6f87226be admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9ff52bb140b43d3bd7731d8aeb5037b)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:51.719479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abea2dd-eb94-461e-af9d-d6b6f87226be admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:51.763481 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169c2ff-1b3b-46a6-a05c-8fdbeecfe2f7 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:51.768051 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c25359-6d1c-4fc0-a8ad-e1625af0b092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:51.768983 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c25359-6d1c-4fc0-a8ad-e1625af0b092 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:51.769416 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c25359-6d1c-4fc0-a8ad-e1625af0b092 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:51.769851 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c25359-6d1c-4fc0-a8ad-e1625af0b092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:51.781436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c25359-6d1c-4fc0-a8ad-e1625af0b092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:51.783198 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c25359-6d1c-4fc0-a8ad-e1625af0b092 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:51.787526 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-6abea2dd-eb94-461e-af9d-d6b6f87226be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9ff52bb140b43d3bd7731d8aeb5037b'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:51.788757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-6abea2dd-eb94-461e-af9d-d6b6f87226be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9ff52bb140b43d3bd7731d8aeb5037b'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:51.789391 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-6abea2dd-eb94-461e-af9d-d6b6f87226be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9ff52bb140b43d3bd7731d8aeb5037b'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:51.794118 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1032/2052] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:51.802564 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-6abea2dd-eb94-461e-af9d-d6b6f87226be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9ff52bb140b43d3bd7731d8aeb5037b'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:51.816145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-6abea2dd-eb94-461e-af9d-d6b6f87226be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9ff52bb140b43d3bd7731d8aeb5037b'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:51.832659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1021/2053] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:05:51 2022] DELETE /identity/v3/users/d9ff52bb140b43d3bd7731d8aeb5037b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:05:51.838581 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767135b-8c90-40f4-a9b2-8d07086d7853 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:51.838843 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767135b-8c90-40f4-a9b2-8d07086d7853 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:51.839291 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767135b-8c90-40f4-a9b2-8d07086d7853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:51.859410 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f767135b-8c90-40f4-a9b2-8d07086d7853 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:51.860629 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f767135b-8c90-40f4-a9b2-8d07086d7853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:51.924678 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1033/2054] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:51.936515 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abea2dd-eb94-461e-af9d-d6b6f87226be admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:51.938072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-6abea2dd-eb94-461e-af9d-d6b6f87226be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:52.002820 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abea2dd-eb94-461e-af9d-d6b6f87226be admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:52.007118 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d0be2-576e-4f2e-a809-e4bdb0fe24ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:52.007758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d0be2-576e-4f2e-a809-e4bdb0fe24ea service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:52.008036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d0be2-576e-4f2e-a809-e4bdb0fe24ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:52.008403 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d0be2-576e-4f2e-a809-e4bdb0fe24ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:52.025995 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d0be2-576e-4f2e-a809-e4bdb0fe24ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:52.027845 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d0be2-576e-4f2e-a809-e4bdb0fe24ea service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:52.045287 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1022/2055] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:52.102352 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767135b-8c90-40f4-a9b2-8d07086d7853 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:52.102352 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f767135b-8c90-40f4-a9b2-8d07086d7853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:52.125361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767135b-8c90-40f4-a9b2-8d07086d7853 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:52.131367 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7264b-1b18-4d52-8ecd-791d4ba1f64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:52.132744 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7264b-1b18-4d52-8ecd-791d4ba1f64e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:52.133109 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7264b-1b18-4d52-8ecd-791d4ba1f64e admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:52.133488 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7264b-1b18-4d52-8ecd-791d4ba1f64e admin admin] PATH_INFO: `/v3/projects/bba43fe0eb0f4d4fa6bce786c495cddc` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:52.134859 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7264b-1b18-4d52-8ecd-791d4ba1f64e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bba43fe0eb0f4d4fa6bce786c495cddc)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:52.136879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7264b-1b18-4d52-8ecd-791d4ba1f64e admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:52.203235 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d9a7264b-1b18-4d52-8ecd-791d4ba1f64e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bba43fe0eb0f4d4fa6bce786c495cddc', 'request_id': 'req-d9a7264b-1b18-4d52-8ecd-791d4ba1f64e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:52.213299 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d9a7264b-1b18-4d52-8ecd-791d4ba1f64e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bba43fe0eb0f4d4fa6bce786c495cddc', 'request_id': 'req-d9a7264b-1b18-4d52-8ecd-791d4ba1f64e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:52.219470 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d9a7264b-1b18-4d52-8ecd-791d4ba1f64e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bba43fe0eb0f4d4fa6bce786c495cddc', 'request_id': 'req-d9a7264b-1b18-4d52-8ecd-791d4ba1f64e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:52.234560 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d9a7264b-1b18-4d52-8ecd-791d4ba1f64e admin admin] The token cache is being invalidate because project bba43fe0eb0f4d4fa6bce786c495cddc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:05:52.234959 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d9a7264b-1b18-4d52-8ecd-791d4ba1f64e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:52.235814 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d9a7264b-1b18-4d52-8ecd-791d4ba1f64e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:52.237725 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1034/2056] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:05:52 2022] DELETE /identity/v3/projects/bba43fe0eb0f4d4fa6bce786c495cddc => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:52.243688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d0be2-576e-4f2e-a809-e4bdb0fe24ea service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:52.269485 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d0be2-576e-4f2e-a809-e4bdb0fe24ea service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:52.340037 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64728060-3981-416f-9906-5a36d9f35e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:52.340760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64728060-3981-416f-9906-5a36d9f35e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:52.340970 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64728060-3981-416f-9906-5a36d9f35e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:52.341240 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64728060-3981-416f-9906-5a36d9f35e10 admin admin] PATH_INFO: `/v3/users/6da564e8b9ac4417a054bd2ca1e50fdc` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:52.342468 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64728060-3981-416f-9906-5a36d9f35e10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6da564e8b9ac4417a054bd2ca1e50fdc)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:52.344408 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64728060-3981-416f-9906-5a36d9f35e10 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:52.360243 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:52.397613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7264b-1b18-4d52-8ecd-791d4ba1f64e admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:52.400257 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d9a7264b-1b18-4d52-8ecd-791d4ba1f64e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:52.419019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7264b-1b18-4d52-8ecd-791d4ba1f64e admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:52.427660 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec5a55-7e97-4879-869d-f2c81894961a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:52.431234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec5a55-7e97-4879-869d-f2c81894961a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:52.431588 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec5a55-7e97-4879-869d-f2c81894961a admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:52.431841 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec5a55-7e97-4879-869d-f2c81894961a admin admin] PATH_INFO: `/v3/projects/76283562eba0447b8b56e82f07b2c3c3` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:52.434777 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-64728060-3981-416f-9906-5a36d9f35e10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6da564e8b9ac4417a054bd2ca1e50fdc'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:52.435233 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec5a55-7e97-4879-869d-f2c81894961a admin admin] RBAC: Authorizing `identity:delete_project(project_id=76283562eba0447b8b56e82f07b2c3c3)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:52.437156 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec5a55-7e97-4879-869d-f2c81894961a admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:52.439054 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-64728060-3981-416f-9906-5a36d9f35e10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6da564e8b9ac4417a054bd2ca1e50fdc'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:52.440418 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-64728060-3981-416f-9906-5a36d9f35e10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6da564e8b9ac4417a054bd2ca1e50fdc'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:52.452517 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-64728060-3981-416f-9906-5a36d9f35e10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6da564e8b9ac4417a054bd2ca1e50fdc'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:52.484701 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:52.486277 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-64728060-3981-416f-9906-5a36d9f35e10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6da564e8b9ac4417a054bd2ca1e50fdc'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:52.514967 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-42ec5a55-7e97-4879-869d-f2c81894961a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76283562eba0447b8b56e82f07b2c3c3', 'request_id': 'req-42ec5a55-7e97-4879-869d-f2c81894961a'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:52.523590 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-42ec5a55-7e97-4879-869d-f2c81894961a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76283562eba0447b8b56e82f07b2c3c3', 'request_id': 'req-42ec5a55-7e97-4879-869d-f2c81894961a'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:52.529756 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-42ec5a55-7e97-4879-869d-f2c81894961a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76283562eba0447b8b56e82f07b2c3c3', 'request_id': 'req-42ec5a55-7e97-4879-869d-f2c81894961a'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:52.531698 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1023/2057] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:05:52 2022] DELETE /identity/v3/users/6da564e8b9ac4417a054bd2ca1e50fdc => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:52.546582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-42ec5a55-7e97-4879-869d-f2c81894961a admin admin] The token cache is being invalidate because project 76283562eba0447b8b56e82f07b2c3c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:05:52.547119 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-42ec5a55-7e97-4879-869d-f2c81894961a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:52.547847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-42ec5a55-7e97-4879-869d-f2c81894961a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:52.549640 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1035/2058] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:05:52 2022] DELETE /identity/v3/projects/76283562eba0447b8b56e82f07b2c3c3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:52.554456 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64728060-3981-416f-9906-5a36d9f35e10 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:52.556816 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-64728060-3981-416f-9906-5a36d9f35e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:52.650835 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64728060-3981-416f-9906-5a36d9f35e10 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:52.657318 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2291f3-ad0d-4b15-a707-d9f4e006f685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:52.658001 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2291f3-ad0d-4b15-a707-d9f4e006f685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:52.658283 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2291f3-ad0d-4b15-a707-d9f4e006f685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:52.658587 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2291f3-ad0d-4b15-a707-d9f4e006f685 admin admin] PATH_INFO: `/v3/users/3c282bcb937b41c096344ef70eac7970` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:52.659915 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2291f3-ad0d-4b15-a707-d9f4e006f685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c282bcb937b41c096344ef70eac7970)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:52.662076 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2291f3-ad0d-4b15-a707-d9f4e006f685 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:52.734387 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-3b2291f3-ad0d-4b15-a707-d9f4e006f685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c282bcb937b41c096344ef70eac7970'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:52.735188 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-3b2291f3-ad0d-4b15-a707-d9f4e006f685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c282bcb937b41c096344ef70eac7970'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:52.736050 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-3b2291f3-ad0d-4b15-a707-d9f4e006f685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c282bcb937b41c096344ef70eac7970'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:52.755655 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-3b2291f3-ad0d-4b15-a707-d9f4e006f685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c282bcb937b41c096344ef70eac7970'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:52.770415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-3b2291f3-ad0d-4b15-a707-d9f4e006f685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c282bcb937b41c096344ef70eac7970'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:52.785349 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1024/2059] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:05:52 2022] DELETE /identity/v3/users/3c282bcb937b41c096344ef70eac7970 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:52.853269 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec5a55-7e97-4879-869d-f2c81894961a admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:52.859574 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-42ec5a55-7e97-4879-869d-f2c81894961a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:52.947171 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec5a55-7e97-4879-869d-f2c81894961a admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:53.012748 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853ea10-7dc6-47fe-8df2-cddbd15d9d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:53.013999 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853ea10-7dc6-47fe-8df2-cddbd15d9d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:53.014794 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853ea10-7dc6-47fe-8df2-cddbd15d9d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:53.015245 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853ea10-7dc6-47fe-8df2-cddbd15d9d8e admin admin] PATH_INFO: `/v3/projects/024e3b985b4345afaa794b89f80cb833` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:53.019535 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853ea10-7dc6-47fe-8df2-cddbd15d9d8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=024e3b985b4345afaa794b89f80cb833)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:53.021561 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853ea10-7dc6-47fe-8df2-cddbd15d9d8e admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:53.073244 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f853ea10-7dc6-47fe-8df2-cddbd15d9d8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '024e3b985b4345afaa794b89f80cb833', 'request_id': 'req-f853ea10-7dc6-47fe-8df2-cddbd15d9d8e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:53.080556 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f853ea10-7dc6-47fe-8df2-cddbd15d9d8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '024e3b985b4345afaa794b89f80cb833', 'request_id': 'req-f853ea10-7dc6-47fe-8df2-cddbd15d9d8e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:53.092372 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f853ea10-7dc6-47fe-8df2-cddbd15d9d8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '024e3b985b4345afaa794b89f80cb833', 'request_id': 'req-f853ea10-7dc6-47fe-8df2-cddbd15d9d8e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:53.095045 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:53.110113 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f853ea10-7dc6-47fe-8df2-cddbd15d9d8e admin admin] The token cache is being invalidate because project 024e3b985b4345afaa794b89f80cb833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:05:53.110492 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f853ea10-7dc6-47fe-8df2-cddbd15d9d8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:53.111107 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f853ea10-7dc6-47fe-8df2-cddbd15d9d8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:53.118401 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1036/2060] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:05:52 2022] DELETE /identity/v3/projects/024e3b985b4345afaa794b89f80cb833 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:05:53.783085 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2291f3-ad0d-4b15-a707-d9f4e006f685 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:53.784644 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-3b2291f3-ad0d-4b15-a707-d9f4e006f685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:53.802028 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2291f3-ad0d-4b15-a707-d9f4e006f685 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:53.807069 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:53.874596 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683560b-016d-4bc1-924f-9a3704ac1a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:53.875365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683560b-016d-4bc1-924f-9a3704ac1a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:53.875715 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683560b-016d-4bc1-924f-9a3704ac1a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:53.876082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683560b-016d-4bc1-924f-9a3704ac1a39 admin admin] PATH_INFO: `/v3/projects/cecf8bd257e84add9ed8559f5f02887b` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:53.877408 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683560b-016d-4bc1-924f-9a3704ac1a39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cecf8bd257e84add9ed8559f5f02887b)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:53.879592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683560b-016d-4bc1-924f-9a3704ac1a39 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:53.946435 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-f683560b-016d-4bc1-924f-9a3704ac1a39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cecf8bd257e84add9ed8559f5f02887b', 'request_id': 'req-f683560b-016d-4bc1-924f-9a3704ac1a39'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:53.952276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-f683560b-016d-4bc1-924f-9a3704ac1a39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cecf8bd257e84add9ed8559f5f02887b', 'request_id': 'req-f683560b-016d-4bc1-924f-9a3704ac1a39'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:53.961138 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-f683560b-016d-4bc1-924f-9a3704ac1a39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cecf8bd257e84add9ed8559f5f02887b', 'request_id': 'req-f683560b-016d-4bc1-924f-9a3704ac1a39'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:53.973196 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-f683560b-016d-4bc1-924f-9a3704ac1a39 admin admin] The token cache is being invalidate because project cecf8bd257e84add9ed8559f5f02887b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:05:53.973641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-f683560b-016d-4bc1-924f-9a3704ac1a39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:53.974472 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-f683560b-016d-4bc1-924f-9a3704ac1a39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:53.977270 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1025/2061] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:05:53 2022] DELETE /identity/v3/projects/cecf8bd257e84add9ed8559f5f02887b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:53.982401 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f7228-e248-4b07-9308-6c4fb7573a55 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:53.984085 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f7228-e248-4b07-9308-6c4fb7573a55 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:53.984756 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f7228-e248-4b07-9308-6c4fb7573a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:54.006190 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-849f7228-e248-4b07-9308-6c4fb7573a55 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:54.007997 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-849f7228-e248-4b07-9308-6c4fb7573a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:54.072106 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1037/2062] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:54.081470 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03f048-4302-4f8d-9717-31ccf15876e7 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:54.082025 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03f048-4302-4f8d-9717-31ccf15876e7 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:54.082304 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03f048-4302-4f8d-9717-31ccf15876e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:54.104953 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-7f03f048-4302-4f8d-9717-31ccf15876e7 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:54.106183 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-7f03f048-4302-4f8d-9717-31ccf15876e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:54.119590 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1026/2063] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:54.122718 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f7228-e248-4b07-9308-6c4fb7573a55 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:54.138939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f7228-e248-4b07-9308-6c4fb7573a55 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:54.144653 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb4c46-d443-4837-a5f1-64ed3df4ac25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:54.145604 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb4c46-d443-4837-a5f1-64ed3df4ac25 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:54.146064 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb4c46-d443-4837-a5f1-64ed3df4ac25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:54.146423 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb4c46-d443-4837-a5f1-64ed3df4ac25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:54.147218 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb4c46-d443-4837-a5f1-64ed3df4ac25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:05:54.147753 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb4c46-d443-4837-a5f1-64ed3df4ac25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:54.149972 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb4c46-d443-4837-a5f1-64ed3df4ac25 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:54.168169 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1038/2064] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:05:54.172946 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03f048-4302-4f8d-9717-31ccf15876e7 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:54.186262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03f048-4302-4f8d-9717-31ccf15876e7 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:54.193881 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a43666-b3d9-4631-ad78-194dc27e3ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:54.194919 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a43666-b3d9-4631-ad78-194dc27e3ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:54.195534 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a43666-b3d9-4631-ad78-194dc27e3ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:54.196036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a43666-b3d9-4631-ad78-194dc27e3ad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:54.196897 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a43666-b3d9-4631-ad78-194dc27e3ad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:54.198993 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a43666-b3d9-4631-ad78-194dc27e3ad2 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:54.235216 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1027/2065] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:05:54 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:54.236339 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb4c46-d443-4837-a5f1-64ed3df4ac25 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:54.248428 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb4c46-d443-4837-a5f1-64ed3df4ac25 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:54.327182 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f43c99-55cc-41d1-8492-53fb1719bb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:54.327848 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f43c99-55cc-41d1-8492-53fb1719bb67 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:54.328125 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f43c99-55cc-41d1-8492-53fb1719bb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:54.328403 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f43c99-55cc-41d1-8492-53fb1719bb67 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:54.329099 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f43c99-55cc-41d1-8492-53fb1719bb67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:54.331129 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f43c99-55cc-41d1-8492-53fb1719bb67 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:54.357764 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1039/2066] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:05:54 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:54.362347 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a43666-b3d9-4631-ad78-194dc27e3ad2 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:54.374192 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a43666-b3d9-4631-ad78-194dc27e3ad2 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:54.379145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb70c7-98c3-4d6e-8c05-e64966a6b7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:54.379723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb70c7-98c3-4d6e-8c05-e64966a6b7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:54.380005 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb70c7-98c3-4d6e-8c05-e64966a6b7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:54.380275 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb70c7-98c3-4d6e-8c05-e64966a6b7e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:54.380980 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb70c7-98c3-4d6e-8c05-e64966a6b7e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:54.382753 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb70c7-98c3-4d6e-8c05-e64966a6b7e6 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:54.393753 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1028/2067] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:05:54.398459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f43c99-55cc-41d1-8492-53fb1719bb67 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:54.409016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f43c99-55cc-41d1-8492-53fb1719bb67 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:54.414910 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c730ed5-10be-4702-81f8-4c1c7120f774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:54.415540 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c730ed5-10be-4702-81f8-4c1c7120f774 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:54.415863 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c730ed5-10be-4702-81f8-4c1c7120f774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:54.416141 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c730ed5-10be-4702-81f8-4c1c7120f774 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:54.416859 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c730ed5-10be-4702-81f8-4c1c7120f774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:54.418513 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c730ed5-10be-4702-81f8-4c1c7120f774 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:54.433309 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1040/2068] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:54.434567 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb70c7-98c3-4d6e-8c05-e64966a6b7e6 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:54.444837 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb70c7-98c3-4d6e-8c05-e64966a6b7e6 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:54.449506 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ad15f-3bc8-45a8-9b79-39b7e79d030c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:54.450179 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ad15f-3bc8-45a8-9b79-39b7e79d030c admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:54.450490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ad15f-3bc8-45a8-9b79-39b7e79d030c admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:54.450767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ad15f-3bc8-45a8-9b79-39b7e79d030c admin admin] PATH_INFO: `/v3/projects/e66f010e4550411bacd0661b282af6f3/users/edb81e44e15b4661a990d244b8d0f733/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:54.471742 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ad15f-3bc8-45a8-9b79-39b7e79d030c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e66f010e4550411bacd0661b282af6f3, user_id=edb81e44e15b4661a990d244b8d0f733, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:54.476283 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ad15f-3bc8-45a8-9b79-39b7e79d030c admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:54.492124 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1029/2069] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:54 2022] PUT /identity/v3/projects/e66f010e4550411bacd0661b282af6f3/users/edb81e44e15b4661a990d244b8d0f733/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:54.502772 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67ef66-be99-4cf2-8d3b-906e9936ddb7 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:54.503092 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67ef66-be99-4cf2-8d3b-906e9936ddb7 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:54.503372 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67ef66-be99-4cf2-8d3b-906e9936ddb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:54.534453 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-0b67ef66-be99-4cf2-8d3b-906e9936ddb7 None None] MFA Rules not processed for user `edb81e44e15b4661a990d244b8d0f733`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:54.535684 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-0b67ef66-be99-4cf2-8d3b-906e9936ddb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:54.606978 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:54.628184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1041/2070] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:54.639906 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ad15f-3bc8-45a8-9b79-39b7e79d030c admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:54.641856 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-7c2ad15f-3bc8-45a8-9b79-39b7e79d030c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:54.681212 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:54.711663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ad15f-3bc8-45a8-9b79-39b7e79d030c admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:54.716541 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2612404-a571-4956-a319-ac21d90c102e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:54.717177 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2612404-a571-4956-a319-ac21d90c102e service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:54.717460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2612404-a571-4956-a319-ac21d90c102e service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:54.717737 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2612404-a571-4956-a319-ac21d90c102e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:54.729009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2612404-a571-4956-a319-ac21d90c102e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:54.730528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2612404-a571-4956-a319-ac21d90c102e service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:54.743758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1030/2071] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:05:56.251063 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281b812-67de-4298-b39c-f1c06b0c07a9 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:56.251907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281b812-67de-4298-b39c-f1c06b0c07a9 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:56.251907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281b812-67de-4298-b39c-f1c06b0c07a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:56.273891 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-8281b812-67de-4298-b39c-f1c06b0c07a9 None None] MFA Rules not processed for user `edb81e44e15b4661a990d244b8d0f733`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:56.275232 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-8281b812-67de-4298-b39c-f1c06b0c07a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:56.286522 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1042/2072] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:57.293358 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2612404-a571-4956-a319-ac21d90c102e service cinder] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:57.296643 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-c2612404-a571-4956-a319-ac21d90c102e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:57.433216 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2612404-a571-4956-a319-ac21d90c102e service cinder] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:57.445570 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c5715-6e5c-4298-a892-6e67d33380c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:57.446907 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c5715-6e5c-4298-a892-6e67d33380c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:57.447516 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c5715-6e5c-4298-a892-6e67d33380c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:57.447952 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c5715-6e5c-4298-a892-6e67d33380c7 admin admin] PATH_INFO: `/v3/users/78116abe231f4e8fa7f62e8764fb5857` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:57.449683 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c5715-6e5c-4298-a892-6e67d33380c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78116abe231f4e8fa7f62e8764fb5857)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:57.452513 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c5715-6e5c-4298-a892-6e67d33380c7 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:57.505589 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-6f4c5715-6e5c-4298-a892-6e67d33380c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78116abe231f4e8fa7f62e8764fb5857'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:57.506229 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-6f4c5715-6e5c-4298-a892-6e67d33380c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78116abe231f4e8fa7f62e8764fb5857'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:57.506953 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-6f4c5715-6e5c-4298-a892-6e67d33380c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78116abe231f4e8fa7f62e8764fb5857'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:57.516152 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-6f4c5715-6e5c-4298-a892-6e67d33380c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78116abe231f4e8fa7f62e8764fb5857'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:57.529555 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-6f4c5715-6e5c-4298-a892-6e67d33380c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78116abe231f4e8fa7f62e8764fb5857'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:57.545637 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1031/2073] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:05:57 2022] DELETE /identity/v3/users/78116abe231f4e8fa7f62e8764fb5857 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:57.760517 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281b812-67de-4298-b39c-f1c06b0c07a9 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:57.783881 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281b812-67de-4298-b39c-f1c06b0c07a9 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:57.868578 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fdd124-df4a-4a52-addd-be7881def24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:57.869227 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fdd124-df4a-4a52-addd-be7881def24d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:57.869529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fdd124-df4a-4a52-addd-be7881def24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:57.869882 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fdd124-df4a-4a52-addd-be7881def24d admin admin] PATH_INFO: `/v3/projects/d06dfb97c48740cfbc2f4bedc4e0bac0` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:57.871205 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fdd124-df4a-4a52-addd-be7881def24d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d06dfb97c48740cfbc2f4bedc4e0bac0)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:57.873061 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fdd124-df4a-4a52-addd-be7881def24d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:57.940176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-97fdd124-df4a-4a52-addd-be7881def24d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd06dfb97c48740cfbc2f4bedc4e0bac0', 'request_id': 'req-97fdd124-df4a-4a52-addd-be7881def24d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:57.948304 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-97fdd124-df4a-4a52-addd-be7881def24d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd06dfb97c48740cfbc2f4bedc4e0bac0', 'request_id': 'req-97fdd124-df4a-4a52-addd-be7881def24d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:57.955167 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-97fdd124-df4a-4a52-addd-be7881def24d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd06dfb97c48740cfbc2f4bedc4e0bac0', 'request_id': 'req-97fdd124-df4a-4a52-addd-be7881def24d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:57.969653 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-97fdd124-df4a-4a52-addd-be7881def24d admin admin] The token cache is being invalidate because project d06dfb97c48740cfbc2f4bedc4e0bac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:05:57.969943 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-97fdd124-df4a-4a52-addd-be7881def24d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:57.971149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-97fdd124-df4a-4a52-addd-be7881def24d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:05:57.972328 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1043/2074] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:05:57 2022] DELETE /identity/v3/projects/d06dfb97c48740cfbc2f4bedc4e0bac0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:05:57.978146 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d52fc1-c773-4a7f-93d9-507c1ea7508e None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:57.978462 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d52fc1-c773-4a7f-93d9-507c1ea7508e None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:57.978743 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d52fc1-c773-4a7f-93d9-507c1ea7508e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:58.006774 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-07d52fc1-c773-4a7f-93d9-507c1ea7508e None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:58.008551 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-07d52fc1-c773-4a7f-93d9-507c1ea7508e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:58.060513 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:58.074250 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1032/2075] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:58.082402 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9599d8-1d62-40fe-ae04-48f5e8819b26 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:58.082802 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9599d8-1d62-40fe-ae04-48f5e8819b26 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:58.083084 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9599d8-1d62-40fe-ae04-48f5e8819b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:58.103757 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-bf9599d8-1d62-40fe-ae04-48f5e8819b26 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:58.104957 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-bf9599d8-1d62-40fe-ae04-48f5e8819b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:58.112943 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1044/2076] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:58.118018 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d52fc1-c773-4a7f-93d9-507c1ea7508e None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:58.128064 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d52fc1-c773-4a7f-93d9-507c1ea7508e None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:58.133360 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dab6d7-54c8-42f2-8641-cca7177e234c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:58.133976 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dab6d7-54c8-42f2-8641-cca7177e234c admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:58.134256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dab6d7-54c8-42f2-8641-cca7177e234c admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:58.134542 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dab6d7-54c8-42f2-8641-cca7177e234c admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:58.135232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dab6d7-54c8-42f2-8641-cca7177e234c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:05:58.136146 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dab6d7-54c8-42f2-8641-cca7177e234c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:58.137170 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dab6d7-54c8-42f2-8641-cca7177e234c admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:58.150770 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1033/2077] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:05:58.155279 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9599d8-1d62-40fe-ae04-48f5e8819b26 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:58.165184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9599d8-1d62-40fe-ae04-48f5e8819b26 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:58.169879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065664a1-b19d-47be-a37c-2a082d382409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:58.170521 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065664a1-b19d-47be-a37c-2a082d382409 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:58.170891 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065664a1-b19d-47be-a37c-2a082d382409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:58.171068 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065664a1-b19d-47be-a37c-2a082d382409 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:58.171727 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065664a1-b19d-47be-a37c-2a082d382409 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:58.173620 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065664a1-b19d-47be-a37c-2a082d382409 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:58.208422 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1045/2078] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:05:58 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:05:58.209776 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dab6d7-54c8-42f2-8641-cca7177e234c admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:58.220280 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dab6d7-54c8-42f2-8641-cca7177e234c admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:58.278183 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf124f6-a387-4b1f-909e-b7fb542b91be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:58.278834 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf124f6-a387-4b1f-909e-b7fb542b91be admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:58.279116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf124f6-a387-4b1f-909e-b7fb542b91be admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:58.279390 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf124f6-a387-4b1f-909e-b7fb542b91be admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:58.280061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf124f6-a387-4b1f-909e-b7fb542b91be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:58.281990 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf124f6-a387-4b1f-909e-b7fb542b91be admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:58.304501 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1034/2079] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:05:58 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:05:58.308747 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065664a1-b19d-47be-a37c-2a082d382409 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:58.319361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065664a1-b19d-47be-a37c-2a082d382409 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:58.327263 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ccf3f-3ed9-4577-bc08-ee27e8aacaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:58.328241 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ccf3f-3ed9-4577-bc08-ee27e8aacaa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:58.328708 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ccf3f-3ed9-4577-bc08-ee27e8aacaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:58.329171 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ccf3f-3ed9-4577-bc08-ee27e8aacaa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:58.330394 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ccf3f-3ed9-4577-bc08-ee27e8aacaa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:58.333493 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ccf3f-3ed9-4577-bc08-ee27e8aacaa6 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:58.346506 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1046/2080] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:58.351042 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf124f6-a387-4b1f-909e-b7fb542b91be admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:58.362213 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf124f6-a387-4b1f-909e-b7fb542b91be admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:58.367003 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006d5bd-2d54-4c2f-89b2-d8c78bed2905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:58.367829 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006d5bd-2d54-4c2f-89b2-d8c78bed2905 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:58.368109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006d5bd-2d54-4c2f-89b2-d8c78bed2905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:58.368383 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006d5bd-2d54-4c2f-89b2-d8c78bed2905 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:58.369085 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006d5bd-2d54-4c2f-89b2-d8c78bed2905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:58.370742 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006d5bd-2d54-4c2f-89b2-d8c78bed2905 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:58.382981 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1035/2081] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:05:58.387543 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ccf3f-3ed9-4577-bc08-ee27e8aacaa6 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:58.399752 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ccf3f-3ed9-4577-bc08-ee27e8aacaa6 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:58.405716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8ae3f-0691-407b-9c01-9d78a7185d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:58.406502 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8ae3f-0691-407b-9c01-9d78a7185d10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:58.406849 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8ae3f-0691-407b-9c01-9d78a7185d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:58.407192 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8ae3f-0691-407b-9c01-9d78a7185d10 admin admin] PATH_INFO: `/v3/projects/e0980749008b4e9683bc5f868e58a7ab/users/a0a1057ce3e84f04911ed2af3a3d1218/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:58.427235 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8ae3f-0691-407b-9c01-9d78a7185d10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0980749008b4e9683bc5f868e58a7ab, user_id=a0a1057ce3e84f04911ed2af3a3d1218, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:58.432013 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8ae3f-0691-407b-9c01-9d78a7185d10 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:58.448975 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1047/2082] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:05:58 2022] PUT /identity/v3/projects/e0980749008b4e9683bc5f868e58a7ab/users/a0a1057ce3e84f04911ed2af3a3d1218/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:05:58.459827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c397b-7b9a-4941-9dc5-939c4da52b99 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:58.460828 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c397b-7b9a-4941-9dc5-939c4da52b99 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:58.461309 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c397b-7b9a-4941-9dc5-939c4da52b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:58.502503 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-505c397b-7b9a-4941-9dc5-939c4da52b99 None None] MFA Rules not processed for user `a0a1057ce3e84f04911ed2af3a3d1218`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:05:58.502503 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-505c397b-7b9a-4941-9dc5-939c4da52b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:58.581746 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1036/2083] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:05:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:05:58.592794 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8ae3f-0691-407b-9c01-9d78a7185d10 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:05:58.594882 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4ce8ae3f-0691-407b-9c01-9d78a7185d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:05:58.608675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:05:58.693132 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8ae3f-0691-407b-9c01-9d78a7185d10 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:05:58.699837 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954367c-8295-48c9-94d1-dac5815d6131 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:05:58.700480 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954367c-8295-48c9-94d1-dac5815d6131 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:05:58.700767 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954367c-8295-48c9-94d1-dac5815d6131 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:05:58.701045 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954367c-8295-48c9-94d1-dac5815d6131 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:05:58.710650 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954367c-8295-48c9-94d1-dac5815d6131 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:05:58.712275 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954367c-8295-48c9-94d1-dac5815d6131 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:05:58.721888 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1048/2084] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:05:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:06:04.221890 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c397b-7b9a-4941-9dc5-939c4da52b99 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:04.274582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:04.287440 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c397b-7b9a-4941-9dc5-939c4da52b99 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:04.293398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2c162-8bde-42b8-984e-3be1a5352b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:04.294043 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2c162-8bde-42b8-984e-3be1a5352b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:04.294403 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2c162-8bde-42b8-984e-3be1a5352b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:04.294627 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2c162-8bde-42b8-984e-3be1a5352b28 admin admin] PATH_INFO: `/v3/users/a0a1057ce3e84f04911ed2af3a3d1218` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:04.295808 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2c162-8bde-42b8-984e-3be1a5352b28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0a1057ce3e84f04911ed2af3a3d1218)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:04.297740 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2c162-8bde-42b8-984e-3be1a5352b28 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:04.360628 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-bcd2c162-8bde-42b8-984e-3be1a5352b28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0a1057ce3e84f04911ed2af3a3d1218'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:04.361891 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-bcd2c162-8bde-42b8-984e-3be1a5352b28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0a1057ce3e84f04911ed2af3a3d1218'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:04.362643 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-bcd2c162-8bde-42b8-984e-3be1a5352b28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0a1057ce3e84f04911ed2af3a3d1218'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:04.373297 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-bcd2c162-8bde-42b8-984e-3be1a5352b28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0a1057ce3e84f04911ed2af3a3d1218'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:04.389697 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-bcd2c162-8bde-42b8-984e-3be1a5352b28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0a1057ce3e84f04911ed2af3a3d1218'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:04.406429 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1037/2085] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:06:04 2022] DELETE /identity/v3/users/a0a1057ce3e84f04911ed2af3a3d1218 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:04.409362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31784879-a79f-4601-954d-78f5d5f529ac None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:04.409847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31784879-a79f-4601-954d-78f5d5f529ac None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:04.410119 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31784879-a79f-4601-954d-78f5d5f529ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:04.435734 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-31784879-a79f-4601-954d-78f5d5f529ac None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:04.437061 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-31784879-a79f-4601-954d-78f5d5f529ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:04.509774 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1049/2086] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:04.519747 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2c162-8bde-42b8-984e-3be1a5352b28 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:04.521338 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-bcd2c162-8bde-42b8-984e-3be1a5352b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:04.588347 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2c162-8bde-42b8-984e-3be1a5352b28 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:04.592354 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9878c-be1d-4e80-8a23-367cfe61068c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:04.592782 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9878c-be1d-4e80-8a23-367cfe61068c service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:04.593060 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9878c-be1d-4e80-8a23-367cfe61068c service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:04.593330 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9878c-be1d-4e80-8a23-367cfe61068c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:04.603982 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9878c-be1d-4e80-8a23-367cfe61068c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:04.605650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9878c-be1d-4e80-8a23-367cfe61068c service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:04.617460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1038/2087] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:06:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:06:04.940514 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31784879-a79f-4601-954d-78f5d5f529ac None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:04.942289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-31784879-a79f-4601-954d-78f5d5f529ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:04.966168 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31784879-a79f-4601-954d-78f5d5f529ac None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:04.971462 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75ac3c-d9e5-40c8-be56-9ff90b4ed0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:04.972349 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75ac3c-d9e5-40c8-be56-9ff90b4ed0c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:04.972702 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75ac3c-d9e5-40c8-be56-9ff90b4ed0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:04.973049 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75ac3c-d9e5-40c8-be56-9ff90b4ed0c6 admin admin] PATH_INFO: `/v3/projects/e0980749008b4e9683bc5f868e58a7ab` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:04.975121 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75ac3c-d9e5-40c8-be56-9ff90b4ed0c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0980749008b4e9683bc5f868e58a7ab)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:04.977313 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75ac3c-d9e5-40c8-be56-9ff90b4ed0c6 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:05.049932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4d75ac3c-d9e5-40c8-be56-9ff90b4ed0c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0980749008b4e9683bc5f868e58a7ab', 'request_id': 'req-4d75ac3c-d9e5-40c8-be56-9ff90b4ed0c6'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:05.057921 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4d75ac3c-d9e5-40c8-be56-9ff90b4ed0c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0980749008b4e9683bc5f868e58a7ab', 'request_id': 'req-4d75ac3c-d9e5-40c8-be56-9ff90b4ed0c6'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:05.064277 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4d75ac3c-d9e5-40c8-be56-9ff90b4ed0c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0980749008b4e9683bc5f868e58a7ab', 'request_id': 'req-4d75ac3c-d9e5-40c8-be56-9ff90b4ed0c6'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:05.079382 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4d75ac3c-d9e5-40c8-be56-9ff90b4ed0c6 admin admin] The token cache is being invalidate because project e0980749008b4e9683bc5f868e58a7ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:06:05.079706 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4d75ac3c-d9e5-40c8-be56-9ff90b4ed0c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:05.080463 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4d75ac3c-d9e5-40c8-be56-9ff90b4ed0c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:05.082191 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1050/2088] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:06:04 2022] DELETE /identity/v3/projects/e0980749008b4e9683bc5f868e58a7ab => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:05.088124 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bcd3a-ae2f-4339-a39e-c7519e07fa81 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:05.088482 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bcd3a-ae2f-4339-a39e-c7519e07fa81 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:05.089295 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bcd3a-ae2f-4339-a39e-c7519e07fa81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:05.111785 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-127bcd3a-ae2f-4339-a39e-c7519e07fa81 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:05.119887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-127bcd3a-ae2f-4339-a39e-c7519e07fa81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:05.198145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1039/2089] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:05.207907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1d71c-4bb8-477d-bade-b0b5e557bac3 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:05.208217 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1d71c-4bb8-477d-bade-b0b5e557bac3 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:05.208505 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1d71c-4bb8-477d-bade-b0b5e557bac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:05.228972 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-e5b1d71c-4bb8-477d-bade-b0b5e557bac3 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:05.230207 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e5b1d71c-4bb8-477d-bade-b0b5e557bac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:05.238254 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1051/2090] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:05.243610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127bcd3a-ae2f-4339-a39e-c7519e07fa81 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:05.253985 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127bcd3a-ae2f-4339-a39e-c7519e07fa81 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:05.258689 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b884c-fb3e-40fc-aa5e-c0b92bb9ea40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:05.259312 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b884c-fb3e-40fc-aa5e-c0b92bb9ea40 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:05.259595 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b884c-fb3e-40fc-aa5e-c0b92bb9ea40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:05.259872 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b884c-fb3e-40fc-aa5e-c0b92bb9ea40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:05.260577 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b884c-fb3e-40fc-aa5e-c0b92bb9ea40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:06:05.260897 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b884c-fb3e-40fc-aa5e-c0b92bb9ea40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:05.262527 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b884c-fb3e-40fc-aa5e-c0b92bb9ea40 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:05.272035 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:05.275944 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1040/2091] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:06:05.280649 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b1d71c-4bb8-477d-bade-b0b5e557bac3 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:05.291345 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b1d71c-4bb8-477d-bade-b0b5e557bac3 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:05.296025 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548ae87-fe46-4708-b505-74df50ff8c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:05.296644 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548ae87-fe46-4708-b505-74df50ff8c4c admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:05.296934 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548ae87-fe46-4708-b505-74df50ff8c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:05.297200 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548ae87-fe46-4708-b505-74df50ff8c4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:05.297901 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548ae87-fe46-4708-b505-74df50ff8c4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:05.299853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548ae87-fe46-4708-b505-74df50ff8c4c admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:05.310544 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:05.330566 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1052/2092] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:06:05 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:06:05.335555 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b884c-fb3e-40fc-aa5e-c0b92bb9ea40 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:05.346483 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b884c-fb3e-40fc-aa5e-c0b92bb9ea40 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:05.404426 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c19a12-0062-4aca-a349-a5d32210241a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:05.405048 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c19a12-0062-4aca-a349-a5d32210241a admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:05.405329 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c19a12-0062-4aca-a349-a5d32210241a admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:05.405606 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c19a12-0062-4aca-a349-a5d32210241a admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:05.406281 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c19a12-0062-4aca-a349-a5d32210241a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:05.408237 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c19a12-0062-4aca-a349-a5d32210241a admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:05.430888 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1041/2093] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:06:05 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:06:05.435045 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548ae87-fe46-4708-b505-74df50ff8c4c admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:05.445905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548ae87-fe46-4708-b505-74df50ff8c4c admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:05.450931 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4bbb4-6f5b-45d4-9655-1beba0f93f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:05.451550 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4bbb4-6f5b-45d4-9655-1beba0f93f38 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:05.451831 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4bbb4-6f5b-45d4-9655-1beba0f93f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:05.452113 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4bbb4-6f5b-45d4-9655-1beba0f93f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:05.452805 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4bbb4-6f5b-45d4-9655-1beba0f93f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:05.454440 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4bbb4-6f5b-45d4-9655-1beba0f93f38 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:05.465737 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1053/2094] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:06:05.469780 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c19a12-0062-4aca-a349-a5d32210241a admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:05.480235 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c19a12-0062-4aca-a349-a5d32210241a admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:05.484774 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b09335-a36c-4cd1-bfcf-5f04b0b8726c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:05.485389 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b09335-a36c-4cd1-bfcf-5f04b0b8726c admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:05.485666 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b09335-a36c-4cd1-bfcf-5f04b0b8726c admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:05.485939 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b09335-a36c-4cd1-bfcf-5f04b0b8726c admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:05.486676 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b09335-a36c-4cd1-bfcf-5f04b0b8726c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:05.488273 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b09335-a36c-4cd1-bfcf-5f04b0b8726c admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:05.501323 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1042/2095] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:06:05.505319 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4bbb4-6f5b-45d4-9655-1beba0f93f38 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:05.515919 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4bbb4-6f5b-45d4-9655-1beba0f93f38 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:05.520730 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2cc09-01d1-48bd-96d2-2d1fe73695fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:05.521412 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2cc09-01d1-48bd-96d2-2d1fe73695fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:05.521692 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2cc09-01d1-48bd-96d2-2d1fe73695fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:05.521980 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2cc09-01d1-48bd-96d2-2d1fe73695fd admin admin] PATH_INFO: `/v3/projects/92bde633089848f285bdb24b52bfcb2e/users/f9409e14513e41d888fd9310198555f7/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:05.538736 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2cc09-01d1-48bd-96d2-2d1fe73695fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=92bde633089848f285bdb24b52bfcb2e, user_id=f9409e14513e41d888fd9310198555f7, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:05.541605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2cc09-01d1-48bd-96d2-2d1fe73695fd admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:05.556994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1054/2096] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:06:05 2022] PUT /identity/v3/projects/92bde633089848f285bdb24b52bfcb2e/users/f9409e14513e41d888fd9310198555f7/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:05.568243 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a778a-16b3-4d41-b8ba-79db2e70e817 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:05.568243 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a778a-16b3-4d41-b8ba-79db2e70e817 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:05.569638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a778a-16b3-4d41-b8ba-79db2e70e817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:05.601626 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-e58a778a-16b3-4d41-b8ba-79db2e70e817 None None] MFA Rules not processed for user `f9409e14513e41d888fd9310198555f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:05.602812 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-e58a778a-16b3-4d41-b8ba-79db2e70e817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:05.690896 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1043/2097] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:05.710981 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2cc09-01d1-48bd-96d2-2d1fe73695fd admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:05.713335 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e3c2cc09-01d1-48bd-96d2-2d1fe73695fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:05.802040 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2cc09-01d1-48bd-96d2-2d1fe73695fd admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:05.808631 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5593e4-b6c2-4ed4-86e9-aad6346ed038 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:05.809284 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5593e4-b6c2-4ed4-86e9-aad6346ed038 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:05.809565 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5593e4-b6c2-4ed4-86e9-aad6346ed038 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:05.809839 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5593e4-b6c2-4ed4-86e9-aad6346ed038 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:05.819023 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5593e4-b6c2-4ed4-86e9-aad6346ed038 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:05.821193 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5593e4-b6c2-4ed4-86e9-aad6346ed038 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:05.831283 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1055/2098] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:06:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:06:08.636281 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a778a-16b3-4d41-b8ba-79db2e70e817 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:08.724341 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a778a-16b3-4d41-b8ba-79db2e70e817 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:08.729888 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c6f08-27a6-4633-9e4c-5519058ea059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:08.730624 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c6f08-27a6-4633-9e4c-5519058ea059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:08.730908 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c6f08-27a6-4633-9e4c-5519058ea059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:08.731194 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c6f08-27a6-4633-9e4c-5519058ea059 admin admin] PATH_INFO: `/v3/users/f9409e14513e41d888fd9310198555f7` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:08.732474 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c6f08-27a6-4633-9e4c-5519058ea059 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9409e14513e41d888fd9310198555f7)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:08.734529 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c6f08-27a6-4633-9e4c-5519058ea059 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:08.749301 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:08.786694 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-3a6c6f08-27a6-4633-9e4c-5519058ea059 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9409e14513e41d888fd9310198555f7'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:08.787269 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-3a6c6f08-27a6-4633-9e4c-5519058ea059 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9409e14513e41d888fd9310198555f7'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:08.787883 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-3a6c6f08-27a6-4633-9e4c-5519058ea059 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9409e14513e41d888fd9310198555f7'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:08.795904 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-3a6c6f08-27a6-4633-9e4c-5519058ea059 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9409e14513e41d888fd9310198555f7'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:08.808169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-3a6c6f08-27a6-4633-9e4c-5519058ea059 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9409e14513e41d888fd9310198555f7'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:08.821444 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1044/2099] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:06:08 2022] DELETE /identity/v3/users/f9409e14513e41d888fd9310198555f7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:08.826137 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb11ea-bd51-408d-addc-54178eb9a4b4 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:08.826645 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb11ea-bd51-408d-addc-54178eb9a4b4 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:08.826769 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb11ea-bd51-408d-addc-54178eb9a4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:08.846651 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-79bb11ea-bd51-408d-addc-54178eb9a4b4 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:08.847889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-79bb11ea-bd51-408d-addc-54178eb9a4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:08.912024 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1056/2100] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:08.922508 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c6f08-27a6-4633-9e4c-5519058ea059 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:08.924006 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-3a6c6f08-27a6-4633-9e4c-5519058ea059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:08.987289 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c6f08-27a6-4633-9e4c-5519058ea059 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:08.990987 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ecd42-8787-4421-bb83-880931cf32ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:08.992257 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ecd42-8787-4421-bb83-880931cf32ea service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:08.992695 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ecd42-8787-4421-bb83-880931cf32ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:08.992984 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ecd42-8787-4421-bb83-880931cf32ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:09.002685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ecd42-8787-4421-bb83-880931cf32ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:09.004132 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ecd42-8787-4421-bb83-880931cf32ea service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:09.014302 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1045/2101] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:06:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:06:09.296898 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb11ea-bd51-408d-addc-54178eb9a4b4 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:09.298561 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-79bb11ea-bd51-408d-addc-54178eb9a4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:09.314646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb11ea-bd51-408d-addc-54178eb9a4b4 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:09.320792 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955c718-4506-4fff-b8f9-ec44c5725fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:09.321456 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955c718-4506-4fff-b8f9-ec44c5725fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:09.321774 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955c718-4506-4fff-b8f9-ec44c5725fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:09.322084 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955c718-4506-4fff-b8f9-ec44c5725fca admin admin] PATH_INFO: `/v3/projects/92bde633089848f285bdb24b52bfcb2e` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:09.323365 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955c718-4506-4fff-b8f9-ec44c5725fca admin admin] RBAC: Authorizing `identity:delete_project(project_id=92bde633089848f285bdb24b52bfcb2e)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:09.325279 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955c718-4506-4fff-b8f9-ec44c5725fca admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:09.364530 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:09.377286 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3955c718-4506-4fff-b8f9-ec44c5725fca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92bde633089848f285bdb24b52bfcb2e', 'request_id': 'req-3955c718-4506-4fff-b8f9-ec44c5725fca'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:09.384295 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3955c718-4506-4fff-b8f9-ec44c5725fca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92bde633089848f285bdb24b52bfcb2e', 'request_id': 'req-3955c718-4506-4fff-b8f9-ec44c5725fca'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:09.389847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3955c718-4506-4fff-b8f9-ec44c5725fca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92bde633089848f285bdb24b52bfcb2e', 'request_id': 'req-3955c718-4506-4fff-b8f9-ec44c5725fca'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:09.402661 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3955c718-4506-4fff-b8f9-ec44c5725fca admin admin] The token cache is being invalidate because project 92bde633089848f285bdb24b52bfcb2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:06:09.402952 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3955c718-4506-4fff-b8f9-ec44c5725fca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:09.403577 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3955c718-4506-4fff-b8f9-ec44c5725fca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:09.405093 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1057/2102] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:06:09 2022] DELETE /identity/v3/projects/92bde633089848f285bdb24b52bfcb2e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:09.409969 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0fe39-56b1-42ae-81fc-27da24526892 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:09.410257 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0fe39-56b1-42ae-81fc-27da24526892 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:09.410558 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0fe39-56b1-42ae-81fc-27da24526892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:09.430194 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-7fa0fe39-56b1-42ae-81fc-27da24526892 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:09.431444 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-7fa0fe39-56b1-42ae-81fc-27da24526892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:09.494589 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1046/2103] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:09.502464 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fce44-4d1f-497f-83ff-2d67f015544f None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:09.502754 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fce44-4d1f-497f-83ff-2d67f015544f None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:09.503032 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fce44-4d1f-497f-83ff-2d67f015544f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:09.523389 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-483fce44-4d1f-497f-83ff-2d67f015544f None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:09.524612 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-483fce44-4d1f-497f-83ff-2d67f015544f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:09.532665 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1058/2104] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:09.537030 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0fe39-56b1-42ae-81fc-27da24526892 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:09.547118 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0fe39-56b1-42ae-81fc-27da24526892 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:09.551722 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc73560-7e90-4d5a-8182-d0f4ef1832a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:09.552329 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc73560-7e90-4d5a-8182-d0f4ef1832a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:09.552608 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc73560-7e90-4d5a-8182-d0f4ef1832a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:09.552885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc73560-7e90-4d5a-8182-d0f4ef1832a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:09.553578 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc73560-7e90-4d5a-8182-d0f4ef1832a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:06:09.553878 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc73560-7e90-4d5a-8182-d0f4ef1832a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:09.556276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc73560-7e90-4d5a-8182-d0f4ef1832a9 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:09.568183 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1047/2105] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:06:09.573439 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fce44-4d1f-497f-83ff-2d67f015544f None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:09.583561 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fce44-4d1f-497f-83ff-2d67f015544f None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:09.588259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558617c4-cc03-487b-99ea-4023f708abd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:09.588867 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558617c4-cc03-487b-99ea-4023f708abd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:09.589142 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558617c4-cc03-487b-99ea-4023f708abd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:09.589410 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558617c4-cc03-487b-99ea-4023f708abd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:09.590084 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558617c4-cc03-487b-99ea-4023f708abd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:09.592017 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558617c4-cc03-487b-99ea-4023f708abd8 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:09.622424 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1059/2106] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:06:09 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:06:09.626235 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc73560-7e90-4d5a-8182-d0f4ef1832a9 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:09.636848 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc73560-7e90-4d5a-8182-d0f4ef1832a9 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:09.649244 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:09.696521 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d7ed4-dff6-429c-8bb7-e3d555aa7e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:09.697472 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d7ed4-dff6-429c-8bb7-e3d555aa7e13 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:09.697472 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d7ed4-dff6-429c-8bb7-e3d555aa7e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:09.697685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d7ed4-dff6-429c-8bb7-e3d555aa7e13 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:09.698344 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d7ed4-dff6-429c-8bb7-e3d555aa7e13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:09.700365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d7ed4-dff6-429c-8bb7-e3d555aa7e13 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:09.737724 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1048/2107] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:06:09 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:06:09.742294 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558617c4-cc03-487b-99ea-4023f708abd8 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:09.751900 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d7ed4-dff6-429c-8bb7-e3d555aa7e13 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:09.754148 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-671d7ed4-dff6-429c-8bb7-e3d555aa7e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:09.757354 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558617c4-cc03-487b-99ea-4023f708abd8 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:09.762221 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813fb5b-7c61-4ba2-8769-ca3cb3047ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:09.762888 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813fb5b-7c61-4ba2-8769-ca3cb3047ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:09.763169 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813fb5b-7c61-4ba2-8769-ca3cb3047ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:09.763446 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813fb5b-7c61-4ba2-8769-ca3cb3047ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:09.764151 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813fb5b-7c61-4ba2-8769-ca3cb3047ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:09.765759 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813fb5b-7c61-4ba2-8769-ca3cb3047ac0 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:09.767400 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d7ed4-dff6-429c-8bb7-e3d555aa7e13 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:09.774141 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876b9e6-8c9f-4f40-aacb-fe977b6d7c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:09.774847 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876b9e6-8c9f-4f40-aacb-fe977b6d7c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:09.775300 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876b9e6-8c9f-4f40-aacb-fe977b6d7c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:09.775651 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876b9e6-8c9f-4f40-aacb-fe977b6d7c9c admin admin] PATH_INFO: `/v3/users/452bc9c8b4674c78bea3faf09da4dc95` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:09.776835 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876b9e6-8c9f-4f40-aacb-fe977b6d7c9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=452bc9c8b4674c78bea3faf09da4dc95)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:09.779175 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1060/2108] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:06:09.781965 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876b9e6-8c9f-4f40-aacb-fe977b6d7c9c admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:09.782362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813fb5b-7c61-4ba2-8769-ca3cb3047ac0 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:09.793588 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813fb5b-7c61-4ba2-8769-ca3cb3047ac0 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:09.798987 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c13d4-fe08-4ed6-950d-76be68c1ab0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:09.799686 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c13d4-fe08-4ed6-950d-76be68c1ab0b admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:09.799971 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c13d4-fe08-4ed6-950d-76be68c1ab0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:09.800263 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c13d4-fe08-4ed6-950d-76be68c1ab0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:09.801008 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c13d4-fe08-4ed6-950d-76be68c1ab0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:09.802682 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c13d4-fe08-4ed6-950d-76be68c1ab0b admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:09.818389 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1061/2109] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:06:09.823846 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c13d4-fe08-4ed6-950d-76be68c1ab0b admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:09.839953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c13d4-fe08-4ed6-950d-76be68c1ab0b admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:09.846331 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01811fff-c0ed-4a02-998f-04f1fca1062d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:09.847029 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01811fff-c0ed-4a02-998f-04f1fca1062d admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:09.847311 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01811fff-c0ed-4a02-998f-04f1fca1062d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:09.847621 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01811fff-c0ed-4a02-998f-04f1fca1062d admin admin] PATH_INFO: `/v3/projects/a16f806985ef48a683eb544eec2aaa31/users/9725e86f852243c5827e718238a83f74/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:09.870038 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-8876b9e6-8c9f-4f40-aacb-fe977b6d7c9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '452bc9c8b4674c78bea3faf09da4dc95'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:09.870962 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-8876b9e6-8c9f-4f40-aacb-fe977b6d7c9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '452bc9c8b4674c78bea3faf09da4dc95'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:09.871689 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-8876b9e6-8c9f-4f40-aacb-fe977b6d7c9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '452bc9c8b4674c78bea3faf09da4dc95'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:09.873287 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01811fff-c0ed-4a02-998f-04f1fca1062d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a16f806985ef48a683eb544eec2aaa31, user_id=9725e86f852243c5827e718238a83f74, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:09.877403 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01811fff-c0ed-4a02-998f-04f1fca1062d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:09.883666 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-8876b9e6-8c9f-4f40-aacb-fe977b6d7c9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '452bc9c8b4674c78bea3faf09da4dc95'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:09.900667 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-8876b9e6-8c9f-4f40-aacb-fe977b6d7c9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '452bc9c8b4674c78bea3faf09da4dc95'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:09.902404 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1062/2110] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:06:09 2022] PUT /identity/v3/projects/a16f806985ef48a683eb544eec2aaa31/users/9725e86f852243c5827e718238a83f74/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:09.910629 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58b4da-c478-4ebd-a0ea-325ddc7213d3 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:09.911063 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58b4da-c478-4ebd-a0ea-325ddc7213d3 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:09.911445 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58b4da-c478-4ebd-a0ea-325ddc7213d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:09.922938 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1049/2111] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:06:09 2022] DELETE /identity/v3/users/452bc9c8b4674c78bea3faf09da4dc95 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:09.927723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845fa52-cf0d-475f-9ab8-53e7178f0b38 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:09.928011 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845fa52-cf0d-475f-9ab8-53e7178f0b38 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:09.938349 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845fa52-cf0d-475f-9ab8-53e7178f0b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:09.945596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-8f58b4da-c478-4ebd-a0ea-325ddc7213d3 None None] MFA Rules not processed for user `9725e86f852243c5827e718238a83f74`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:09.947350 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-8f58b4da-c478-4ebd-a0ea-325ddc7213d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:09.950209 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-6845fa52-cf0d-475f-9ab8-53e7178f0b38 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:09.951596 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-6845fa52-cf0d-475f-9ab8-53e7178f0b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:10.021792 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1050/2112] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:06:10.026396 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1063/2113] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:10.033902 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845fa52-cf0d-475f-9ab8-53e7178f0b38 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:10.035372 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-6845fa52-cf0d-475f-9ab8-53e7178f0b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:10.038084 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58b4da-c478-4ebd-a0ea-325ddc7213d3 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:10.040155 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-8f58b4da-c478-4ebd-a0ea-325ddc7213d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:10.059935 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:10.086689 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:10.112369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845fa52-cf0d-475f-9ab8-53e7178f0b38 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:10.117726 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7f1f6-e148-4c06-a311-0c60db07bfe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:10.118831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7f1f6-e148-4c06-a311-0c60db07bfe3 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:10.119253 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7f1f6-e148-4c06-a311-0c60db07bfe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:10.119689 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7f1f6-e148-4c06-a311-0c60db07bfe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:10.129531 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58b4da-c478-4ebd-a0ea-325ddc7213d3 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:10.132885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7f1f6-e148-4c06-a311-0c60db07bfe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:10.134519 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7f1f6-e148-4c06-a311-0c60db07bfe3 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:10.135259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acacffe6-c0e8-4e38-93a9-965b275d42b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:10.135894 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacffe6-c0e8-4e38-93a9-965b275d42b5 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:10.136177 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacffe6-c0e8-4e38-93a9-965b275d42b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:10.136537 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacffe6-c0e8-4e38-93a9-965b275d42b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:10.144714 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1051/2114] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:06:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:06:10.144953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acacffe6-c0e8-4e38-93a9-965b275d42b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:10.146618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acacffe6-c0e8-4e38-93a9-965b275d42b5 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:10.157322 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1064/2115] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:06:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:06:10.405953 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7f1f6-e148-4c06-a311-0c60db07bfe3 service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:10.408804 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-99f7f1f6-e148-4c06-a311-0c60db07bfe3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:10.423040 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7f1f6-e148-4c06-a311-0c60db07bfe3 service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:10.428776 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc46de9-5106-4797-95af-b17cf41ca051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:10.430168 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc46de9-5106-4797-95af-b17cf41ca051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:10.430168 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc46de9-5106-4797-95af-b17cf41ca051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:10.430168 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc46de9-5106-4797-95af-b17cf41ca051 admin admin] PATH_INFO: `/v3/users/9725e86f852243c5827e718238a83f74` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:10.432323 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc46de9-5106-4797-95af-b17cf41ca051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9725e86f852243c5827e718238a83f74)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:10.433822 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc46de9-5106-4797-95af-b17cf41ca051 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:10.477168 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acacffe6-c0e8-4e38-93a9-965b275d42b5 service nova] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:10.479361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-acacffe6-c0e8-4e38-93a9-965b275d42b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:10.498561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-7fc46de9-5106-4797-95af-b17cf41ca051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9725e86f852243c5827e718238a83f74'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:10.500174 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-7fc46de9-5106-4797-95af-b17cf41ca051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9725e86f852243c5827e718238a83f74'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:10.501404 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-7fc46de9-5106-4797-95af-b17cf41ca051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9725e86f852243c5827e718238a83f74'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:10.507807 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acacffe6-c0e8-4e38-93a9-965b275d42b5 service nova] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:10.511953 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-7fc46de9-5106-4797-95af-b17cf41ca051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9725e86f852243c5827e718238a83f74'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:10.522304 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a898bd-da51-4c43-9260-6e95f4576364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:10.524940 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a898bd-da51-4c43-9260-6e95f4576364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:10.524940 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a898bd-da51-4c43-9260-6e95f4576364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:10.525164 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a898bd-da51-4c43-9260-6e95f4576364 admin admin] PATH_INFO: `/v3/projects/7e46d3d9aefe4f54b773a020b2312b57` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:10.527506 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a898bd-da51-4c43-9260-6e95f4576364 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e46d3d9aefe4f54b773a020b2312b57)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:10.529686 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a898bd-da51-4c43-9260-6e95f4576364 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:10.548494 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-7fc46de9-5106-4797-95af-b17cf41ca051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9725e86f852243c5827e718238a83f74'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:10.565374 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1052/2116] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:06:10 2022] DELETE /identity/v3/users/9725e86f852243c5827e718238a83f74 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:10.570976 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a899f16-cf16-4274-908c-029e1e7aab2c None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:10.571281 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a899f16-cf16-4274-908c-029e1e7aab2c None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:10.571696 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a899f16-cf16-4274-908c-029e1e7aab2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:10.592587 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-3a899f16-cf16-4274-908c-029e1e7aab2c None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:10.593792 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-3a899f16-cf16-4274-908c-029e1e7aab2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:10.606446 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e3a898bd-da51-4c43-9260-6e95f4576364 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e46d3d9aefe4f54b773a020b2312b57', 'request_id': 'req-e3a898bd-da51-4c43-9260-6e95f4576364'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:10.614048 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e3a898bd-da51-4c43-9260-6e95f4576364 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e46d3d9aefe4f54b773a020b2312b57', 'request_id': 'req-e3a898bd-da51-4c43-9260-6e95f4576364'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:10.621503 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e3a898bd-da51-4c43-9260-6e95f4576364 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e46d3d9aefe4f54b773a020b2312b57', 'request_id': 'req-e3a898bd-da51-4c43-9260-6e95f4576364'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:10.641315 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e3a898bd-da51-4c43-9260-6e95f4576364 admin admin] The token cache is being invalidate because project 7e46d3d9aefe4f54b773a020b2312b57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:06:10.641566 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e3a898bd-da51-4c43-9260-6e95f4576364 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:10.642187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e3a898bd-da51-4c43-9260-6e95f4576364 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:10.644074 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1065/2117] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:06:10 2022] DELETE /identity/v3/projects/7e46d3d9aefe4f54b773a020b2312b57 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:10.661077 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1053/2118] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:06:10.672071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a898bd-da51-4c43-9260-6e95f4576364 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:10.673676 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e3a898bd-da51-4c43-9260-6e95f4576364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:10.747979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a898bd-da51-4c43-9260-6e95f4576364 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:10.752029 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb102c35-b366-442f-bc6a-6dcfb6ab0a9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:10.752682 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb102c35-b366-442f-bc6a-6dcfb6ab0a9f service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:10.752966 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb102c35-b366-442f-bc6a-6dcfb6ab0a9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:10.753248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb102c35-b366-442f-bc6a-6dcfb6ab0a9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:10.764607 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb102c35-b366-442f-bc6a-6dcfb6ab0a9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:10.766141 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb102c35-b366-442f-bc6a-6dcfb6ab0a9f service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:10.777623 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1066/2119] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:06:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:06:11.082246 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a899f16-cf16-4274-908c-029e1e7aab2c None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:11.084225 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-3a899f16-cf16-4274-908c-029e1e7aab2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:11.099867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a899f16-cf16-4274-908c-029e1e7aab2c None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:11.107267 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4743c-b198-4623-9371-fd24dbbd7c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:11.107986 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4743c-b198-4623-9371-fd24dbbd7c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:11.108325 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4743c-b198-4623-9371-fd24dbbd7c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:11.108663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4743c-b198-4623-9371-fd24dbbd7c1a admin admin] PATH_INFO: `/v3/projects/a16f806985ef48a683eb544eec2aaa31` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:11.110095 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4743c-b198-4623-9371-fd24dbbd7c1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a16f806985ef48a683eb544eec2aaa31)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:11.112120 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4743c-b198-4623-9371-fd24dbbd7c1a admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:11.150758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:11.165831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-d4b4743c-b198-4623-9371-fd24dbbd7c1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a16f806985ef48a683eb544eec2aaa31', 'request_id': 'req-d4b4743c-b198-4623-9371-fd24dbbd7c1a'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:11.171704 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-d4b4743c-b198-4623-9371-fd24dbbd7c1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a16f806985ef48a683eb544eec2aaa31', 'request_id': 'req-d4b4743c-b198-4623-9371-fd24dbbd7c1a'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:11.179110 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-d4b4743c-b198-4623-9371-fd24dbbd7c1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a16f806985ef48a683eb544eec2aaa31', 'request_id': 'req-d4b4743c-b198-4623-9371-fd24dbbd7c1a'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:11.190623 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-d4b4743c-b198-4623-9371-fd24dbbd7c1a admin admin] The token cache is being invalidate because project a16f806985ef48a683eb544eec2aaa31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:06:11.190848 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-d4b4743c-b198-4623-9371-fd24dbbd7c1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:11.191481 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-d4b4743c-b198-4623-9371-fd24dbbd7c1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:11.193041 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1054/2120] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:06:11 2022] DELETE /identity/v3/projects/a16f806985ef48a683eb544eec2aaa31 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:11.198578 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229d9e4-0463-443c-bb3a-2014534a3d2f None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:11.199078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229d9e4-0463-443c-bb3a-2014534a3d2f None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:11.199185 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229d9e4-0463-443c-bb3a-2014534a3d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:11.220255 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-1229d9e4-0463-443c-bb3a-2014534a3d2f None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:11.221451 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1229d9e4-0463-443c-bb3a-2014534a3d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:11.266592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:11.283846 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1067/2121] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:11.291815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa680c-ae57-4bc4-a379-ddc2f1502134 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:11.292114 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa680c-ae57-4bc4-a379-ddc2f1502134 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:11.292394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa680c-ae57-4bc4-a379-ddc2f1502134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:11.312290 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-adfa680c-ae57-4bc4-a379-ddc2f1502134 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:11.313486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-adfa680c-ae57-4bc4-a379-ddc2f1502134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:11.321945 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1055/2122] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:11.326162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229d9e4-0463-443c-bb3a-2014534a3d2f None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:11.336645 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229d9e4-0463-443c-bb3a-2014534a3d2f None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:11.341281 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d456f32-404e-4bdc-87df-8808e0c135cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:11.341896 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d456f32-404e-4bdc-87df-8808e0c135cd admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:11.342180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d456f32-404e-4bdc-87df-8808e0c135cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:11.342482 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d456f32-404e-4bdc-87df-8808e0c135cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:11.343230 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d456f32-404e-4bdc-87df-8808e0c135cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:06:11.343582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d456f32-404e-4bdc-87df-8808e0c135cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:11.345361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d456f32-404e-4bdc-87df-8808e0c135cd admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:11.358730 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1068/2123] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:06:11.363123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa680c-ae57-4bc4-a379-ddc2f1502134 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:11.372500 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa680c-ae57-4bc4-a379-ddc2f1502134 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:11.377163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b5c1c-a5f8-403f-9ccf-cbd1ce5b30e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:11.377772 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b5c1c-a5f8-403f-9ccf-cbd1ce5b30e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:11.378055 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b5c1c-a5f8-403f-9ccf-cbd1ce5b30e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:11.378352 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b5c1c-a5f8-403f-9ccf-cbd1ce5b30e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:11.379072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b5c1c-a5f8-403f-9ccf-cbd1ce5b30e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:11.380986 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b5c1c-a5f8-403f-9ccf-cbd1ce5b30e3 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:11.409267 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1056/2124] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:06:11 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:06:11.413485 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d456f32-404e-4bdc-87df-8808e0c135cd admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:11.423709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d456f32-404e-4bdc-87df-8808e0c135cd admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:11.481312 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a25bd7-9e2e-4634-942a-a36c5a9bb4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:11.481935 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a25bd7-9e2e-4634-942a-a36c5a9bb4b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:11.482215 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a25bd7-9e2e-4634-942a-a36c5a9bb4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:11.482526 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a25bd7-9e2e-4634-942a-a36c5a9bb4b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:11.483199 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a25bd7-9e2e-4634-942a-a36c5a9bb4b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:11.485128 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a25bd7-9e2e-4634-942a-a36c5a9bb4b6 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:11.511269 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1069/2125] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:06:11 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:06:11.515673 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b5c1c-a5f8-403f-9ccf-cbd1ce5b30e3 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:11.526544 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b5c1c-a5f8-403f-9ccf-cbd1ce5b30e3 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:11.531334 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293b505-ffc1-4e87-825a-119abcb2faeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:11.531944 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293b505-ffc1-4e87-825a-119abcb2faeb admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:11.532227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293b505-ffc1-4e87-825a-119abcb2faeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:11.532505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293b505-ffc1-4e87-825a-119abcb2faeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:11.533206 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293b505-ffc1-4e87-825a-119abcb2faeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:11.534852 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293b505-ffc1-4e87-825a-119abcb2faeb admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:11.544921 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1057/2126] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:06:11.548982 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a25bd7-9e2e-4634-942a-a36c5a9bb4b6 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:11.559665 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a25bd7-9e2e-4634-942a-a36c5a9bb4b6 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:11.564318 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e60f8-589c-4ef7-ad4e-8a89104faafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:11.564960 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e60f8-589c-4ef7-ad4e-8a89104faafa admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:11.565239 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e60f8-589c-4ef7-ad4e-8a89104faafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:11.565513 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e60f8-589c-4ef7-ad4e-8a89104faafa admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:11.566213 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e60f8-589c-4ef7-ad4e-8a89104faafa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:11.567977 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e60f8-589c-4ef7-ad4e-8a89104faafa admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:11.580275 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1070/2127] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:06:11.584614 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293b505-ffc1-4e87-825a-119abcb2faeb admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:11.595371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293b505-ffc1-4e87-825a-119abcb2faeb admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:11.600292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4e064-001f-4ed5-ac8e-bf4e3abdcb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:11.601040 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4e064-001f-4ed5-ac8e-bf4e3abdcb0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:11.601824 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4e064-001f-4ed5-ac8e-bf4e3abdcb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:11.602086 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4e064-001f-4ed5-ac8e-bf4e3abdcb0e admin admin] PATH_INFO: `/v3/projects/0675874cb3a444249ade218641db0637/users/c951b364a0af48dfa9398fa73ac01363/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:11.617505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4e064-001f-4ed5-ac8e-bf4e3abdcb0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0675874cb3a444249ade218641db0637, user_id=c951b364a0af48dfa9398fa73ac01363, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:11.620268 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4e064-001f-4ed5-ac8e-bf4e3abdcb0e admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:11.635296 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1058/2128] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:06:11 2022] PUT /identity/v3/projects/0675874cb3a444249ade218641db0637/users/c951b364a0af48dfa9398fa73ac01363/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:11.647527 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab684a-a8da-4ab9-b7bd-f8e8012b091d None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:11.649145 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab684a-a8da-4ab9-b7bd-f8e8012b091d None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:11.649145 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab684a-a8da-4ab9-b7bd-f8e8012b091d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:11.677649 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-37ab684a-a8da-4ab9-b7bd-f8e8012b091d None None] MFA Rules not processed for user `c951b364a0af48dfa9398fa73ac01363`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:11.678908 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-37ab684a-a8da-4ab9-b7bd-f8e8012b091d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:11.752210 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1071/2129] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:11.756869 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4e064-001f-4ed5-ac8e-bf4e3abdcb0e admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:11.823857 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4e064-001f-4ed5-ac8e-bf4e3abdcb0e admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:11.828722 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237188a7-1e84-4ea1-aca0-2581299a27e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:11.829338 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237188a7-1e84-4ea1-aca0-2581299a27e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:11.829634 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237188a7-1e84-4ea1-aca0-2581299a27e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:11.829917 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237188a7-1e84-4ea1-aca0-2581299a27e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:11.830620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237188a7-1e84-4ea1-aca0-2581299a27e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:11.832542 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237188a7-1e84-4ea1-aca0-2581299a27e5 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:11.861089 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1059/2130] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:06:11 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:06:11.865530 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab684a-a8da-4ab9-b7bd-f8e8012b091d None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:11.878558 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab684a-a8da-4ab9-b7bd-f8e8012b091d None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:11.929467 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:11.946179 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f56587-c7f7-43ba-a16c-0d0091c72302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:11.946831 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f56587-c7f7-43ba-a16c-0d0091c72302 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:11.947111 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f56587-c7f7-43ba-a16c-0d0091c72302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:11.947385 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f56587-c7f7-43ba-a16c-0d0091c72302 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:11.948070 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f56587-c7f7-43ba-a16c-0d0091c72302 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:11.949995 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f56587-c7f7-43ba-a16c-0d0091c72302 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:11.973098 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1072/2131] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:06:11 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:06:11.978033 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237188a7-1e84-4ea1-aca0-2581299a27e5 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:11.988752 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237188a7-1e84-4ea1-aca0-2581299a27e5 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:11.994162 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a049f1d-5280-445c-a963-e452d73624b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:11.994908 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a049f1d-5280-445c-a963-e452d73624b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:11.995257 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a049f1d-5280-445c-a963-e452d73624b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:11.995621 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a049f1d-5280-445c-a963-e452d73624b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:11.996395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a049f1d-5280-445c-a963-e452d73624b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:11.998070 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a049f1d-5280-445c-a963-e452d73624b9 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:12.010279 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1060/2132] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:06:12.014311 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f56587-c7f7-43ba-a16c-0d0091c72302 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:12.025389 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f56587-c7f7-43ba-a16c-0d0091c72302 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:12.030303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e3545-efa6-4d53-978a-7c92aa53586f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:12.031031 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e3545-efa6-4d53-978a-7c92aa53586f admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:12.031311 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e3545-efa6-4d53-978a-7c92aa53586f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:12.031586 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e3545-efa6-4d53-978a-7c92aa53586f admin admin] PATH_INFO: `/v3/projects/7b4cc166c7364755b87a8ceba8ef4629/users/2b91d4f51b194077ab669a689f52d3c8/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:12.047391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e3545-efa6-4d53-978a-7c92aa53586f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b4cc166c7364755b87a8ceba8ef4629, user_id=2b91d4f51b194077ab669a689f52d3c8, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:12.050081 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e3545-efa6-4d53-978a-7c92aa53586f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:12.073847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1073/2133] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:06:12 2022] PUT /identity/v3/projects/7b4cc166c7364755b87a8ceba8ef4629/users/2b91d4f51b194077ab669a689f52d3c8/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:12.073978 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a049f1d-5280-445c-a963-e452d73624b9 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:12.078723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a049f1d-5280-445c-a963-e452d73624b9 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:12.107177 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:12.151393 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932c325-f549-4e43-8152-e0b4a81cc0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:12.152366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932c325-f549-4e43-8152-e0b4a81cc0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:12.152820 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932c325-f549-4e43-8152-e0b4a81cc0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:12.153279 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932c325-f549-4e43-8152-e0b4a81cc0b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:12.154400 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932c325-f549-4e43-8152-e0b4a81cc0b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:12.157267 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932c325-f549-4e43-8152-e0b4a81cc0b2 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:12.172307 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1061/2134] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:06:12.177762 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e3545-efa6-4d53-978a-7c92aa53586f admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:12.195257 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e3545-efa6-4d53-978a-7c92aa53586f admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:12.202945 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39781920-d68e-4d83-8900-dbb34b4c436f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:12.204026 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39781920-d68e-4d83-8900-dbb34b4c436f admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:12.204482 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39781920-d68e-4d83-8900-dbb34b4c436f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:12.204938 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39781920-d68e-4d83-8900-dbb34b4c436f admin admin] PATH_INFO: `/v3/projects/7b4cc166c7364755b87a8ceba8ef4629/users/2b91d4f51b194077ab669a689f52d3c8/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:12.208565 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39781920-d68e-4d83-8900-dbb34b4c436f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b4cc166c7364755b87a8ceba8ef4629, user_id=2b91d4f51b194077ab669a689f52d3c8, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:12.214155 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39781920-d68e-4d83-8900-dbb34b4c436f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:12.227169 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1074/2135] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:06:12 2022] PUT /identity/v3/projects/7b4cc166c7364755b87a8ceba8ef4629/users/2b91d4f51b194077ab669a689f52d3c8/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:12.239138 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1004b53-a38d-4b00-a21d-dee75438f9f9 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:12.239504 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1004b53-a38d-4b00-a21d-dee75438f9f9 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:12.239901 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1004b53-a38d-4b00-a21d-dee75438f9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:12.280495 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-a1004b53-a38d-4b00-a21d-dee75438f9f9 None None] MFA Rules not processed for user `2b91d4f51b194077ab669a689f52d3c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:12.282304 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-a1004b53-a38d-4b00-a21d-dee75438f9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:12.384544 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1062/2136] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:06:12.398413 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39781920-d68e-4d83-8900-dbb34b4c436f admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:12.400204 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-39781920-d68e-4d83-8900-dbb34b4c436f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:12.475743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39781920-d68e-4d83-8900-dbb34b4c436f admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:12.483325 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf17f8-c96f-4278-806f-b8c73602a9a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:12.484551 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf17f8-c96f-4278-806f-b8c73602a9a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:12.485042 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf17f8-c96f-4278-806f-b8c73602a9a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:12.485524 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf17f8-c96f-4278-806f-b8c73602a9a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:12.553758 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf17f8-c96f-4278-806f-b8c73602a9a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:12.555821 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf17f8-c96f-4278-806f-b8c73602a9a7 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:12.565969 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1075/2137] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:06:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:06:15.494157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1004b53-a38d-4b00-a21d-dee75438f9f9 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:15.505387 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1004b53-a38d-4b00-a21d-dee75438f9f9 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:15.509068 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f3215-b9bb-4955-ba12-85971dabcb26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:15.509849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f3215-b9bb-4955-ba12-85971dabcb26 service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:15.510131 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f3215-b9bb-4955-ba12-85971dabcb26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:15.510438 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f3215-b9bb-4955-ba12-85971dabcb26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:15.521007 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f3215-b9bb-4955-ba12-85971dabcb26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:15.522533 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f3215-b9bb-4955-ba12-85971dabcb26 service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:15.534577 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1063/2138] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:06:15 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:06:15.821532 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c05174-5a5a-4908-b4ed-7ff97aebad1a None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:15.824332 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c05174-5a5a-4908-b4ed-7ff97aebad1a None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:15.825088 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c05174-5a5a-4908-b4ed-7ff97aebad1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:15.860237 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-44c05174-5a5a-4908-b4ed-7ff97aebad1a None None] MFA Rules not processed for user `c607472800fc49d5a75c5e6acb33f2a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:15.861669 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-44c05174-5a5a-4908-b4ed-7ff97aebad1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:15.932662 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:15.954440 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1076/2139] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 09:06:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:16.064994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f3215-b9bb-4955-ba12-85971dabcb26 service cinder] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:16.066513 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-f59f3215-b9bb-4955-ba12-85971dabcb26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:16.226979 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f3215-b9bb-4955-ba12-85971dabcb26 service cinder] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:16.235624 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f88af-52ef-4398-943f-421672ca2b4b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158ea5c9dd5142eebd903d5f732997ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:16.236701 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f88af-52ef-4398-943f-421672ca2b4b service swift] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:16.237215 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f88af-52ef-4398-943f-421672ca2b4b service swift] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:16.237721 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f88af-52ef-4398-943f-421672ca2b4b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:16.254033 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f88af-52ef-4398-943f-421672ca2b4b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:16.257198 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f88af-52ef-4398-943f-421672ca2b4b service swift] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:16.273823 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1064/2140] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 09:06:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 09:06:16.897184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3729b1-1def-4291-9048-ad85a117bb10 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:16.897811 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3729b1-1def-4291-9048-ad85a117bb10 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:16.897811 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3729b1-1def-4291-9048-ad85a117bb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:16.918789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-9c3729b1-1def-4291-9048-ad85a117bb10 None None] MFA Rules not processed for user `c607472800fc49d5a75c5e6acb33f2a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:16.920007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9c3729b1-1def-4291-9048-ad85a117bb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:16.927263 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1077/2141] 10.222.0.65 () {58 vars in 967 bytes} [Wed Jul 27 09:06:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:16.944109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f88af-52ef-4398-943f-421672ca2b4b service swift] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:16.957235 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f88af-52ef-4398-943f-421672ca2b4b service swift] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:16.963126 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf42441-c576-46f1-ac60-4bffc103b541 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158ea5c9dd5142eebd903d5f732997ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:16.963745 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf42441-c576-46f1-ac60-4bffc103b541 service swift] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:16.964021 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf42441-c576-46f1-ac60-4bffc103b541 service swift] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:16.964290 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf42441-c576-46f1-ac60-4bffc103b541 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:16.973395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf42441-c576-46f1-ac60-4bffc103b541 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:16.975015 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf42441-c576-46f1-ac60-4bffc103b541 service swift] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:16.984851 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1065/2142] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 09:06:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 09:06:17.275243 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658630b-5806-4d75-9675-d76c1a029eb2 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:17.275584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658630b-5806-4d75-9675-d76c1a029eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:17.275907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658630b-5806-4d75-9675-d76c1a029eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:17.310174 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-2658630b-5806-4d75-9675-d76c1a029eb2 None None] MFA Rules not processed for user `c607472800fc49d5a75c5e6acb33f2a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:17.311901 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-2658630b-5806-4d75-9675-d76c1a029eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:17.319324 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1078/2143] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 09:06:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:06:17.331670 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf42441-c576-46f1-ac60-4bffc103b541 service swift] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:17.345365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf42441-c576-46f1-ac60-4bffc103b541 service swift] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:17.352209 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed835e5-d1a4-4b83-8957-8e7e4225844a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158ea5c9dd5142eebd903d5f732997ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:17.352978 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed835e5-d1a4-4b83-8957-8e7e4225844a service swift] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:17.353322 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed835e5-d1a4-4b83-8957-8e7e4225844a service swift] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:17.353661 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed835e5-d1a4-4b83-8957-8e7e4225844a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:17.368308 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed835e5-d1a4-4b83-8957-8e7e4225844a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:17.369983 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed835e5-d1a4-4b83-8957-8e7e4225844a service swift] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:17.375469 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:17.384577 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1066/2144] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 09:06:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 09:06:17.779462 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76818ddc-8fba-4199-88ac-44da0eab24a5 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:17.779683 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76818ddc-8fba-4199-88ac-44da0eab24a5 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:17.779963 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76818ddc-8fba-4199-88ac-44da0eab24a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:17.801589 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-76818ddc-8fba-4199-88ac-44da0eab24a5 None None] MFA Rules not processed for user `c607472800fc49d5a75c5e6acb33f2a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:17.802877 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-76818ddc-8fba-4199-88ac-44da0eab24a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:17.811125 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1079/2145] 10.222.0.65 () {58 vars in 967 bytes} [Wed Jul 27 09:06:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:17.824679 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed835e5-d1a4-4b83-8957-8e7e4225844a service swift] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:17.839250 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed835e5-d1a4-4b83-8957-8e7e4225844a service swift] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:17.844658 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113a773-74ae-4978-918c-69bb0feff405 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158ea5c9dd5142eebd903d5f732997ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:17.845321 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113a773-74ae-4978-918c-69bb0feff405 service swift] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:17.845610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113a773-74ae-4978-918c-69bb0feff405 service swift] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:17.845883 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113a773-74ae-4978-918c-69bb0feff405 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:17.855173 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113a773-74ae-4978-918c-69bb0feff405 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:17.856852 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113a773-74ae-4978-918c-69bb0feff405 service swift] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:17.867923 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1067/2146] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 09:06:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 09:06:20.240617 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76818ddc-8fba-4199-88ac-44da0eab24a5 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:20.242854 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-76818ddc-8fba-4199-88ac-44da0eab24a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:20.329212 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76818ddc-8fba-4199-88ac-44da0eab24a5 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:20.334278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fc146-2661-4ba5-879f-66d54d02a3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:20.334972 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fc146-2661-4ba5-879f-66d54d02a3ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:20.335248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fc146-2661-4ba5-879f-66d54d02a3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:20.336362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fc146-2661-4ba5-879f-66d54d02a3ca admin admin] PATH_INFO: `/v3/users/edb81e44e15b4661a990d244b8d0f733` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:20.337828 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2fc146-2661-4ba5-879f-66d54d02a3ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=edb81e44e15b4661a990d244b8d0f733)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:20.339822 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2fc146-2661-4ba5-879f-66d54d02a3ca admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:20.421470 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3b2fc146-2661-4ba5-879f-66d54d02a3ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edb81e44e15b4661a990d244b8d0f733'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:20.431100 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3b2fc146-2661-4ba5-879f-66d54d02a3ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edb81e44e15b4661a990d244b8d0f733'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:20.431865 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3b2fc146-2661-4ba5-879f-66d54d02a3ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edb81e44e15b4661a990d244b8d0f733'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:20.447438 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3b2fc146-2661-4ba5-879f-66d54d02a3ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edb81e44e15b4661a990d244b8d0f733'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:20.448580 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3b2fc146-2661-4ba5-879f-66d54d02a3ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edb81e44e15b4661a990d244b8d0f733'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:20.469528 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1080/2147] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:06:20 2022] DELETE /identity/v3/users/edb81e44e15b4661a990d244b8d0f733 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:20.476015 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c03a8-9d84-46aa-8012-901bd80206f0 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:20.477532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c03a8-9d84-46aa-8012-901bd80206f0 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:20.477532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c03a8-9d84-46aa-8012-901bd80206f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:20.500026 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-466c03a8-9d84-46aa-8012-901bd80206f0 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:20.501288 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-466c03a8-9d84-46aa-8012-901bd80206f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:20.581498 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1068/2148] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:20.593988 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fc146-2661-4ba5-879f-66d54d02a3ca admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:20.596151 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-3b2fc146-2661-4ba5-879f-66d54d02a3ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:20.677967 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fc146-2661-4ba5-879f-66d54d02a3ca admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:20.685716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b03325-b2af-41ee-ba2b-bf5ad47c1501 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:20.686625 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b03325-b2af-41ee-ba2b-bf5ad47c1501 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:20.686959 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b03325-b2af-41ee-ba2b-bf5ad47c1501 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:20.687432 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b03325-b2af-41ee-ba2b-bf5ad47c1501 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:20.699368 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b03325-b2af-41ee-ba2b-bf5ad47c1501 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:20.700879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b03325-b2af-41ee-ba2b-bf5ad47c1501 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:20.705493 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:20.715475 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1081/2149] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:06:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:06:21.027393 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c03a8-9d84-46aa-8012-901bd80206f0 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:21.029421 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-466c03a8-9d84-46aa-8012-901bd80206f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:21.043359 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c03a8-9d84-46aa-8012-901bd80206f0 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:21.048582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9ad0f-78d4-4437-a677-5935fbe8143f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:21.049310 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9ad0f-78d4-4437-a677-5935fbe8143f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:21.049681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9ad0f-78d4-4437-a677-5935fbe8143f admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:21.049948 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9ad0f-78d4-4437-a677-5935fbe8143f admin admin] PATH_INFO: `/v3/projects/e66f010e4550411bacd0661b282af6f3` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:21.051382 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9ad0f-78d4-4437-a677-5935fbe8143f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e66f010e4550411bacd0661b282af6f3)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:21.053386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9ad0f-78d4-4437-a677-5935fbe8143f admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:21.140566 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-b0e9ad0f-78d4-4437-a677-5935fbe8143f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e66f010e4550411bacd0661b282af6f3', 'request_id': 'req-b0e9ad0f-78d4-4437-a677-5935fbe8143f'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:21.151398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-b0e9ad0f-78d4-4437-a677-5935fbe8143f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e66f010e4550411bacd0661b282af6f3', 'request_id': 'req-b0e9ad0f-78d4-4437-a677-5935fbe8143f'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:21.170687 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-b0e9ad0f-78d4-4437-a677-5935fbe8143f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e66f010e4550411bacd0661b282af6f3', 'request_id': 'req-b0e9ad0f-78d4-4437-a677-5935fbe8143f'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:21.193825 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-b0e9ad0f-78d4-4437-a677-5935fbe8143f admin admin] The token cache is being invalidate because project e66f010e4550411bacd0661b282af6f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:06:21.194127 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-b0e9ad0f-78d4-4437-a677-5935fbe8143f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:21.195528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-b0e9ad0f-78d4-4437-a677-5935fbe8143f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:21.198540 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1069/2150] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:06:21 2022] DELETE /identity/v3/projects/e66f010e4550411bacd0661b282af6f3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:21.204949 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc780c9-f247-4107-a3a7-0a2239c494a2 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:21.205563 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc780c9-f247-4107-a3a7-0a2239c494a2 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:21.206223 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc780c9-f247-4107-a3a7-0a2239c494a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:21.237755 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-dbc780c9-f247-4107-a3a7-0a2239c494a2 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:21.239116 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-dbc780c9-f247-4107-a3a7-0a2239c494a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:21.329612 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1082/2151] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:21.339059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955b778-9f6d-4eb6-ab7a-c72c87009ae7 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:21.339329 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955b778-9f6d-4eb6-ab7a-c72c87009ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:21.339606 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955b778-9f6d-4eb6-ab7a-c72c87009ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:21.362469 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-4955b778-9f6d-4eb6-ab7a-c72c87009ae7 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:21.363759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-4955b778-9f6d-4eb6-ab7a-c72c87009ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:21.372651 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1070/2152] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:21.377128 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc780c9-f247-4107-a3a7-0a2239c494a2 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:21.388998 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc780c9-f247-4107-a3a7-0a2239c494a2 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:21.394662 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b03f52-fbdf-4b30-ab25-09964e3bd86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:21.395364 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b03f52-fbdf-4b30-ab25-09964e3bd86e admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:21.395697 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b03f52-fbdf-4b30-ab25-09964e3bd86e admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:21.396266 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b03f52-fbdf-4b30-ab25-09964e3bd86e admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:21.397401 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b03f52-fbdf-4b30-ab25-09964e3bd86e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:06:21.397797 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b03f52-fbdf-4b30-ab25-09964e3bd86e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:21.400246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b03f52-fbdf-4b30-ab25-09964e3bd86e admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:21.417185 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1083/2153] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:06:21.421445 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955b778-9f6d-4eb6-ab7a-c72c87009ae7 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:21.432256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955b778-9f6d-4eb6-ab7a-c72c87009ae7 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:21.437725 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27125a-f058-4f52-badb-abbd86e33c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:21.438424 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27125a-f058-4f52-badb-abbd86e33c68 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:21.438731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27125a-f058-4f52-badb-abbd86e33c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:21.439045 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27125a-f058-4f52-badb-abbd86e33c68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:21.439881 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27125a-f058-4f52-badb-abbd86e33c68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:21.441725 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27125a-f058-4f52-badb-abbd86e33c68 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:21.479627 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1071/2154] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:06:21 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:06:21.484436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b03f52-fbdf-4b30-ab25-09964e3bd86e admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:21.498673 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b03f52-fbdf-4b30-ab25-09964e3bd86e admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:21.593733 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1e6e1-7aa7-4f49-8f7e-a196a4113129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:21.594626 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1e6e1-7aa7-4f49-8f7e-a196a4113129 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:21.595078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1e6e1-7aa7-4f49-8f7e-a196a4113129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:21.595541 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1e6e1-7aa7-4f49-8f7e-a196a4113129 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:21.597310 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1e6e1-7aa7-4f49-8f7e-a196a4113129 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:21.599805 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1e6e1-7aa7-4f49-8f7e-a196a4113129 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:21.633680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1084/2155] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:06:21 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:06:21.638155 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27125a-f058-4f52-badb-abbd86e33c68 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:21.664513 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27125a-f058-4f52-badb-abbd86e33c68 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:21.677420 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd177377-f531-4031-ad20-b7ccdeebb065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:21.678142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd177377-f531-4031-ad20-b7ccdeebb065 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:21.681603 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd177377-f531-4031-ad20-b7ccdeebb065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:21.681917 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd177377-f531-4031-ad20-b7ccdeebb065 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:21.682827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd177377-f531-4031-ad20-b7ccdeebb065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:21.684923 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd177377-f531-4031-ad20-b7ccdeebb065 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:21.699058 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1072/2156] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:06:21.704545 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1e6e1-7aa7-4f49-8f7e-a196a4113129 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:21.723289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1e6e1-7aa7-4f49-8f7e-a196a4113129 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:21.732338 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516f070-50bf-416c-a430-eb0981f1144b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:21.733463 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516f070-50bf-416c-a430-eb0981f1144b admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:21.733987 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516f070-50bf-416c-a430-eb0981f1144b admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:21.734542 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516f070-50bf-416c-a430-eb0981f1144b admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:21.736208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516f070-50bf-416c-a430-eb0981f1144b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:21.741153 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516f070-50bf-416c-a430-eb0981f1144b admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:21.767637 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1085/2157] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:06:21.772892 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd177377-f531-4031-ad20-b7ccdeebb065 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:21.797412 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd177377-f531-4031-ad20-b7ccdeebb065 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:21.802956 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89ba23-960a-4808-bfb9-4e21d4cb0f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:21.803650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89ba23-960a-4808-bfb9-4e21d4cb0f66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:21.804468 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89ba23-960a-4808-bfb9-4e21d4cb0f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:21.805398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89ba23-960a-4808-bfb9-4e21d4cb0f66 admin admin] PATH_INFO: `/v3/projects/42793a66b7cf4e22aac9c927451538e7/users/8af873e303054ca7ad58f09a6bdb677d/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:21.828958 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89ba23-960a-4808-bfb9-4e21d4cb0f66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42793a66b7cf4e22aac9c927451538e7, user_id=8af873e303054ca7ad58f09a6bdb677d, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:21.832461 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89ba23-960a-4808-bfb9-4e21d4cb0f66 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:21.852463 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1073/2158] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:06:21 2022] PUT /identity/v3/projects/42793a66b7cf4e22aac9c927451538e7/users/8af873e303054ca7ad58f09a6bdb677d/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:06:21.858029 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e98df2-21ce-4c8a-9174-4f21d9375d06 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:21.858486 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e98df2-21ce-4c8a-9174-4f21d9375d06 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:21.858871 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e98df2-21ce-4c8a-9174-4f21d9375d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:21.884285 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-92e98df2-21ce-4c8a-9174-4f21d9375d06 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:21.885712 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-92e98df2-21ce-4c8a-9174-4f21d9375d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:21.967021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1086/2159] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:06:21.978686 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89ba23-960a-4808-bfb9-4e21d4cb0f66 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:21.980720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-4d89ba23-960a-4808-bfb9-4e21d4cb0f66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:21.993957 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:22.078599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89ba23-960a-4808-bfb9-4e21d4cb0f66 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:22.083037 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bddfe2-df9b-43ac-8b37-e082a3179901 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:22.083946 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bddfe2-df9b-43ac-8b37-e082a3179901 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:22.084230 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bddfe2-df9b-43ac-8b37-e082a3179901 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:22.084545 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bddfe2-df9b-43ac-8b37-e082a3179901 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:22.097409 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bddfe2-df9b-43ac-8b37-e082a3179901 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:22.098993 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bddfe2-df9b-43ac-8b37-e082a3179901 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:22.111736 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1074/2160] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:06:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:06:28.863472 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800947a-e1b0-4ee9-b4fa-e3bb40b292ee None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:28.864088 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800947a-e1b0-4ee9-b4fa-e3bb40b292ee None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:28.864696 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800947a-e1b0-4ee9-b4fa-e3bb40b292ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:28.880475 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:28.931550 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-1800947a-e1b0-4ee9-b4fa-e3bb40b292ee None None] MFA Rules not processed for user `8af873e303054ca7ad58f09a6bdb677d`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:28.934984 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1800947a-e1b0-4ee9-b4fa-e3bb40b292ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:29.057295 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1087/2161] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:29.062292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bddfe2-df9b-43ac-8b37-e082a3179901 service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:29.076273 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bddfe2-df9b-43ac-8b37-e082a3179901 service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:29.081346 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62f476-edb8-4d44-9a0f-94e566016ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:29.081975 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62f476-edb8-4d44-9a0f-94e566016ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:29.082305 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62f476-edb8-4d44-9a0f-94e566016ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:29.082618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62f476-edb8-4d44-9a0f-94e566016ce1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:29.083299 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62f476-edb8-4d44-9a0f-94e566016ce1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:29.085517 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62f476-edb8-4d44-9a0f-94e566016ce1 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:29.119360 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1075/2162] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:06:29 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:06:29.123764 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800947a-e1b0-4ee9-b4fa-e3bb40b292ee None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:29.136071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800947a-e1b0-4ee9-b4fa-e3bb40b292ee None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:29.240046 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1eef6-e445-4fbf-b3a9-07b0af3b550f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:29.240923 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1eef6-e445-4fbf-b3a9-07b0af3b550f admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:29.241261 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1eef6-e445-4fbf-b3a9-07b0af3b550f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:29.241594 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1eef6-e445-4fbf-b3a9-07b0af3b550f admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:29.242616 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1eef6-e445-4fbf-b3a9-07b0af3b550f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:29.245005 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1eef6-e445-4fbf-b3a9-07b0af3b550f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:29.272241 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1088/2163] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:06:29 2022] POST /identity/v3/users => generated 298 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:06:29.277900 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62f476-edb8-4d44-9a0f-94e566016ce1 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:29.299154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62f476-edb8-4d44-9a0f-94e566016ce1 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:29.307442 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d725f87-563b-4812-a978-c306e9f67495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:29.308405 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d725f87-563b-4812-a978-c306e9f67495 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:29.308812 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d725f87-563b-4812-a978-c306e9f67495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:29.309262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d725f87-563b-4812-a978-c306e9f67495 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:29.310246 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d725f87-563b-4812-a978-c306e9f67495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:29.312454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d725f87-563b-4812-a978-c306e9f67495 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:29.342203 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1076/2164] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:06:29.347039 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1eef6-e445-4fbf-b3a9-07b0af3b550f admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:29.369708 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1eef6-e445-4fbf-b3a9-07b0af3b550f admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:29.378264 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34458c-9bba-4401-a501-c52c21f52d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:29.380721 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34458c-9bba-4401-a501-c52c21f52d0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:29.381254 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34458c-9bba-4401-a501-c52c21f52d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:29.381740 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34458c-9bba-4401-a501-c52c21f52d0a admin admin] PATH_INFO: `/v3/projects/7008bd3606a945b8a252cdb93dd7fff7/users/ffeb0bacb3fa46829bed3aeccaa442c3/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:29.411693 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34458c-9bba-4401-a501-c52c21f52d0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7008bd3606a945b8a252cdb93dd7fff7, user_id=ffeb0bacb3fa46829bed3aeccaa442c3, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:29.419180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34458c-9bba-4401-a501-c52c21f52d0a admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:29.452179 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1089/2165] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:06:29 2022] PUT /identity/v3/projects/7008bd3606a945b8a252cdb93dd7fff7/users/ffeb0bacb3fa46829bed3aeccaa442c3/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:29.452644 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d725f87-563b-4812-a978-c306e9f67495 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:29.473412 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d725f87-563b-4812-a978-c306e9f67495 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:29.572231 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e5ef0-b668-4696-8475-3f4ac6d6e184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:29.573595 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e5ef0-b668-4696-8475-3f4ac6d6e184 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:29.574087 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e5ef0-b668-4696-8475-3f4ac6d6e184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:29.574721 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e5ef0-b668-4696-8475-3f4ac6d6e184 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:29.576033 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e5ef0-b668-4696-8475-3f4ac6d6e184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:29.579975 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e5ef0-b668-4696-8475-3f4ac6d6e184 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:29.603835 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1077/2166] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:06:29.610052 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34458c-9bba-4401-a501-c52c21f52d0a admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:29.626085 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34458c-9bba-4401-a501-c52c21f52d0a admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:29.632464 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363e997-9aeb-405e-ab40-b7313e5d984f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:29.633858 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363e997-9aeb-405e-ab40-b7313e5d984f admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:29.634386 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363e997-9aeb-405e-ab40-b7313e5d984f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:29.634772 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363e997-9aeb-405e-ab40-b7313e5d984f admin admin] PATH_INFO: `/v3/projects/7008bd3606a945b8a252cdb93dd7fff7/users/ffeb0bacb3fa46829bed3aeccaa442c3/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:29.637490 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363e997-9aeb-405e-ab40-b7313e5d984f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7008bd3606a945b8a252cdb93dd7fff7, user_id=ffeb0bacb3fa46829bed3aeccaa442c3, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:29.640358 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363e997-9aeb-405e-ab40-b7313e5d984f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:29.655446 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1090/2167] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:06:29 2022] PUT /identity/v3/projects/7008bd3606a945b8a252cdb93dd7fff7/users/ffeb0bacb3fa46829bed3aeccaa442c3/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:06:29.894187 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e5ef0-b668-4696-8475-3f4ac6d6e184 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:29.897462 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-135e5ef0-b668-4696-8475-3f4ac6d6e184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:29.929058 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e5ef0-b668-4696-8475-3f4ac6d6e184 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:30.068658 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984d5e5-d0c0-47bf-89a9-682310444545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:30.070004 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984d5e5-d0c0-47bf-89a9-682310444545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:30.071209 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984d5e5-d0c0-47bf-89a9-682310444545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:30.071828 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984d5e5-d0c0-47bf-89a9-682310444545 admin admin] PATH_INFO: `/v3/users/c951b364a0af48dfa9398fa73ac01363` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:30.074429 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0984d5e5-d0c0-47bf-89a9-682310444545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c951b364a0af48dfa9398fa73ac01363)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:30.078476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0984d5e5-d0c0-47bf-89a9-682310444545 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:30.111081 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:30.200505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-0984d5e5-d0c0-47bf-89a9-682310444545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c951b364a0af48dfa9398fa73ac01363'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:30.202112 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-0984d5e5-d0c0-47bf-89a9-682310444545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c951b364a0af48dfa9398fa73ac01363'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:30.203571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-0984d5e5-d0c0-47bf-89a9-682310444545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c951b364a0af48dfa9398fa73ac01363'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:30.222233 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-0984d5e5-d0c0-47bf-89a9-682310444545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c951b364a0af48dfa9398fa73ac01363'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:30.248422 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-0984d5e5-d0c0-47bf-89a9-682310444545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c951b364a0af48dfa9398fa73ac01363'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:30.278183 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1078/2168] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:06:29 2022] DELETE /identity/v3/users/c951b364a0af48dfa9398fa73ac01363 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:30.284476 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a6b08-b1a1-4a39-b407-ba35244903cb None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:30.285508 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a6b08-b1a1-4a39-b407-ba35244903cb None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:30.285889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a6b08-b1a1-4a39-b407-ba35244903cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:30.309792 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-8f4a6b08-b1a1-4a39-b407-ba35244903cb None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:30.311176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-8f4a6b08-b1a1-4a39-b407-ba35244903cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:30.406987 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:30.436127 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1091/2169] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:30.447577 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984d5e5-d0c0-47bf-89a9-682310444545 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:30.450877 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-0984d5e5-d0c0-47bf-89a9-682310444545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:30.536701 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984d5e5-d0c0-47bf-89a9-682310444545 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:30.542058 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7837b95-dd1d-4ea2-a705-887bd5935cbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:30.543074 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7837b95-dd1d-4ea2-a705-887bd5935cbf service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:30.543519 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7837b95-dd1d-4ea2-a705-887bd5935cbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:30.543806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7837b95-dd1d-4ea2-a705-887bd5935cbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:30.557243 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7837b95-dd1d-4ea2-a705-887bd5935cbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:30.558788 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7837b95-dd1d-4ea2-a705-887bd5935cbf service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:30.571393 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1079/2170] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:06:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:06:31.096050 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a6b08-b1a1-4a39-b407-ba35244903cb None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:31.098026 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-8f4a6b08-b1a1-4a39-b407-ba35244903cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:31.141931 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a6b08-b1a1-4a39-b407-ba35244903cb None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:31.161783 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2043a-bb4a-44ed-92d2-3e23e466381f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:31.163371 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2043a-bb4a-44ed-92d2-3e23e466381f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:31.163721 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2043a-bb4a-44ed-92d2-3e23e466381f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:31.165788 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2043a-bb4a-44ed-92d2-3e23e466381f admin admin] PATH_INFO: `/v3/projects/0675874cb3a444249ade218641db0637` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:31.171323 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2043a-bb4a-44ed-92d2-3e23e466381f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0675874cb3a444249ade218641db0637)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:31.175464 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2043a-bb4a-44ed-92d2-3e23e466381f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:31.307194 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-eba2043a-bb4a-44ed-92d2-3e23e466381f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0675874cb3a444249ade218641db0637', 'request_id': 'req-eba2043a-bb4a-44ed-92d2-3e23e466381f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:31.326877 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-eba2043a-bb4a-44ed-92d2-3e23e466381f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0675874cb3a444249ade218641db0637', 'request_id': 'req-eba2043a-bb4a-44ed-92d2-3e23e466381f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:31.343416 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-eba2043a-bb4a-44ed-92d2-3e23e466381f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0675874cb3a444249ade218641db0637', 'request_id': 'req-eba2043a-bb4a-44ed-92d2-3e23e466381f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:31.380137 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-eba2043a-bb4a-44ed-92d2-3e23e466381f admin admin] The token cache is being invalidate because project 0675874cb3a444249ade218641db0637 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:06:31.380393 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-eba2043a-bb4a-44ed-92d2-3e23e466381f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:31.382289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-eba2043a-bb4a-44ed-92d2-3e23e466381f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:31.386870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1092/2171] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:06:31 2022] DELETE /identity/v3/projects/0675874cb3a444249ade218641db0637 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:31.394504 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7837b95-dd1d-4ea2-a705-887bd5935cbf service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:31.459723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7837b95-dd1d-4ea2-a705-887bd5935cbf service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:31.653582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257e4ba-fb6e-4893-84e5-e99d88478aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:31.654499 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257e4ba-fb6e-4893-84e5-e99d88478aa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:31.654784 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257e4ba-fb6e-4893-84e5-e99d88478aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:31.655061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257e4ba-fb6e-4893-84e5-e99d88478aa4 admin admin] PATH_INFO: `/v3/users/2b91d4f51b194077ab669a689f52d3c8` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:31.656488 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257e4ba-fb6e-4893-84e5-e99d88478aa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b91d4f51b194077ab669a689f52d3c8)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:31.659357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257e4ba-fb6e-4893-84e5-e99d88478aa4 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:31.740323 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:31.770891 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-3257e4ba-fb6e-4893-84e5-e99d88478aa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b91d4f51b194077ab669a689f52d3c8'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:31.771708 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-3257e4ba-fb6e-4893-84e5-e99d88478aa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b91d4f51b194077ab669a689f52d3c8'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:31.772401 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-3257e4ba-fb6e-4893-84e5-e99d88478aa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b91d4f51b194077ab669a689f52d3c8'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:31.783476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-3257e4ba-fb6e-4893-84e5-e99d88478aa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b91d4f51b194077ab669a689f52d3c8'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:31.804449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-3257e4ba-fb6e-4893-84e5-e99d88478aa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b91d4f51b194077ab669a689f52d3c8'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:31.843402 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1080/2172] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:06:31 2022] DELETE /identity/v3/users/2b91d4f51b194077ab669a689f52d3c8 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:32.416377 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2043a-bb4a-44ed-92d2-3e23e466381f admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:32.420136 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-eba2043a-bb4a-44ed-92d2-3e23e466381f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:32.451729 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2043a-bb4a-44ed-92d2-3e23e466381f admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:32.610997 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302fd62-a2eb-4a62-ace4-e8ec25364551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:32.611708 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302fd62-a2eb-4a62-ace4-e8ec25364551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:32.612197 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302fd62-a2eb-4a62-ace4-e8ec25364551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:32.612695 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302fd62-a2eb-4a62-ace4-e8ec25364551 admin admin] PATH_INFO: `/v3/projects/7b4cc166c7364755b87a8ceba8ef4629` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:32.614503 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302fd62-a2eb-4a62-ace4-e8ec25364551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b4cc166c7364755b87a8ceba8ef4629)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:32.618533 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302fd62-a2eb-4a62-ace4-e8ec25364551 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:32.688441 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8302fd62-a2eb-4a62-ace4-e8ec25364551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b4cc166c7364755b87a8ceba8ef4629', 'request_id': 'req-8302fd62-a2eb-4a62-ace4-e8ec25364551'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:32.698999 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8302fd62-a2eb-4a62-ace4-e8ec25364551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b4cc166c7364755b87a8ceba8ef4629', 'request_id': 'req-8302fd62-a2eb-4a62-ace4-e8ec25364551'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:32.711038 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8302fd62-a2eb-4a62-ace4-e8ec25364551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b4cc166c7364755b87a8ceba8ef4629', 'request_id': 'req-8302fd62-a2eb-4a62-ace4-e8ec25364551'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:32.725275 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:32.730925 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8302fd62-a2eb-4a62-ace4-e8ec25364551 admin admin] The token cache is being invalidate because project 7b4cc166c7364755b87a8ceba8ef4629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:06:32.731485 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8302fd62-a2eb-4a62-ace4-e8ec25364551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:32.732689 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8302fd62-a2eb-4a62-ace4-e8ec25364551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:32.736422 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1093/2173] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:06:32 2022] DELETE /identity/v3/projects/7b4cc166c7364755b87a8ceba8ef4629 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:32.741935 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0309e3a-b656-40c4-9440-7a8ed37ca87b None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:32.743051 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0309e3a-b656-40c4-9440-7a8ed37ca87b None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:32.743353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0309e3a-b656-40c4-9440-7a8ed37ca87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:32.772465 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-d0309e3a-b656-40c4-9440-7a8ed37ca87b None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:32.775793 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-d0309e3a-b656-40c4-9440-7a8ed37ca87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:32.899113 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1081/2174] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:32.902018 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12273079-9374-43ef-ac7d-7fc1998e8b8f None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:32.902555 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12273079-9374-43ef-ac7d-7fc1998e8b8f None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:32.903637 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12273079-9374-43ef-ac7d-7fc1998e8b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:32.948857 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-12273079-9374-43ef-ac7d-7fc1998e8b8f None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:32.950203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-12273079-9374-43ef-ac7d-7fc1998e8b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:32.964842 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1094/2175] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:32.966543 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0309e3a-b656-40c4-9440-7a8ed37ca87b None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:32.982770 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0309e3a-b656-40c4-9440-7a8ed37ca87b None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:32.989256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237e8ea-65bc-4a53-acc8-285767167457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:32.990215 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237e8ea-65bc-4a53-acc8-285767167457 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:32.990865 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237e8ea-65bc-4a53-acc8-285767167457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:32.991293 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237e8ea-65bc-4a53-acc8-285767167457 admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:32.992237 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237e8ea-65bc-4a53-acc8-285767167457 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:06:32.992795 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237e8ea-65bc-4a53-acc8-285767167457 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:32.994937 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237e8ea-65bc-4a53-acc8-285767167457 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:33.017090 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1082/2176] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:06:33.028880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12273079-9374-43ef-ac7d-7fc1998e8b8f None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:33.044799 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12273079-9374-43ef-ac7d-7fc1998e8b8f None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:33.051208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7358b89-7acb-409d-9e2a-30d86c3726dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:33.052146 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7358b89-7acb-409d-9e2a-30d86c3726dd admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:33.052593 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7358b89-7acb-409d-9e2a-30d86c3726dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:33.053032 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7358b89-7acb-409d-9e2a-30d86c3726dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:33.054070 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7358b89-7acb-409d-9e2a-30d86c3726dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:33.056523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7358b89-7acb-409d-9e2a-30d86c3726dd admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:33.112723 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1095/2177] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:06:33 2022] POST /identity/v3/projects => generated 387 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:06:33.114596 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237e8ea-65bc-4a53-acc8-285767167457 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:33.153356 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237e8ea-65bc-4a53-acc8-285767167457 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:33.452981 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b8cec2-5a8a-45e8-a8ec-6141855444b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:33.457994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8cec2-5a8a-45e8-a8ec-6141855444b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:33.457994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8cec2-5a8a-45e8-a8ec-6141855444b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:33.457994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8cec2-5a8a-45e8-a8ec-6141855444b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:33.457994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b8cec2-5a8a-45e8-a8ec-6141855444b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:33.457994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b8cec2-5a8a-45e8-a8ec-6141855444b7 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:33.533540 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7358b89-7acb-409d-9e2a-30d86c3726dd admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:33.571761 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1083/2178] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:06:33 2022] POST /identity/v3/users => generated 294 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:06:33.574553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7358b89-7acb-409d-9e2a-30d86c3726dd admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:33.589664 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da648274-7733-469a-a02e-1dc42ddb3c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:33.591792 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da648274-7733-469a-a02e-1dc42ddb3c48 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:33.592471 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da648274-7733-469a-a02e-1dc42ddb3c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:33.592971 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da648274-7733-469a-a02e-1dc42ddb3c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:33.593953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da648274-7733-469a-a02e-1dc42ddb3c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:33.596760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da648274-7733-469a-a02e-1dc42ddb3c48 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:33.612334 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1096/2179] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:06:33.619833 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b8cec2-5a8a-45e8-a8ec-6141855444b7 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:33.645750 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b8cec2-5a8a-45e8-a8ec-6141855444b7 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:33.654048 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d853f98-51a6-4a69-8cda-771e500678af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:33.654860 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d853f98-51a6-4a69-8cda-771e500678af admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:33.655023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d853f98-51a6-4a69-8cda-771e500678af admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:33.655299 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d853f98-51a6-4a69-8cda-771e500678af admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:33.656041 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d853f98-51a6-4a69-8cda-771e500678af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:33.657965 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d853f98-51a6-4a69-8cda-771e500678af admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:33.687312 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1084/2180] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:06:33.699648 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da648274-7733-469a-a02e-1dc42ddb3c48 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:33.724041 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da648274-7733-469a-a02e-1dc42ddb3c48 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:33.740186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c43f1-fc68-4048-b899-49e149515517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:33.742616 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c43f1-fc68-4048-b899-49e149515517 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:33.743470 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c43f1-fc68-4048-b899-49e149515517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:33.745943 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c43f1-fc68-4048-b899-49e149515517 admin admin] PATH_INFO: `/v3/projects/da0433b2873e41b298cd00df246de0df/users/df7534a6e448477c92eac5953a4826e5/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:33.779581 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c43f1-fc68-4048-b899-49e149515517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da0433b2873e41b298cd00df246de0df, user_id=df7534a6e448477c92eac5953a4826e5, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:33.783929 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c43f1-fc68-4048-b899-49e149515517 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:33.810072 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1097/2181] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:06:33 2022] PUT /identity/v3/projects/da0433b2873e41b298cd00df246de0df/users/df7534a6e448477c92eac5953a4826e5/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:33.823008 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8f3f9-c6bf-4a8d-a45f-51619a40ba71 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:33.823808 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8f3f9-c6bf-4a8d-a45f-51619a40ba71 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:33.823808 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8f3f9-c6bf-4a8d-a45f-51619a40ba71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:33.866830 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-bae8f3f9-c6bf-4a8d-a45f-51619a40ba71 None None] MFA Rules not processed for user `df7534a6e448477c92eac5953a4826e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:33.870636 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-bae8f3f9-c6bf-4a8d-a45f-51619a40ba71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:33.884793 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:33.997115 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1085/2182] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:34.001756 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c43f1-fc68-4048-b899-49e149515517 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:34.136778 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c43f1-fc68-4048-b899-49e149515517 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:34.142205 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8dde8-e01d-48a5-97a4-ff3fdbe44a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:34.142892 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8dde8-e01d-48a5-97a4-ff3fdbe44a68 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:34.143180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8dde8-e01d-48a5-97a4-ff3fdbe44a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:34.143569 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8dde8-e01d-48a5-97a4-ff3fdbe44a68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:34.144294 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8dde8-e01d-48a5-97a4-ff3fdbe44a68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:34.146868 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8dde8-e01d-48a5-97a4-ff3fdbe44a68 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:34.184317 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1098/2183] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:06:34 2022] POST /identity/v3/projects => generated 387 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:06:34.189720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8f3f9-c6bf-4a8d-a45f-51619a40ba71 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:34.215773 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8f3f9-c6bf-4a8d-a45f-51619a40ba71 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:34.350465 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76add9-9461-4ae8-ac6a-210dc7e13341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:34.350958 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76add9-9461-4ae8-ac6a-210dc7e13341 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:34.351244 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76add9-9461-4ae8-ac6a-210dc7e13341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:34.352544 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76add9-9461-4ae8-ac6a-210dc7e13341 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:34.353168 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76add9-9461-4ae8-ac6a-210dc7e13341 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:34.355302 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76add9-9461-4ae8-ac6a-210dc7e13341 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:34.394681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1086/2184] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:06:34 2022] POST /identity/v3/users => generated 300 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:06:34.401513 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8dde8-e01d-48a5-97a4-ff3fdbe44a68 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:34.419482 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8dde8-e01d-48a5-97a4-ff3fdbe44a68 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:34.434537 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbd4bc-c288-4684-bf79-e481bd338e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:34.435197 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbd4bc-c288-4684-bf79-e481bd338e31 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:34.435563 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbd4bc-c288-4684-bf79-e481bd338e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:34.435934 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbd4bc-c288-4684-bf79-e481bd338e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:34.436761 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbd4bc-c288-4684-bf79-e481bd338e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:34.442186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbd4bc-c288-4684-bf79-e481bd338e31 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:34.469320 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1099/2185] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:06:34.476176 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76add9-9461-4ae8-ac6a-210dc7e13341 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:34.497474 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76add9-9461-4ae8-ac6a-210dc7e13341 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:34.506647 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1455526-65a9-44cb-b3d8-96f9b3d01955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:34.508362 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1455526-65a9-44cb-b3d8-96f9b3d01955 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:34.508846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1455526-65a9-44cb-b3d8-96f9b3d01955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:34.509339 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1455526-65a9-44cb-b3d8-96f9b3d01955 admin admin] PATH_INFO: `/v3/projects/50f8677928974c4f847fa98b8533ef5d/users/ec2518ae40a44e26a0c725410ab8dc53/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:34.532362 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1455526-65a9-44cb-b3d8-96f9b3d01955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50f8677928974c4f847fa98b8533ef5d, user_id=ec2518ae40a44e26a0c725410ab8dc53, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:34.535292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1455526-65a9-44cb-b3d8-96f9b3d01955 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:34.561023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1087/2186] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:06:34 2022] PUT /identity/v3/projects/50f8677928974c4f847fa98b8533ef5d/users/ec2518ae40a44e26a0c725410ab8dc53/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:06:34.561753 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbd4bc-c288-4684-bf79-e481bd338e31 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:34.596211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbd4bc-c288-4684-bf79-e481bd338e31 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:34.720932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251d823-fc27-403e-870c-11e0c8bde674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:34.721688 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251d823-fc27-403e-870c-11e0c8bde674 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:34.722040 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251d823-fc27-403e-870c-11e0c8bde674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:34.722413 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251d823-fc27-403e-870c-11e0c8bde674 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:34.723937 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251d823-fc27-403e-870c-11e0c8bde674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:34.725676 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251d823-fc27-403e-870c-11e0c8bde674 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:34.738671 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1100/2187] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:06:34.743819 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1455526-65a9-44cb-b3d8-96f9b3d01955 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:34.770346 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1455526-65a9-44cb-b3d8-96f9b3d01955 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:34.778664 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b31e0d-335e-45dd-a7f0-12b2515d7b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:34.779453 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b31e0d-335e-45dd-a7f0-12b2515d7b06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:34.779654 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b31e0d-335e-45dd-a7f0-12b2515d7b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:34.779931 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b31e0d-335e-45dd-a7f0-12b2515d7b06 admin admin] PATH_INFO: `/v3/projects/50f8677928974c4f847fa98b8533ef5d/users/ec2518ae40a44e26a0c725410ab8dc53/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:34.782871 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b31e0d-335e-45dd-a7f0-12b2515d7b06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50f8677928974c4f847fa98b8533ef5d, user_id=ec2518ae40a44e26a0c725410ab8dc53, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:34.797936 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b31e0d-335e-45dd-a7f0-12b2515d7b06 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:34.816739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1088/2188] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:06:34 2022] PUT /identity/v3/projects/50f8677928974c4f847fa98b8533ef5d/users/ec2518ae40a44e26a0c725410ab8dc53/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:34.828387 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626709a-faa2-4ddc-bb4a-32c31e172157 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:34.829093 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626709a-faa2-4ddc-bb4a-32c31e172157 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:34.829736 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626709a-faa2-4ddc-bb4a-32c31e172157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:34.849240 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:34.878796 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-0626709a-faa2-4ddc-bb4a-32c31e172157 None None] MFA Rules not processed for user `ec2518ae40a44e26a0c725410ab8dc53`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:34.880822 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-0626709a-faa2-4ddc-bb4a-32c31e172157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:35.051928 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1101/2189] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:35.059923 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b31e0d-335e-45dd-a7f0-12b2515d7b06 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:35.062241 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-a1b31e0d-335e-45dd-a7f0-12b2515d7b06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:35.186605 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b31e0d-335e-45dd-a7f0-12b2515d7b06 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:35.202863 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf0bf6-4723-48c7-b532-8d9248eaf4f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:35.204250 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf0bf6-4723-48c7-b532-8d9248eaf4f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:35.205139 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf0bf6-4723-48c7-b532-8d9248eaf4f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:35.205628 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf0bf6-4723-48c7-b532-8d9248eaf4f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:35.227132 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf0bf6-4723-48c7-b532-8d9248eaf4f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:35.230965 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf0bf6-4723-48c7-b532-8d9248eaf4f2 service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:35.257047 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1089/2190] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:06:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:06:35.294474 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626709a-faa2-4ddc-bb4a-32c31e172157 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:35.385615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626709a-faa2-4ddc-bb4a-32c31e172157 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:35.391531 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c101ed-290e-4f44-944f-8d4819347973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:35.392387 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c101ed-290e-4f44-944f-8d4819347973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:35.392768 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c101ed-290e-4f44-944f-8d4819347973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:35.393585 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c101ed-290e-4f44-944f-8d4819347973 admin admin] PATH_INFO: `/v3/users/df7534a6e448477c92eac5953a4826e5` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:35.394663 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c101ed-290e-4f44-944f-8d4819347973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df7534a6e448477c92eac5953a4826e5)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:35.396864 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c101ed-290e-4f44-944f-8d4819347973 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:35.467339 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e4c101ed-290e-4f44-944f-8d4819347973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df7534a6e448477c92eac5953a4826e5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:35.476766 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e4c101ed-290e-4f44-944f-8d4819347973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df7534a6e448477c92eac5953a4826e5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:35.477740 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e4c101ed-290e-4f44-944f-8d4819347973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df7534a6e448477c92eac5953a4826e5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:35.494078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e4c101ed-290e-4f44-944f-8d4819347973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df7534a6e448477c92eac5953a4826e5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:35.494965 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e4c101ed-290e-4f44-944f-8d4819347973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df7534a6e448477c92eac5953a4826e5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:35.514850 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1102/2191] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:06:35 2022] DELETE /identity/v3/users/df7534a6e448477c92eac5953a4826e5 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:35.523159 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beadd115-1d19-4b2f-b7aa-2f23a45eee61 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:35.523159 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beadd115-1d19-4b2f-b7aa-2f23a45eee61 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:35.523159 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beadd115-1d19-4b2f-b7aa-2f23a45eee61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:35.540678 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:35.558022 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-beadd115-1d19-4b2f-b7aa-2f23a45eee61 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:35.563881 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-beadd115-1d19-4b2f-b7aa-2f23a45eee61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:35.736022 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1090/2192] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:35.751588 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c101ed-290e-4f44-944f-8d4819347973 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:35.753311 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e4c101ed-290e-4f44-944f-8d4819347973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:35.792302 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:35.921133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c101ed-290e-4f44-944f-8d4819347973 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:35.925595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e78ba-2462-447d-a08f-8c786a89e219 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:35.926373 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e78ba-2462-447d-a08f-8c786a89e219 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:35.926670 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e78ba-2462-447d-a08f-8c786a89e219 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:35.926968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e78ba-2462-447d-a08f-8c786a89e219 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:35.940770 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e78ba-2462-447d-a08f-8c786a89e219 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:35.942626 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e78ba-2462-447d-a08f-8c786a89e219 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:35.955840 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1103/2193] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:06:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:06:36.665663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beadd115-1d19-4b2f-b7aa-2f23a45eee61 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:36.667686 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-beadd115-1d19-4b2f-b7aa-2f23a45eee61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:36.683005 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beadd115-1d19-4b2f-b7aa-2f23a45eee61 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:36.688604 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e698bad-0ba8-435d-a5d1-fd5d54075eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:36.689486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e698bad-0ba8-435d-a5d1-fd5d54075eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:36.689869 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e698bad-0ba8-435d-a5d1-fd5d54075eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:36.690243 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e698bad-0ba8-435d-a5d1-fd5d54075eb8 admin admin] PATH_INFO: `/v3/projects/da0433b2873e41b298cd00df246de0df` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:36.692461 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e698bad-0ba8-435d-a5d1-fd5d54075eb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da0433b2873e41b298cd00df246de0df)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:36.694945 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e698bad-0ba8-435d-a5d1-fd5d54075eb8 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:36.782722 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-0e698bad-0ba8-435d-a5d1-fd5d54075eb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da0433b2873e41b298cd00df246de0df', 'request_id': 'req-0e698bad-0ba8-435d-a5d1-fd5d54075eb8'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:36.792227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-0e698bad-0ba8-435d-a5d1-fd5d54075eb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da0433b2873e41b298cd00df246de0df', 'request_id': 'req-0e698bad-0ba8-435d-a5d1-fd5d54075eb8'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:36.802493 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-0e698bad-0ba8-435d-a5d1-fd5d54075eb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da0433b2873e41b298cd00df246de0df', 'request_id': 'req-0e698bad-0ba8-435d-a5d1-fd5d54075eb8'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:36.819445 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-0e698bad-0ba8-435d-a5d1-fd5d54075eb8 admin admin] The token cache is being invalidate because project da0433b2873e41b298cd00df246de0df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:06:36.819736 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-0e698bad-0ba8-435d-a5d1-fd5d54075eb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:36.821097 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-0e698bad-0ba8-435d-a5d1-fd5d54075eb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:36.823077 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1091/2194] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:06:36 2022] DELETE /identity/v3/projects/da0433b2873e41b298cd00df246de0df => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:36.828398 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e78ba-2462-447d-a08f-8c786a89e219 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:36.841439 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e78ba-2462-447d-a08f-8c786a89e219 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:36.943201 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3d97e-0c18-4d80-b490-80f69af09243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:36.944685 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3d97e-0c18-4d80-b490-80f69af09243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:36.945962 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3d97e-0c18-4d80-b490-80f69af09243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:36.947538 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3d97e-0c18-4d80-b490-80f69af09243 admin admin] PATH_INFO: `/v3/users/ec2518ae40a44e26a0c725410ab8dc53` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:36.951503 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3d97e-0c18-4d80-b490-80f69af09243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec2518ae40a44e26a0c725410ab8dc53)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:36.955752 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3d97e-0c18-4d80-b490-80f69af09243 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:37.097549 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-09d3d97e-0c18-4d80-b490-80f69af09243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec2518ae40a44e26a0c725410ab8dc53'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:37.123416 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-09d3d97e-0c18-4d80-b490-80f69af09243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec2518ae40a44e26a0c725410ab8dc53'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:37.124681 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-09d3d97e-0c18-4d80-b490-80f69af09243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec2518ae40a44e26a0c725410ab8dc53'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:37.159726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-09d3d97e-0c18-4d80-b490-80f69af09243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec2518ae40a44e26a0c725410ab8dc53'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:37.160905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-09d3d97e-0c18-4d80-b490-80f69af09243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec2518ae40a44e26a0c725410ab8dc53'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:37.183128 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1104/2195] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:06:36 2022] DELETE /identity/v3/users/ec2518ae40a44e26a0c725410ab8dc53 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:37.774152 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e698bad-0ba8-435d-a5d1-fd5d54075eb8 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:37.776163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-0e698bad-0ba8-435d-a5d1-fd5d54075eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:37.802252 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e698bad-0ba8-435d-a5d1-fd5d54075eb8 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:37.884063 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a538256-bd95-4dee-b30a-feb551fa53d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:37.887027 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a538256-bd95-4dee-b30a-feb551fa53d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:37.887768 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a538256-bd95-4dee-b30a-feb551fa53d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:37.888372 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a538256-bd95-4dee-b30a-feb551fa53d2 admin admin] PATH_INFO: `/v3/projects/50f8677928974c4f847fa98b8533ef5d` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:37.891957 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a538256-bd95-4dee-b30a-feb551fa53d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50f8677928974c4f847fa98b8533ef5d)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:37.894626 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a538256-bd95-4dee-b30a-feb551fa53d2 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:37.951133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:37.977560 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-8a538256-bd95-4dee-b30a-feb551fa53d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50f8677928974c4f847fa98b8533ef5d', 'request_id': 'req-8a538256-bd95-4dee-b30a-feb551fa53d2'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:37.995496 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-8a538256-bd95-4dee-b30a-feb551fa53d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50f8677928974c4f847fa98b8533ef5d', 'request_id': 'req-8a538256-bd95-4dee-b30a-feb551fa53d2'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:38.013550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-8a538256-bd95-4dee-b30a-feb551fa53d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50f8677928974c4f847fa98b8533ef5d', 'request_id': 'req-8a538256-bd95-4dee-b30a-feb551fa53d2'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:38.038212 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-8a538256-bd95-4dee-b30a-feb551fa53d2 admin admin] The token cache is being invalidate because project 50f8677928974c4f847fa98b8533ef5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:06:38.038926 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-8a538256-bd95-4dee-b30a-feb551fa53d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:38.040921 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-8a538256-bd95-4dee-b30a-feb551fa53d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:38.045845 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1092/2196] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:06:37 2022] DELETE /identity/v3/projects/50f8677928974c4f847fa98b8533ef5d => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:38.050924 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110cb89-a423-461f-801e-fe28f8a0ebd1 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:38.051580 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110cb89-a423-461f-801e-fe28f8a0ebd1 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:38.051580 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110cb89-a423-461f-801e-fe28f8a0ebd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:38.078050 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-e110cb89-a423-461f-801e-fe28f8a0ebd1 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:38.079393 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e110cb89-a423-461f-801e-fe28f8a0ebd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:38.135713 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:38.195362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1105/2197] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:38.203734 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1801a7-e5fb-45b9-a400-1943c59a26fc None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:38.204223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1801a7-e5fb-45b9-a400-1943c59a26fc None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:38.204711 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1801a7-e5fb-45b9-a400-1943c59a26fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:38.244073 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-fc1801a7-e5fb-45b9-a400-1943c59a26fc None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:38.246799 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-fc1801a7-e5fb-45b9-a400-1943c59a26fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:38.267246 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1093/2198] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:38.271432 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110cb89-a423-461f-801e-fe28f8a0ebd1 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:38.285893 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110cb89-a423-461f-801e-fe28f8a0ebd1 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:38.293598 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c21361-6f62-4c13-85b5-858d834b9fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:38.295934 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c21361-6f62-4c13-85b5-858d834b9fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:38.296278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c21361-6f62-4c13-85b5-858d834b9fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:38.296546 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c21361-6f62-4c13-85b5-858d834b9fe7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:38.297363 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c21361-6f62-4c13-85b5-858d834b9fe7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:06:38.297782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c21361-6f62-4c13-85b5-858d834b9fe7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:38.300079 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c21361-6f62-4c13-85b5-858d834b9fe7 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:38.315498 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1106/2199] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 09:06:38.321272 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1801a7-e5fb-45b9-a400-1943c59a26fc None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:38.337886 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1801a7-e5fb-45b9-a400-1943c59a26fc None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:38.359359 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077122a-44ee-4a98-8281-1d945fc3a8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:38.360128 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077122a-44ee-4a98-8281-1d945fc3a8b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:38.360425 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077122a-44ee-4a98-8281-1d945fc3a8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:38.360700 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077122a-44ee-4a98-8281-1d945fc3a8b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:38.361443 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077122a-44ee-4a98-8281-1d945fc3a8b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:38.363505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077122a-44ee-4a98-8281-1d945fc3a8b8 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:38.410369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1094/2200] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:06:38 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:06:38.412469 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14efb0f-10c2-4ea4-a590-c055c95e52b0 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:38.412970 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14efb0f-10c2-4ea4-a590-c055c95e52b0 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:38.414418 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14efb0f-10c2-4ea4-a590-c055c95e52b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:38.415408 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077122a-44ee-4a98-8281-1d945fc3a8b8 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:38.457907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-a14efb0f-10c2-4ea4-a590-c055c95e52b0 None None] MFA Rules not processed for user `ffeb0bacb3fa46829bed3aeccaa442c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:38.459974 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a14efb0f-10c2-4ea4-a590-c055c95e52b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:38.526603 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077122a-44ee-4a98-8281-1d945fc3a8b8 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:38.533859 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fc442-6fb9-488e-b640-8ae7f5811e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:38.534900 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fc442-6fb9-488e-b640-8ae7f5811e81 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:38.535350 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fc442-6fb9-488e-b640-8ae7f5811e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:38.535802 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fc442-6fb9-488e-b640-8ae7f5811e81 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:38.536697 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951fc442-6fb9-488e-b640-8ae7f5811e81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:38.540216 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951fc442-6fb9-488e-b640-8ae7f5811e81 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:38.575103 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1095/2201] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:06:38 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:06:38.579460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fc442-6fb9-488e-b640-8ae7f5811e81 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:38.584992 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1107/2202] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:38.596335 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fc442-6fb9-488e-b640-8ae7f5811e81 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:38.600061 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14efb0f-10c2-4ea4-a590-c055c95e52b0 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:38.602307 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e8be9-1e1d-4d1a-a201-8b68c0553b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:38.602681 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a14efb0f-10c2-4ea4-a590-c055c95e52b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:38.603008 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e8be9-1e1d-4d1a-a201-8b68c0553b1d admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:38.603297 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e8be9-1e1d-4d1a-a201-8b68c0553b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:38.603570 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e8be9-1e1d-4d1a-a201-8b68c0553b1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:38.604305 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e8be9-1e1d-4d1a-a201-8b68c0553b1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:38.605971 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e8be9-1e1d-4d1a-a201-8b68c0553b1d admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:38.617691 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1096/2203] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:06:38.621863 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e8be9-1e1d-4d1a-a201-8b68c0553b1d admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:38.632998 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e8be9-1e1d-4d1a-a201-8b68c0553b1d admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:38.638110 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa5ba5-92de-4abb-b4d2-bb374f7d6d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:38.638776 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa5ba5-92de-4abb-b4d2-bb374f7d6d0d admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:38.639062 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa5ba5-92de-4abb-b4d2-bb374f7d6d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:38.639368 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa5ba5-92de-4abb-b4d2-bb374f7d6d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:38.640080 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa5ba5-92de-4abb-b4d2-bb374f7d6d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:38.641718 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa5ba5-92de-4abb-b4d2-bb374f7d6d0d admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:38.656446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1097/2204] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:06:38.662049 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa5ba5-92de-4abb-b4d2-bb374f7d6d0d admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:38.678370 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa5ba5-92de-4abb-b4d2-bb374f7d6d0d admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:38.684916 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f43db9-91b8-4c73-b4c3-b399aa42584c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:38.685867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f43db9-91b8-4c73-b4c3-b399aa42584c admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:38.686422 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f43db9-91b8-4c73-b4c3-b399aa42584c admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:38.686885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f43db9-91b8-4c73-b4c3-b399aa42584c admin admin] PATH_INFO: `/v3/projects/1468b65ac0674807b05599c0830e9fde/users/f6081901eb8c43c6abb19fe5b97b1f00/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:38.693519 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14efb0f-10c2-4ea4-a590-c055c95e52b0 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:38.698365 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ae674-7706-4e4e-a6ca-31cab2641496 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713805e0f1174a01987014319075ec03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:38.698576 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ae674-7706-4e4e-a6ca-31cab2641496 service glance] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:38.698861 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ae674-7706-4e4e-a6ca-31cab2641496 service glance] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:38.699135 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ae674-7706-4e4e-a6ca-31cab2641496 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:38.701062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9b8ae674-7706-4e4e-a6ca-31cab2641496 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:38.707192 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f43db9-91b8-4c73-b4c3-b399aa42584c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1468b65ac0674807b05599c0830e9fde, user_id=f6081901eb8c43c6abb19fe5b97b1f00, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:38.710217 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f43db9-91b8-4c73-b4c3-b399aa42584c admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:38.727511 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1098/2205] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:06:38 2022] PUT /identity/v3/projects/1468b65ac0674807b05599c0830e9fde/users/f6081901eb8c43c6abb19fe5b97b1f00/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:38.740237 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd6076-5c36-4c6e-8936-187c10b61eda None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:38.740883 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd6076-5c36-4c6e-8936-187c10b61eda None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:38.741367 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd6076-5c36-4c6e-8936-187c10b61eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:38.779154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ae674-7706-4e4e-a6ca-31cab2641496 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:38.779955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-b3dd6076-5c36-4c6e-8936-187c10b61eda None None] MFA Rules not processed for user `f6081901eb8c43c6abb19fe5b97b1f00`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:38.780700 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ae674-7706-4e4e-a6ca-31cab2641496 service glance] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:38.781191 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-b3dd6076-5c36-4c6e-8936-187c10b61eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:38.786379 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:38.793903 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1108/2206] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:06:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:06:38.806767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:38.881909 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1099/2207] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:06:38.896602 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ae674-7706-4e4e-a6ca-31cab2641496 service glance] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:38.898158 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9b8ae674-7706-4e4e-a6ca-31cab2641496 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:38.946195 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92932bb6-9eeb-406c-ac2f-89b02906af43 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:38.946874 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92932bb6-9eeb-406c-ac2f-89b02906af43 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:38.947598 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92932bb6-9eeb-406c-ac2f-89b02906af43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:38.973542 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-92932bb6-9eeb-406c-ac2f-89b02906af43 None None] MFA Rules not processed for user `c607472800fc49d5a75c5e6acb33f2a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:38.975881 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-92932bb6-9eeb-406c-ac2f-89b02906af43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:38.985434 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ae674-7706-4e4e-a6ca-31cab2641496 service glance] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:39.054443 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1100/2208] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 09:06:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:06:39.058589 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cef1e-27c7-40cf-9cfe-f8dcb6e7541c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:39.059719 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cef1e-27c7-40cf-9cfe-f8dcb6e7541c service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:39.059719 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cef1e-27c7-40cf-9cfe-f8dcb6e7541c service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:39.060027 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cef1e-27c7-40cf-9cfe-f8dcb6e7541c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:39.072147 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890cef1e-27c7-40cf-9cfe-f8dcb6e7541c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:39.072909 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92932bb6-9eeb-406c-ac2f-89b02906af43 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:39.073624 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890cef1e-27c7-40cf-9cfe-f8dcb6e7541c service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:39.075350 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-92932bb6-9eeb-406c-ac2f-89b02906af43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:39.087009 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1109/2209] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:06:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:06:39.119922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cef1e-27c7-40cf-9cfe-f8dcb6e7541c service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:39.214126 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92932bb6-9eeb-406c-ac2f-89b02906af43 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:39.223124 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1aaa5-217b-40d0-9733-e75221396d73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158ea5c9dd5142eebd903d5f732997ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:39.224232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1aaa5-217b-40d0-9733-e75221396d73 service swift] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:39.224771 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1aaa5-217b-40d0-9733-e75221396d73 service swift] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:39.225296 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1aaa5-217b-40d0-9733-e75221396d73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:39.241321 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1aaa5-217b-40d0-9733-e75221396d73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:39.244630 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1aaa5-217b-40d0-9733-e75221396d73 service swift] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:39.249789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cef1e-27c7-40cf-9cfe-f8dcb6e7541c service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:39.258967 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1101/2210] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 09:06:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 09:06:39.260253 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b2c65-0561-40ec-9035-c2efe5378635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:39.261493 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b2c65-0561-40ec-9035-c2efe5378635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:39.262265 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b2c65-0561-40ec-9035-c2efe5378635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:39.262454 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b2c65-0561-40ec-9035-c2efe5378635 admin admin] PATH_INFO: `/v3/users/f6081901eb8c43c6abb19fe5b97b1f00` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:39.264638 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b2c65-0561-40ec-9035-c2efe5378635 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6081901eb8c43c6abb19fe5b97b1f00)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:39.268615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b2c65-0561-40ec-9035-c2efe5378635 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:39.408455 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-358b2c65-0561-40ec-9035-c2efe5378635 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6081901eb8c43c6abb19fe5b97b1f00'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:39.431553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-358b2c65-0561-40ec-9035-c2efe5378635 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6081901eb8c43c6abb19fe5b97b1f00'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:39.433160 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-358b2c65-0561-40ec-9035-c2efe5378635 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6081901eb8c43c6abb19fe5b97b1f00'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:39.450284 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:39.478444 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-358b2c65-0561-40ec-9035-c2efe5378635 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6081901eb8c43c6abb19fe5b97b1f00'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:39.483329 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-358b2c65-0561-40ec-9035-c2efe5378635 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6081901eb8c43c6abb19fe5b97b1f00'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:39.526350 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1110/2211] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:06:39 2022] DELETE /identity/v3/users/f6081901eb8c43c6abb19fe5b97b1f00 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:39.533034 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd744e7-51ac-4418-816c-3e2beba8b6ed None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:39.533604 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd744e7-51ac-4418-816c-3e2beba8b6ed None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:39.534090 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd744e7-51ac-4418-816c-3e2beba8b6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:39.610497 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-5bd744e7-51ac-4418-816c-3e2beba8b6ed None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:39.612671 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-5bd744e7-51ac-4418-816c-3e2beba8b6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:39.865793 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:39.897124 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1102/2212] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:06:39.909995 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b2c65-0561-40ec-9035-c2efe5378635 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:39.915950 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-358b2c65-0561-40ec-9035-c2efe5378635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:40.075465 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b2c65-0561-40ec-9035-c2efe5378635 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:40.085123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b0bf5-393e-40c8-a176-4a0468bc8ace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:40.086902 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b0bf5-393e-40c8-a176-4a0468bc8ace service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:40.087408 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b0bf5-393e-40c8-a176-4a0468bc8ace service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:40.087892 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b0bf5-393e-40c8-a176-4a0468bc8ace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:40.110023 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b0bf5-393e-40c8-a176-4a0468bc8ace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:40.113393 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b0bf5-393e-40c8-a176-4a0468bc8ace service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:40.152426 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1111/2213] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:06:41.039331 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd744e7-51ac-4418-816c-3e2beba8b6ed None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:41.040853 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-5bd744e7-51ac-4418-816c-3e2beba8b6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:41.068836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd744e7-51ac-4418-816c-3e2beba8b6ed None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:41.074896 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac54984-a870-4a0b-b359-faec120b849a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:41.075593 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac54984-a870-4a0b-b359-faec120b849a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:41.075936 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac54984-a870-4a0b-b359-faec120b849a admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:41.076213 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac54984-a870-4a0b-b359-faec120b849a admin admin] PATH_INFO: `/v3/projects/1468b65ac0674807b05599c0830e9fde` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:41.087345 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac54984-a870-4a0b-b359-faec120b849a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1468b65ac0674807b05599c0830e9fde)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:41.090114 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac54984-a870-4a0b-b359-faec120b849a admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:41.208565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-1ac54984-a870-4a0b-b359-faec120b849a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1468b65ac0674807b05599c0830e9fde', 'request_id': 'req-1ac54984-a870-4a0b-b359-faec120b849a'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:41.222119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-1ac54984-a870-4a0b-b359-faec120b849a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1468b65ac0674807b05599c0830e9fde', 'request_id': 'req-1ac54984-a870-4a0b-b359-faec120b849a'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:41.240341 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-1ac54984-a870-4a0b-b359-faec120b849a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1468b65ac0674807b05599c0830e9fde', 'request_id': 'req-1ac54984-a870-4a0b-b359-faec120b849a'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:41.274208 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-1ac54984-a870-4a0b-b359-faec120b849a admin admin] The token cache is being invalidate because project 1468b65ac0674807b05599c0830e9fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:06:41.274809 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-1ac54984-a870-4a0b-b359-faec120b849a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:41.276325 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-1ac54984-a870-4a0b-b359-faec120b849a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:41.285738 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1103/2214] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:06:41 2022] DELETE /identity/v3/projects/1468b65ac0674807b05599c0830e9fde => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:41.287932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b408747-f9df-4b07-a185-a971b9f71770 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:41.289692 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b408747-f9df-4b07-a185-a971b9f71770 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:41.290024 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b408747-f9df-4b07-a185-a971b9f71770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:41.366527 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-2b408747-f9df-4b07-a185-a971b9f71770 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:41.372915 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-2b408747-f9df-4b07-a185-a971b9f71770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:41.590392 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1112/2215] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:41.605010 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f523c93-0e44-43c4-941c-368c6a1c435e None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:41.605510 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f523c93-0e44-43c4-941c-368c6a1c435e None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:41.606009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f523c93-0e44-43c4-941c-368c6a1c435e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:41.672864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-5f523c93-0e44-43c4-941c-368c6a1c435e None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:41.677995 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-5f523c93-0e44-43c4-941c-368c6a1c435e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:41.698646 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1104/2216] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:41.704881 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b408747-f9df-4b07-a185-a971b9f71770 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:41.729943 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b408747-f9df-4b07-a185-a971b9f71770 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:41.750247 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa86a6-8c2a-4bf9-8098-9d39b4bc28a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:41.751553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa86a6-8c2a-4bf9-8098-9d39b4bc28a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:41.753490 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa86a6-8c2a-4bf9-8098-9d39b4bc28a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:41.754159 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa86a6-8c2a-4bf9-8098-9d39b4bc28a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:41.755714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa86a6-8c2a-4bf9-8098-9d39b4bc28a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:06:41.757353 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa86a6-8c2a-4bf9-8098-9d39b4bc28a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:41.761032 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa86a6-8c2a-4bf9-8098-9d39b4bc28a8 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:41.804477 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f523c93-0e44-43c4-941c-368c6a1c435e None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:41.809245 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1113/2217] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:06:41.818646 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f523c93-0e44-43c4-941c-368c6a1c435e None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:41.830067 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5cbcd-be32-421e-b19e-13465512eeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:41.830946 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5cbcd-be32-421e-b19e-13465512eeba admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:41.831236 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5cbcd-be32-421e-b19e-13465512eeba admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:41.831513 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5cbcd-be32-421e-b19e-13465512eeba admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:41.832234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5cbcd-be32-421e-b19e-13465512eeba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:41.834431 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5cbcd-be32-421e-b19e-13465512eeba admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:41.902525 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1105/2218] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:06:41 2022] POST /identity/v3/projects => generated 359 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:06:41.903939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa86a6-8c2a-4bf9-8098-9d39b4bc28a8 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:41.921244 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa86a6-8c2a-4bf9-8098-9d39b4bc28a8 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:42.115451 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717fdd0-1a47-46fe-8a07-a9bac43d5a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:42.116991 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717fdd0-1a47-46fe-8a07-a9bac43d5a75 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:42.118308 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717fdd0-1a47-46fe-8a07-a9bac43d5a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:42.119173 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717fdd0-1a47-46fe-8a07-a9bac43d5a75 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:42.121200 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717fdd0-1a47-46fe-8a07-a9bac43d5a75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:42.127151 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717fdd0-1a47-46fe-8a07-a9bac43d5a75 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:42.168850 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:42.196696 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5cbcd-be32-421e-b19e-13465512eeba admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:42.198272 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1114/2219] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:06:41 2022] POST /identity/v3/users => generated 280 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:06:42.221210 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5cbcd-be32-421e-b19e-13465512eeba admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:42.232012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99b69d-b6bf-4793-bfa5-97b449ae0ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:42.233697 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99b69d-b6bf-4793-bfa5-97b449ae0ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:42.234829 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99b69d-b6bf-4793-bfa5-97b449ae0ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:42.235642 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99b69d-b6bf-4793-bfa5-97b449ae0ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:42.237636 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99b69d-b6bf-4793-bfa5-97b449ae0ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:42.242872 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99b69d-b6bf-4793-bfa5-97b449ae0ab4 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:42.284066 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717fdd0-1a47-46fe-8a07-a9bac43d5a75 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:42.284493 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1106/2220] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:06:42.322993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717fdd0-1a47-46fe-8a07-a9bac43d5a75 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:42.338247 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89105b87-ae98-4eaf-8ff6-4fc0f1747c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:42.338247 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89105b87-ae98-4eaf-8ff6-4fc0f1747c30 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:42.338247 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89105b87-ae98-4eaf-8ff6-4fc0f1747c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:42.339146 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89105b87-ae98-4eaf-8ff6-4fc0f1747c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:42.340948 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89105b87-ae98-4eaf-8ff6-4fc0f1747c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:42.344474 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89105b87-ae98-4eaf-8ff6-4fc0f1747c30 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:42.379806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99b69d-b6bf-4793-bfa5-97b449ae0ab4 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:42.389528 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1115/2221] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:06:42.411773 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99b69d-b6bf-4793-bfa5-97b449ae0ab4 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:42.438466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39daf1c9-bb2e-47b0-8d5d-db1d18d5b47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:42.440348 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39daf1c9-bb2e-47b0-8d5d-db1d18d5b47a admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:42.442998 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39daf1c9-bb2e-47b0-8d5d-db1d18d5b47a admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:42.445022 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39daf1c9-bb2e-47b0-8d5d-db1d18d5b47a admin admin] PATH_INFO: `/v3/projects/66ecbd340deb45a28866d1d60f68629e/users/5338a510ce6d41749b42c207c2eb6e11/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:42.490244 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39daf1c9-bb2e-47b0-8d5d-db1d18d5b47a admin admin] RBAC: Authorizing `identity:create_grant(project_id=66ecbd340deb45a28866d1d60f68629e, user_id=5338a510ce6d41749b42c207c2eb6e11, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:42.496438 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39daf1c9-bb2e-47b0-8d5d-db1d18d5b47a admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:42.572429 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1107/2222] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:06:42 2022] PUT /identity/v3/projects/66ecbd340deb45a28866d1d60f68629e/users/5338a510ce6d41749b42c207c2eb6e11/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:42.584158 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb241d-d05e-47c3-aa6a-6f09fbbee2f0 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:42.585517 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb241d-d05e-47c3-aa6a-6f09fbbee2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:42.586927 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb241d-d05e-47c3-aa6a-6f09fbbee2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:42.705333 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-5fbb241d-d05e-47c3-aa6a-6f09fbbee2f0 None None] MFA Rules not processed for user `5338a510ce6d41749b42c207c2eb6e11`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:42.707868 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-5fbb241d-d05e-47c3-aa6a-6f09fbbee2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:42.894529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1116/2223] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:42 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:42.978158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39daf1c9-bb2e-47b0-8d5d-db1d18d5b47a admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:42.981455 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-39daf1c9-bb2e-47b0-8d5d-db1d18d5b47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:43.270863 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39daf1c9-bb2e-47b0-8d5d-db1d18d5b47a admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:43.289670 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b165d4-c543-4575-9027-94e7db2abad6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:43.291816 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b165d4-c543-4575-9027-94e7db2abad6 service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:43.292394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b165d4-c543-4575-9027-94e7db2abad6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:43.292806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b165d4-c543-4575-9027-94e7db2abad6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:43.339685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b165d4-c543-4575-9027-94e7db2abad6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:43.345405 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b165d4-c543-4575-9027-94e7db2abad6 service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:43.392639 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1108/2224] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:06:42 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:06:43.436887 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb241d-d05e-47c3-aa6a-6f09fbbee2f0 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:43.684152 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb241d-d05e-47c3-aa6a-6f09fbbee2f0 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:43.708329 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a049a-6353-4582-b4a8-08acc4d276d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:43.709266 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a049a-6353-4582-b4a8-08acc4d276d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:43.709557 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a049a-6353-4582-b4a8-08acc4d276d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:43.710198 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a049a-6353-4582-b4a8-08acc4d276d3 admin admin] PATH_INFO: `/v3/users/5338a510ce6d41749b42c207c2eb6e11` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:43.723905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a049a-6353-4582-b4a8-08acc4d276d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5338a510ce6d41749b42c207c2eb6e11)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:43.726859 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a049a-6353-4582-b4a8-08acc4d276d3 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:43.870439 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-820a049a-6353-4582-b4a8-08acc4d276d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5338a510ce6d41749b42c207c2eb6e11'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:43.889106 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-820a049a-6353-4582-b4a8-08acc4d276d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5338a510ce6d41749b42c207c2eb6e11'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:43.890441 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-820a049a-6353-4582-b4a8-08acc4d276d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5338a510ce6d41749b42c207c2eb6e11'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:43.927329 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-820a049a-6353-4582-b4a8-08acc4d276d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5338a510ce6d41749b42c207c2eb6e11'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:43.930362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-820a049a-6353-4582-b4a8-08acc4d276d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5338a510ce6d41749b42c207c2eb6e11'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:43.940933 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:43.970372 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1117/2225] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:06:43 2022] DELETE /identity/v3/users/5338a510ce6d41749b42c207c2eb6e11 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:43.974699 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa2cd7-207b-488f-8f97-93c634611b88 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:43.975091 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa2cd7-207b-488f-8f97-93c634611b88 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:43.975493 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa2cd7-207b-488f-8f97-93c634611b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:44.012516 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-eaaa2cd7-207b-488f-8f97-93c634611b88 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:44.013819 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-eaaa2cd7-207b-488f-8f97-93c634611b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:44.040016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:44.189095 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1109/2226] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:06:44.206388 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a049a-6353-4582-b4a8-08acc4d276d3 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:44.208052 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-820a049a-6353-4582-b4a8-08acc4d276d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:44.369337 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a049a-6353-4582-b4a8-08acc4d276d3 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:44.374098 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a69502-867c-4bf3-b06c-0c74a46d28af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:44.374948 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a69502-867c-4bf3-b06c-0c74a46d28af service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:44.375236 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a69502-867c-4bf3-b06c-0c74a46d28af service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:44.375520 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a69502-867c-4bf3-b06c-0c74a46d28af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:44.411820 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a69502-867c-4bf3-b06c-0c74a46d28af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:44.423069 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a69502-867c-4bf3-b06c-0c74a46d28af service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:44.440427 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1118/2227] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:06:45.645774 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa2cd7-207b-488f-8f97-93c634611b88 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:45.647323 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-eaaa2cd7-207b-488f-8f97-93c634611b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:45.683267 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa2cd7-207b-488f-8f97-93c634611b88 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:45.693866 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630918d-55bc-41df-aab7-6d0f7cca0949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:45.694577 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630918d-55bc-41df-aab7-6d0f7cca0949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:45.694860 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630918d-55bc-41df-aab7-6d0f7cca0949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:45.695129 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630918d-55bc-41df-aab7-6d0f7cca0949 admin admin] PATH_INFO: `/v3/projects/66ecbd340deb45a28866d1d60f68629e` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:45.699271 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630918d-55bc-41df-aab7-6d0f7cca0949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66ecbd340deb45a28866d1d60f68629e)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:45.701351 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630918d-55bc-41df-aab7-6d0f7cca0949 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:45.856924 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-9630918d-55bc-41df-aab7-6d0f7cca0949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66ecbd340deb45a28866d1d60f68629e', 'request_id': 'req-9630918d-55bc-41df-aab7-6d0f7cca0949'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:45.875458 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-9630918d-55bc-41df-aab7-6d0f7cca0949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66ecbd340deb45a28866d1d60f68629e', 'request_id': 'req-9630918d-55bc-41df-aab7-6d0f7cca0949'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:45.900961 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-9630918d-55bc-41df-aab7-6d0f7cca0949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66ecbd340deb45a28866d1d60f68629e', 'request_id': 'req-9630918d-55bc-41df-aab7-6d0f7cca0949'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:45.926012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-9630918d-55bc-41df-aab7-6d0f7cca0949 admin admin] The token cache is being invalidate because project 66ecbd340deb45a28866d1d60f68629e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:06:45.926475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-9630918d-55bc-41df-aab7-6d0f7cca0949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:45.927926 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-9630918d-55bc-41df-aab7-6d0f7cca0949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:45.940033 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1110/2228] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:06:45 2022] DELETE /identity/v3/projects/66ecbd340deb45a28866d1d60f68629e => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:06:45.948374 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5396f7-5486-4484-9cea-f9d164895ac0 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:45.949272 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5396f7-5486-4484-9cea-f9d164895ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:45.949432 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5396f7-5486-4484-9cea-f9d164895ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:45.998762 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-7d5396f7-5486-4484-9cea-f9d164895ac0 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:46.004168 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-7d5396f7-5486-4484-9cea-f9d164895ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:46.279104 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1119/2229] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:46.285707 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de55cd-8c58-42a5-a6d9-23f88fa43a64 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:46.286153 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de55cd-8c58-42a5-a6d9-23f88fa43a64 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:46.286712 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de55cd-8c58-42a5-a6d9-23f88fa43a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:46.369530 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-65de55cd-8c58-42a5-a6d9-23f88fa43a64 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:46.371196 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-65de55cd-8c58-42a5-a6d9-23f88fa43a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:46.389690 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1111/2230] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:06:46.394151 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5396f7-5486-4484-9cea-f9d164895ac0 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:46.407931 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5396f7-5486-4484-9cea-f9d164895ac0 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:46.413677 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612ccc5-9452-44a9-8961-68cc5c6ba2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:46.415266 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612ccc5-9452-44a9-8961-68cc5c6ba2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:46.416561 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612ccc5-9452-44a9-8961-68cc5c6ba2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:46.416980 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612ccc5-9452-44a9-8961-68cc5c6ba2e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:46.418012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612ccc5-9452-44a9-8961-68cc5c6ba2e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:06:46.418462 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612ccc5-9452-44a9-8961-68cc5c6ba2e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:46.420925 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612ccc5-9452-44a9-8961-68cc5c6ba2e6 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:46.448082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de55cd-8c58-42a5-a6d9-23f88fa43a64 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:46.454246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1120/2231] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 09:06:46.462997 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de55cd-8c58-42a5-a6d9-23f88fa43a64 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:46.468975 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac91303-60f6-4015-b29e-69b1b2ac522e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:46.469804 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac91303-60f6-4015-b29e-69b1b2ac522e admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:46.470187 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac91303-60f6-4015-b29e-69b1b2ac522e admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:46.470629 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac91303-60f6-4015-b29e-69b1b2ac522e admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:46.471443 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac91303-60f6-4015-b29e-69b1b2ac522e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:46.473588 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac91303-60f6-4015-b29e-69b1b2ac522e admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:46.544681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1112/2232] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:06:46 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:06:46.545460 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612ccc5-9452-44a9-8961-68cc5c6ba2e6 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:46.583968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612ccc5-9452-44a9-8961-68cc5c6ba2e6 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:46.775277 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64215579-7988-4486-be3c-ef0f8d342c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:46.776435 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64215579-7988-4486-be3c-ef0f8d342c32 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:46.777638 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64215579-7988-4486-be3c-ef0f8d342c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:46.778152 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64215579-7988-4486-be3c-ef0f8d342c32 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:46.780130 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64215579-7988-4486-be3c-ef0f8d342c32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:46.783872 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64215579-7988-4486-be3c-ef0f8d342c32 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:46.831672 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1121/2233] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:06:46 2022] POST /identity/v3/users => generated 293 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:06:46.837464 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac91303-60f6-4015-b29e-69b1b2ac522e admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:46.856792 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac91303-60f6-4015-b29e-69b1b2ac522e admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:46.864381 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6d564-e058-4878-8eb2-e7f23905af51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:46.865401 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6d564-e058-4878-8eb2-e7f23905af51 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:46.870845 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6d564-e058-4878-8eb2-e7f23905af51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:46.871270 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6d564-e058-4878-8eb2-e7f23905af51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:46.872544 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6d564-e058-4878-8eb2-e7f23905af51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:46.875213 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6d564-e058-4878-8eb2-e7f23905af51 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:46.891767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1113/2234] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:06:46.896044 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64215579-7988-4486-be3c-ef0f8d342c32 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:46.913919 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64215579-7988-4486-be3c-ef0f8d342c32 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:46.921392 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6c98c-af57-4ab5-860d-e65e31a68cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:46.922300 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6c98c-af57-4ab5-860d-e65e31a68cfb admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:46.930697 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6c98c-af57-4ab5-860d-e65e31a68cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:46.931586 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6c98c-af57-4ab5-860d-e65e31a68cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:46.932747 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6c98c-af57-4ab5-860d-e65e31a68cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:46.934913 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6c98c-af57-4ab5-860d-e65e31a68cfb admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:46.960718 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6d564-e058-4878-8eb2-e7f23905af51 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:46.971512 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1122/2235] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:06:46.974728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6d564-e058-4878-8eb2-e7f23905af51 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:46.997824 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920660b-d370-4b52-b871-b016600aab81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:46.998934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920660b-d370-4b52-b871-b016600aab81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:46.999432 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920660b-d370-4b52-b871-b016600aab81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:46.999817 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920660b-d370-4b52-b871-b016600aab81 admin admin] PATH_INFO: `/v3/projects/477ca6eefdf74b62874a421de39cd83f/users/43d7927367ec45338d9df86a8e4f22e1/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:47.031342 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e920660b-d370-4b52-b871-b016600aab81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=477ca6eefdf74b62874a421de39cd83f, user_id=43d7927367ec45338d9df86a8e4f22e1, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:47.034726 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e920660b-d370-4b52-b871-b016600aab81 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:47.059848 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1114/2236] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:06:46 2022] PUT /identity/v3/projects/477ca6eefdf74b62874a421de39cd83f/users/43d7927367ec45338d9df86a8e4f22e1/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:47.074063 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f21c1d-46cf-45f6-b562-fd05624e9fd8 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:47.074770 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f21c1d-46cf-45f6-b562-fd05624e9fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:47.075271 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f21c1d-46cf-45f6-b562-fd05624e9fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:47.088480 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:47.115038 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc524d-6535-407b-a548-17a2bc3c03d0 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:47.115463 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc524d-6535-407b-a548-17a2bc3c03d0 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:47.115906 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc524d-6535-407b-a548-17a2bc3c03d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:47.123914 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-53f21c1d-46cf-45f6-b562-fd05624e9fd8 None None] MFA Rules not processed for user `43d7927367ec45338d9df86a8e4f22e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:47.125475 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-53f21c1d-46cf-45f6-b562-fd05624e9fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:47.177477 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-f2dc524d-6535-407b-a548-17a2bc3c03d0 None None] MFA Rules not processed for user `5f1dfc498c1f4ccfa214d8c4777a2b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:47.180518 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-f2dc524d-6535-407b-a548-17a2bc3c03d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:47.302555 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1123/2237] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:47.306264 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f21c1d-46cf-45f6-b562-fd05624e9fd8 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:47.315661 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:47.396695 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1115/2238] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:06:47.540440 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f21c1d-46cf-45f6-b562-fd05624e9fd8 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:47.575830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907e308-eb8e-4270-b979-6e4e393e4db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:47.576907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907e308-eb8e-4270-b979-6e4e393e4db6 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:47.577390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907e308-eb8e-4270-b979-6e4e393e4db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:47.577874 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907e308-eb8e-4270-b979-6e4e393e4db6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:47.579135 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907e308-eb8e-4270-b979-6e4e393e4db6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:47.582957 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907e308-eb8e-4270-b979-6e4e393e4db6 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:47.674238 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1124/2239] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:06:47 2022] POST /identity/v3/projects => generated 385 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:06:47.678303 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc524d-6535-407b-a548-17a2bc3c03d0 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:47.703744 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc524d-6535-407b-a548-17a2bc3c03d0 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:47.879348 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21540d-df66-4cd5-91f0-76b968c04a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:47.882821 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21540d-df66-4cd5-91f0-76b968c04a90 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:47.883862 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21540d-df66-4cd5-91f0-76b968c04a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:47.884315 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21540d-df66-4cd5-91f0-76b968c04a90 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:47.885633 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21540d-df66-4cd5-91f0-76b968c04a90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:47.890177 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21540d-df66-4cd5-91f0-76b968c04a90 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:47.931988 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1116/2240] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:06:47 2022] POST /identity/v3/users => generated 293 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:06:47.936288 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907e308-eb8e-4270-b979-6e4e393e4db6 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:47.957601 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907e308-eb8e-4270-b979-6e4e393e4db6 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:47.967499 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afca5df-417d-4f54-a112-319a96dc8ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:47.968930 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afca5df-417d-4f54-a112-319a96dc8ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:47.969526 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afca5df-417d-4f54-a112-319a96dc8ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:47.970097 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afca5df-417d-4f54-a112-319a96dc8ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:47.971715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afca5df-417d-4f54-a112-319a96dc8ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:47.975728 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afca5df-417d-4f54-a112-319a96dc8ca4 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:48.008836 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1125/2241] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:06:48.013098 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21540d-df66-4cd5-91f0-76b968c04a90 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:48.033194 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21540d-df66-4cd5-91f0-76b968c04a90 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:48.041607 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cb80e-d267-49ae-a9a2-98456eaf964b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:48.042610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cb80e-d267-49ae-a9a2-98456eaf964b admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:48.043036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cb80e-d267-49ae-a9a2-98456eaf964b admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:48.043446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cb80e-d267-49ae-a9a2-98456eaf964b admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:48.044400 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24cb80e-d267-49ae-a9a2-98456eaf964b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:48.046688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24cb80e-d267-49ae-a9a2-98456eaf964b admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:48.067777 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1117/2242] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:06:48.072345 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afca5df-417d-4f54-a112-319a96dc8ca4 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:48.084310 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afca5df-417d-4f54-a112-319a96dc8ca4 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:48.092040 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4bbaa-53b4-4fdb-81ca-7075cfa230c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:48.093318 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4bbaa-53b4-4fdb-81ca-7075cfa230c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:48.094549 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4bbaa-53b4-4fdb-81ca-7075cfa230c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:48.095078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4bbaa-53b4-4fdb-81ca-7075cfa230c2 admin admin] PATH_INFO: `/v3/projects/edeee2821dac4119b67cad98b8ff6968/users/256f537005484926806b14912864184a/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:48.136995 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac4bbaa-53b4-4fdb-81ca-7075cfa230c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edeee2821dac4119b67cad98b8ff6968, user_id=256f537005484926806b14912864184a, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:48.142613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac4bbaa-53b4-4fdb-81ca-7075cfa230c2 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:48.167312 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1126/2243] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:06:48 2022] PUT /identity/v3/projects/edeee2821dac4119b67cad98b8ff6968/users/256f537005484926806b14912864184a/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:48.277991 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def8480-dc61-4218-b650-8c941655f651 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:48.278714 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def8480-dc61-4218-b650-8c941655f651 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:48.279417 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def8480-dc61-4218-b650-8c941655f651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:48.337623 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-8def8480-dc61-4218-b650-8c941655f651 None None] MFA Rules not processed for user `256f537005484926806b14912864184a`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:48.340607 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-8def8480-dc61-4218-b650-8c941655f651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:48.508827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1118/2244] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:06:48.515353 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4bbaa-53b4-4fdb-81ca-7075cfa230c2 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:48.619697 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:48.656067 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4bbaa-53b4-4fdb-81ca-7075cfa230c2 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:48.670908 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f28a7-e1fd-4c0e-b2e5-ef93d65cab4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:48.671881 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f28a7-e1fd-4c0e-b2e5-ef93d65cab4a admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:48.672369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f28a7-e1fd-4c0e-b2e5-ef93d65cab4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:48.672870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f28a7-e1fd-4c0e-b2e5-ef93d65cab4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:48.673799 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f28a7-e1fd-4c0e-b2e5-ef93d65cab4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:48.676160 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f28a7-e1fd-4c0e-b2e5-ef93d65cab4a admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:48.756854 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1127/2245] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:06:48 2022] POST /identity/v3/projects => generated 385 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:06:48.759204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def8480-dc61-4218-b650-8c941655f651 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:48.779879 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def8480-dc61-4218-b650-8c941655f651 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:48.899834 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:48.921527 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff251517-d295-4417-b89a-121116611b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:48.922370 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff251517-d295-4417-b89a-121116611b84 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:48.922855 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff251517-d295-4417-b89a-121116611b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:48.923338 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff251517-d295-4417-b89a-121116611b84 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:48.925755 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff251517-d295-4417-b89a-121116611b84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:48.930952 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff251517-d295-4417-b89a-121116611b84 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:48.988769 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1119/2246] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:06:48 2022] POST /identity/v3/users => generated 299 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:06:48.989160 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f28a7-e1fd-4c0e-b2e5-ef93d65cab4a admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:49.003178 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f28a7-e1fd-4c0e-b2e5-ef93d65cab4a admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:49.009978 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc7d34-6be8-4d81-977f-dea50c962fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:49.010836 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc7d34-6be8-4d81-977f-dea50c962fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:49.011324 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc7d34-6be8-4d81-977f-dea50c962fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:49.012278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc7d34-6be8-4d81-977f-dea50c962fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:49.013068 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc7d34-6be8-4d81-977f-dea50c962fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:49.016378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc7d34-6be8-4d81-977f-dea50c962fa7 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:49.038521 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1128/2247] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:06:49.042063 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff251517-d295-4417-b89a-121116611b84 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:49.068827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff251517-d295-4417-b89a-121116611b84 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:49.082951 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffe887-7beb-4c7c-92ff-15b73a92f616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:49.084353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffe887-7beb-4c7c-92ff-15b73a92f616 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:49.085688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffe887-7beb-4c7c-92ff-15b73a92f616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:49.085883 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffe887-7beb-4c7c-92ff-15b73a92f616 admin admin] PATH_INFO: `/v3/projects/c858ec3a270646159d55ea888e07012f/users/7bc795331d654863a417a3aa31bd49c6/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:49.120235 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ffe887-7beb-4c7c-92ff-15b73a92f616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c858ec3a270646159d55ea888e07012f, user_id=7bc795331d654863a417a3aa31bd49c6, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:49.123726 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ffe887-7beb-4c7c-92ff-15b73a92f616 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:49.146774 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1120/2248] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:06:49 2022] PUT /identity/v3/projects/c858ec3a270646159d55ea888e07012f/users/7bc795331d654863a417a3aa31bd49c6/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:49.152764 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc7d34-6be8-4d81-977f-dea50c962fa7 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:49.179045 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc7d34-6be8-4d81-977f-dea50c962fa7 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:49.307953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a69f5-06c7-41e3-8bfd-4a904ad44248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:49.309058 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a69f5-06c7-41e3-8bfd-4a904ad44248 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:49.309538 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a69f5-06c7-41e3-8bfd-4a904ad44248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:49.310010 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a69f5-06c7-41e3-8bfd-4a904ad44248 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:49.311924 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a69f5-06c7-41e3-8bfd-4a904ad44248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:49.317104 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a69f5-06c7-41e3-8bfd-4a904ad44248 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:49.341605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1129/2249] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:06:49.346031 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffe887-7beb-4c7c-92ff-15b73a92f616 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:49.365539 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffe887-7beb-4c7c-92ff-15b73a92f616 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:49.374541 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59a72f-8668-4219-ae3e-8900f982bc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:49.375731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59a72f-8668-4219-ae3e-8900f982bc00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:49.376223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59a72f-8668-4219-ae3e-8900f982bc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:49.376791 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59a72f-8668-4219-ae3e-8900f982bc00 admin admin] PATH_INFO: `/v3/projects/c858ec3a270646159d55ea888e07012f/users/7bc795331d654863a417a3aa31bd49c6/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:49.380661 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59a72f-8668-4219-ae3e-8900f982bc00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c858ec3a270646159d55ea888e07012f, user_id=7bc795331d654863a417a3aa31bd49c6, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:49.386536 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59a72f-8668-4219-ae3e-8900f982bc00 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:49.407833 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1121/2250] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:06:49 2022] PUT /identity/v3/projects/c858ec3a270646159d55ea888e07012f/users/7bc795331d654863a417a3aa31bd49c6/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:06:49.427285 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60074860-af06-46eb-9d3c-f6489739b033 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:49.427827 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60074860-af06-46eb-9d3c-f6489739b033 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:49.428324 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60074860-af06-46eb-9d3c-f6489739b033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:49.497982 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-60074860-af06-46eb-9d3c-f6489739b033 None None] MFA Rules not processed for user `7bc795331d654863a417a3aa31bd49c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:49.497982 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-60074860-af06-46eb-9d3c-f6489739b033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:49.669532 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1130/2251] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:49.717333 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59a72f-8668-4219-ae3e-8900f982bc00 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:49.720196 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-6e59a72f-8668-4219-ae3e-8900f982bc00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:49.869927 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59a72f-8668-4219-ae3e-8900f982bc00 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:49.878379 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd53924-35dc-486e-a916-e31e77d32f89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:49.879444 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd53924-35dc-486e-a916-e31e77d32f89 service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:49.880072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd53924-35dc-486e-a916-e31e77d32f89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:49.880981 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd53924-35dc-486e-a916-e31e77d32f89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:50.036127 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd53924-35dc-486e-a916-e31e77d32f89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:50.038585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd53924-35dc-486e-a916-e31e77d32f89 service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:50.053262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1122/2252] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:06:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:06:52.132485 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60074860-af06-46eb-9d3c-f6489739b033 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:52.137051 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-60074860-af06-46eb-9d3c-f6489739b033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:52.161613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60074860-af06-46eb-9d3c-f6489739b033 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:52.169403 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41128e27-e7b8-4d63-89fd-c6f0ca215ae3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:52.170420 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41128e27-e7b8-4d63-89fd-c6f0ca215ae3 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:52.170920 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41128e27-e7b8-4d63-89fd-c6f0ca215ae3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:52.171574 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41128e27-e7b8-4d63-89fd-c6f0ca215ae3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:52.247742 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:52.290123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41128e27-e7b8-4d63-89fd-c6f0ca215ae3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:52.291716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41128e27-e7b8-4d63-89fd-c6f0ca215ae3 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:52.305753 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1131/2253] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:06:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:06:53.745674 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd53924-35dc-486e-a916-e31e77d32f89 service cinder] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:53.760826 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd53924-35dc-486e-a916-e31e77d32f89 service cinder] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:53.777925 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f97f8-f3f1-4ba5-8b22-0ec938594c94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:53.779632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f97f8-f3f1-4ba5-8b22-0ec938594c94 service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:53.780363 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f97f8-f3f1-4ba5-8b22-0ec938594c94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:53.780816 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f97f8-f3f1-4ba5-8b22-0ec938594c94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:53.803026 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f97f8-f3f1-4ba5-8b22-0ec938594c94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:53.806176 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f97f8-f3f1-4ba5-8b22-0ec938594c94 service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:53.830684 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1123/2254] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:06:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:06:55.021357 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd0f94-2f1e-42d6-8d3b-fe32483137e7 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:55.022438 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd0f94-2f1e-42d6-8d3b-fe32483137e7 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:55.022438 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd0f94-2f1e-42d6-8d3b-fe32483137e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:55.046055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-c1bd0f94-2f1e-42d6-8d3b-fe32483137e7 None None] MFA Rules not processed for user `8af873e303054ca7ad58f09a6bdb677d`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:55.047405 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c1bd0f94-2f1e-42d6-8d3b-fe32483137e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:55.128058 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1132/2255] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:06:57.967657 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd1dd3-064c-45a0-8499-8576fee66fa5 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:57.968317 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd1dd3-064c-45a0-8499-8576fee66fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:57.968548 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd1dd3-064c-45a0-8499-8576fee66fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:57.994710 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-f6dd1dd3-064c-45a0-8499-8576fee66fa5 None None] MFA Rules not processed for user `c607472800fc49d5a75c5e6acb33f2a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:58.003340 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-f6dd1dd3-064c-45a0-8499-8576fee66fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:58.103003 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:58.149400 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1124/2256] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 09:06:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:58.178901 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd0f94-2f1e-42d6-8d3b-fe32483137e7 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:58.182962 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c1bd0f94-2f1e-42d6-8d3b-fe32483137e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:58.217117 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd1dd3-064c-45a0-8499-8576fee66fa5 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:58.286296 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd0f94-2f1e-42d6-8d3b-fe32483137e7 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:58.293152 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442788e0-073a-4889-860a-3ac9de633c09 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158ea5c9dd5142eebd903d5f732997ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:58.294108 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442788e0-073a-4889-860a-3ac9de633c09 service swift] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:58.294411 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442788e0-073a-4889-860a-3ac9de633c09 service swift] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:58.294680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442788e0-073a-4889-860a-3ac9de633c09 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:58.302142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd1dd3-064c-45a0-8499-8576fee66fa5 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:58.308149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442788e0-073a-4889-860a-3ac9de633c09 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:58.308470 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6e39d-a833-4f17-a44b-18cefbf8e4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:58.308983 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6e39d-a833-4f17-a44b-18cefbf8e4c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:58.309475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6e39d-a833-4f17-a44b-18cefbf8e4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:58.309822 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6e39d-a833-4f17-a44b-18cefbf8e4c6 admin admin] PATH_INFO: `/v3/users/43d7927367ec45338d9df86a8e4f22e1` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:58.309949 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442788e0-073a-4889-860a-3ac9de633c09 service swift] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:58.311377 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6e39d-a833-4f17-a44b-18cefbf8e4c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43d7927367ec45338d9df86a8e4f22e1)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:58.313660 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6e39d-a833-4f17-a44b-18cefbf8e4c6 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:58.322920 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1133/2257] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 09:06:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 09:06:58.397863 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-12d6e39d-a833-4f17-a44b-18cefbf8e4c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43d7927367ec45338d9df86a8e4f22e1'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:58.398845 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-12d6e39d-a833-4f17-a44b-18cefbf8e4c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43d7927367ec45338d9df86a8e4f22e1'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:58.401148 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-12d6e39d-a833-4f17-a44b-18cefbf8e4c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43d7927367ec45338d9df86a8e4f22e1'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:58.413977 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-12d6e39d-a833-4f17-a44b-18cefbf8e4c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43d7927367ec45338d9df86a8e4f22e1'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:58.434862 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-12d6e39d-a833-4f17-a44b-18cefbf8e4c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43d7927367ec45338d9df86a8e4f22e1'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:58.457202 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1125/2258] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:06:58 2022] DELETE /identity/v3/users/43d7927367ec45338d9df86a8e4f22e1 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:06:58.463746 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4f3f4-c076-4ad0-8644-4aae23d4386b None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:58.464115 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4f3f4-c076-4ad0-8644-4aae23d4386b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:58.465161 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4f3f4-c076-4ad0-8644-4aae23d4386b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:58.547692 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-b2c4f3f4-c076-4ad0-8644-4aae23d4386b None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:06:58.549054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b2c4f3f4-c076-4ad0-8644-4aae23d4386b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:58.745895 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1134/2259] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:06:58.772203 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6e39d-a833-4f17-a44b-18cefbf8e4c6 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:58.775456 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-12d6e39d-a833-4f17-a44b-18cefbf8e4c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:58.887249 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6e39d-a833-4f17-a44b-18cefbf8e4c6 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:58.891997 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1104d40-904c-422b-bce6-8aad3b74146e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:58.893241 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1104d40-904c-422b-bce6-8aad3b74146e service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:58.893878 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1104d40-904c-422b-bce6-8aad3b74146e service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:58.894849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1104d40-904c-422b-bce6-8aad3b74146e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:58.936310 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1104d40-904c-422b-bce6-8aad3b74146e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:58.937915 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1104d40-904c-422b-bce6-8aad3b74146e service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:58.966587 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1126/2260] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:06:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:06:59.501878 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4f3f4-c076-4ad0-8644-4aae23d4386b None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:59.504376 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b2c4f3f4-c076-4ad0-8644-4aae23d4386b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:06:59.578248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4f3f4-c076-4ad0-8644-4aae23d4386b None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:59.605623 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ceb73d-7997-40ef-ad21-5bfd832f4474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:59.606887 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ceb73d-7997-40ef-ad21-5bfd832f4474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:59.607444 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ceb73d-7997-40ef-ad21-5bfd832f4474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:59.608008 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ceb73d-7997-40ef-ad21-5bfd832f4474 admin admin] PATH_INFO: `/v3/projects/477ca6eefdf74b62874a421de39cd83f` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:59.611691 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ceb73d-7997-40ef-ad21-5bfd832f4474 admin admin] RBAC: Authorizing `identity:delete_project(project_id=477ca6eefdf74b62874a421de39cd83f)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:59.615952 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ceb73d-7997-40ef-ad21-5bfd832f4474 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:59.637026 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:59.719472 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-54ceb73d-7997-40ef-ad21-5bfd832f4474 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '477ca6eefdf74b62874a421de39cd83f', 'request_id': 'req-54ceb73d-7997-40ef-ad21-5bfd832f4474'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:59.736034 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-54ceb73d-7997-40ef-ad21-5bfd832f4474 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '477ca6eefdf74b62874a421de39cd83f', 'request_id': 'req-54ceb73d-7997-40ef-ad21-5bfd832f4474'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:59.743942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-54ceb73d-7997-40ef-ad21-5bfd832f4474 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '477ca6eefdf74b62874a421de39cd83f', 'request_id': 'req-54ceb73d-7997-40ef-ad21-5bfd832f4474'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:59.776262 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-54ceb73d-7997-40ef-ad21-5bfd832f4474 admin admin] The token cache is being invalidate because project 477ca6eefdf74b62874a421de39cd83f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:06:59.776800 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-54ceb73d-7997-40ef-ad21-5bfd832f4474 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:59.780254 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-54ceb73d-7997-40ef-ad21-5bfd832f4474 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:59.782619 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1135/2261] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:06:59 2022] DELETE /identity/v3/projects/477ca6eefdf74b62874a421de39cd83f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:06:59.791570 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1104d40-904c-422b-bce6-8aad3b74146e service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:06:59.805387 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1104d40-904c-422b-bce6-8aad3b74146e service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:06:59.825801 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:06:59.918631 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267633e-f39f-43fa-86f6-e930b43d18ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:06:59.919327 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267633e-f39f-43fa-86f6-e930b43d18ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:06:59.919626 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267633e-f39f-43fa-86f6-e930b43d18ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:06:59.919907 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267633e-f39f-43fa-86f6-e930b43d18ad admin admin] PATH_INFO: `/v3/users/256f537005484926806b14912864184a` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:06:59.921200 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267633e-f39f-43fa-86f6-e930b43d18ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=256f537005484926806b14912864184a)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:06:59.923395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267633e-f39f-43fa-86f6-e930b43d18ad admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:06:59.996676 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-1267633e-f39f-43fa-86f6-e930b43d18ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '256f537005484926806b14912864184a'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:59.997601 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-1267633e-f39f-43fa-86f6-e930b43d18ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '256f537005484926806b14912864184a'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:06:59.998307 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-1267633e-f39f-43fa-86f6-e930b43d18ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '256f537005484926806b14912864184a'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:07:00.012214 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-1267633e-f39f-43fa-86f6-e930b43d18ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '256f537005484926806b14912864184a'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:07:00.033623 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-1267633e-f39f-43fa-86f6-e930b43d18ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '256f537005484926806b14912864184a'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:07:00.050882 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1127/2262] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:06:59 2022] DELETE /identity/v3/users/256f537005484926806b14912864184a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:07:00.548433 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ceb73d-7997-40ef-ad21-5bfd832f4474 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:07:00.550563 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-54ceb73d-7997-40ef-ad21-5bfd832f4474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:07:00.581188 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ceb73d-7997-40ef-ad21-5bfd832f4474 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:07:00.700007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a62ce-4d15-4a07-8050-41bffbaadb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:07:00.700695 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a62ce-4d15-4a07-8050-41bffbaadb98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:07:00.700980 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a62ce-4d15-4a07-8050-41bffbaadb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:07:00.701259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a62ce-4d15-4a07-8050-41bffbaadb98 admin admin] PATH_INFO: `/v3/projects/edeee2821dac4119b67cad98b8ff6968` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:07:00.703130 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a62ce-4d15-4a07-8050-41bffbaadb98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edeee2821dac4119b67cad98b8ff6968)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:07:00.705636 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a62ce-4d15-4a07-8050-41bffbaadb98 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:07:00.798596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f19a62ce-4d15-4a07-8050-41bffbaadb98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edeee2821dac4119b67cad98b8ff6968', 'request_id': 'req-f19a62ce-4d15-4a07-8050-41bffbaadb98'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:07:00.813859 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f19a62ce-4d15-4a07-8050-41bffbaadb98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edeee2821dac4119b67cad98b8ff6968', 'request_id': 'req-f19a62ce-4d15-4a07-8050-41bffbaadb98'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:07:00.842408 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f19a62ce-4d15-4a07-8050-41bffbaadb98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edeee2821dac4119b67cad98b8ff6968', 'request_id': 'req-f19a62ce-4d15-4a07-8050-41bffbaadb98'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:07:00.886265 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f19a62ce-4d15-4a07-8050-41bffbaadb98 admin admin] The token cache is being invalidate because project edeee2821dac4119b67cad98b8ff6968 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:07:00.887096 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f19a62ce-4d15-4a07-8050-41bffbaadb98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:07:00.888342 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f19a62ce-4d15-4a07-8050-41bffbaadb98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:07:00.891372 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1136/2263] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:07:00 2022] DELETE /identity/v3/projects/edeee2821dac4119b67cad98b8ff6968 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:07:00.897233 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267633e-f39f-43fa-86f6-e930b43d18ad admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:07:00.899385 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-1267633e-f39f-43fa-86f6-e930b43d18ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:07:00.921470 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267633e-f39f-43fa-86f6-e930b43d18ad admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:07:01.031458 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929297f-7bf2-44f8-a40c-4a5fd0702c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:07:01.032459 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929297f-7bf2-44f8-a40c-4a5fd0702c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:07:01.032915 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929297f-7bf2-44f8-a40c-4a5fd0702c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:07:01.033318 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929297f-7bf2-44f8-a40c-4a5fd0702c61 admin admin] PATH_INFO: `/v3/users/7bc795331d654863a417a3aa31bd49c6` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:07:01.035889 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9929297f-7bf2-44f8-a40c-4a5fd0702c61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bc795331d654863a417a3aa31bd49c6)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:07:01.040885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9929297f-7bf2-44f8-a40c-4a5fd0702c61 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:07:01.123681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:07:01.156157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-9929297f-7bf2-44f8-a40c-4a5fd0702c61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bc795331d654863a417a3aa31bd49c6'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:07:01.157141 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-9929297f-7bf2-44f8-a40c-4a5fd0702c61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bc795331d654863a417a3aa31bd49c6'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:07:01.158235 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-9929297f-7bf2-44f8-a40c-4a5fd0702c61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bc795331d654863a417a3aa31bd49c6'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:07:01.173672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-9929297f-7bf2-44f8-a40c-4a5fd0702c61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bc795331d654863a417a3aa31bd49c6'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:07:01.205235 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-9929297f-7bf2-44f8-a40c-4a5fd0702c61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bc795331d654863a417a3aa31bd49c6'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:07:01.235980 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1128/2264] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:07:00 2022] DELETE /identity/v3/users/7bc795331d654863a417a3aa31bd49c6 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:07:01.617802 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a62ce-4d15-4a07-8050-41bffbaadb98 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:07:01.621686 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f19a62ce-4d15-4a07-8050-41bffbaadb98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:07:01.642436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a62ce-4d15-4a07-8050-41bffbaadb98 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:07:01.688169 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:07:01.765236 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162dbf9-47ce-43a2-b4b4-e59f81b370e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:07:01.765993 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162dbf9-47ce-43a2-b4b4-e59f81b370e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:07:01.766280 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162dbf9-47ce-43a2-b4b4-e59f81b370e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:07:01.767269 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162dbf9-47ce-43a2-b4b4-e59f81b370e7 admin admin] PATH_INFO: `/v3/projects/c858ec3a270646159d55ea888e07012f` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:07:01.768763 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162dbf9-47ce-43a2-b4b4-e59f81b370e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c858ec3a270646159d55ea888e07012f)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:07:01.771587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162dbf9-47ce-43a2-b4b4-e59f81b370e7 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:07:01.846283 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-5162dbf9-47ce-43a2-b4b4-e59f81b370e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c858ec3a270646159d55ea888e07012f', 'request_id': 'req-5162dbf9-47ce-43a2-b4b4-e59f81b370e7'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:07:01.858477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-5162dbf9-47ce-43a2-b4b4-e59f81b370e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c858ec3a270646159d55ea888e07012f', 'request_id': 'req-5162dbf9-47ce-43a2-b4b4-e59f81b370e7'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:07:01.863623 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-5162dbf9-47ce-43a2-b4b4-e59f81b370e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c858ec3a270646159d55ea888e07012f', 'request_id': 'req-5162dbf9-47ce-43a2-b4b4-e59f81b370e7'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:07:01.886949 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-5162dbf9-47ce-43a2-b4b4-e59f81b370e7 admin admin] The token cache is being invalidate because project c858ec3a270646159d55ea888e07012f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:07:01.887246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-5162dbf9-47ce-43a2-b4b4-e59f81b370e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:07:01.888000 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-5162dbf9-47ce-43a2-b4b4-e59f81b370e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:07:01.890764 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1137/2265] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:07:01 2022] DELETE /identity/v3/projects/c858ec3a270646159d55ea888e07012f => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:07:11.230261 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=16,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:07:11.876750 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=39,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:07:30.687506 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929297f-7bf2-44f8-a40c-4a5fd0702c61 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:07:30.689310 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-9929297f-7bf2-44f8-a40c-4a5fd0702c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:07:30.762420 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929297f-7bf2-44f8-a40c-4a5fd0702c61 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:07:30.824353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21b576-b9c6-4709-8bd2-b1099b7b7cce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:07:30.824920 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21b576-b9c6-4709-8bd2-b1099b7b7cce service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:07:30.825205 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21b576-b9c6-4709-8bd2-b1099b7b7cce service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:07:30.825479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21b576-b9c6-4709-8bd2-b1099b7b7cce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:07:30.827578 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-1b21b576-b9c6-4709-8bd2-b1099b7b7cce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:07:30.927044 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21b576-b9c6-4709-8bd2-b1099b7b7cce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:07:30.928541 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21b576-b9c6-4709-8bd2-b1099b7b7cce service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:07:30.941134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1129/2266] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:07:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:07:40.935852 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=70 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:07:50.977032 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1714d2c-3c0f-4e5f-a581-2872aac4e6f5 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:07:50.977975 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1714d2c-3c0f-4e5f-a581-2872aac4e6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:07:50.977975 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1714d2c-3c0f-4e5f-a581-2872aac4e6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:07:51.012463 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-a1714d2c-3c0f-4e5f-a581-2872aac4e6f5 None None] MFA Rules not processed for user `ae3fe5b4d9344c3bb7ae21b030377313`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:07:51.015781 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a1714d2c-3c0f-4e5f-a581-2872aac4e6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:07:51.110354 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1138/2267] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:07:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:07:52.776074 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21b576-b9c6-4709-8bd2-b1099b7b7cce service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:07:52.778419 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-1b21b576-b9c6-4709-8bd2-b1099b7b7cce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:07:52.886423 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21b576-b9c6-4709-8bd2-b1099b7b7cce service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:07:52.891662 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bc4f9-cf13-48d8-9afe-39ebea5a4df0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d69004d02f9426b86e07907a553e523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:07:52.892305 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bc4f9-cf13-48d8-9afe-39ebea5a4df0 service placement] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:07:52.892586 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bc4f9-cf13-48d8-9afe-39ebea5a4df0 service placement] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:07:52.892863 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bc4f9-cf13-48d8-9afe-39ebea5a4df0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:07:52.894761 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-819bc4f9-cf13-48d8-9afe-39ebea5a4df0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:07:52.908127 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bc4f9-cf13-48d8-9afe-39ebea5a4df0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:07:52.909792 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bc4f9-cf13-48d8-9afe-39ebea5a4df0 service placement] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:07:52.921406 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1130/2268] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:07:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:08:00.627947 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e5096-8d2c-43ee-b45f-2102d1cc6249 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:08:00.628785 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e5096-8d2c-43ee-b45f-2102d1cc6249 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:08:00.629093 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e5096-8d2c-43ee-b45f-2102d1cc6249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:08:00.663556 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-805e5096-8d2c-43ee-b45f-2102d1cc6249 None None] MFA Rules not processed for user `c607472800fc49d5a75c5e6acb33f2a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:08:00.664951 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-805e5096-8d2c-43ee-b45f-2102d1cc6249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:08:00.741718 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1139/2269] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 09:08:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:08:00.799807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bc4f9-cf13-48d8-9afe-39ebea5a4df0 service placement] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:08:00.801427 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-819bc4f9-cf13-48d8-9afe-39ebea5a4df0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:08:00.888749 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bc4f9-cf13-48d8-9afe-39ebea5a4df0 service placement] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:08:00.894183 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afabdacf-bb20-460e-b45e-c5d2b45fd5b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158ea5c9dd5142eebd903d5f732997ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:08:00.894870 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabdacf-bb20-460e-b45e-c5d2b45fd5b5 service swift] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:08:00.896008 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabdacf-bb20-460e-b45e-c5d2b45fd5b5 service swift] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:08:00.896321 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabdacf-bb20-460e-b45e-c5d2b45fd5b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:08:00.906788 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afabdacf-bb20-460e-b45e-c5d2b45fd5b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:08:00.908425 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afabdacf-bb20-460e-b45e-c5d2b45fd5b5 service swift] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:08:00.921319 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1131/2270] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 09:08:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 09:08:10.733582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=50 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:08:10.915897 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=64 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:08:18.377362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490065e8-acac-4406-9a37-43a9103972c3 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:08:18.378353 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490065e8-acac-4406-9a37-43a9103972c3 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:08:18.378353 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490065e8-acac-4406-9a37-43a9103972c3 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:08:18.380208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1140/2271] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 09:08:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 09:08:18.392514 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0095b-3fb1-43e3-b401-b51e775bf4da None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:08:18.393345 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0095b-3fb1-43e3-b401-b51e775bf4da None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:08:18.393513 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0095b-3fb1-43e3-b401-b51e775bf4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:08:18.427558 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-3ff0095b-3fb1-43e3-b401-b51e775bf4da None None] MFA Rules not processed for user `c30bc55c6a1348bb961f0d010422da87`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:08:18.428793 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-3ff0095b-3fb1-43e3-b401-b51e775bf4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:08:18.526653 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1132/2272] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 09:08:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:08:18.544624 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490065e8-acac-4406-9a37-43a9103972c3 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:08:18.546622 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-490065e8-acac-4406-9a37-43a9103972c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:08:18.618018 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490065e8-acac-4406-9a37-43a9103972c3 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:08:18.623233 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eee244-3755-4899-9e07-01ccc522d027 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713805e0f1174a01987014319075ec03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:08:18.623901 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eee244-3755-4899-9e07-01ccc522d027 service glance] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:08:18.624176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eee244-3755-4899-9e07-01ccc522d027 service glance] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:08:18.624445 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eee244-3755-4899-9e07-01ccc522d027 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:08:18.637514 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eee244-3755-4899-9e07-01ccc522d027 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:08:18.639216 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eee244-3755-4899-9e07-01ccc522d027 service glance] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:08:18.653387 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1141/2273] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:08:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:08:18.748334 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10130d-dffa-41dc-a7cb-bb067b0216ab None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:08:18.748620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10130d-dffa-41dc-a7cb-bb067b0216ab None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:08:18.748896 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10130d-dffa-41dc-a7cb-bb067b0216ab None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:08:18.750632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1133/2274] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 09:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 09:08:18.759215 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8d82c-6a30-4356-9f8a-1f172b5a46aa None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:08:18.759529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8d82c-6a30-4356-9f8a-1f172b5a46aa None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:08:18.759765 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8d82c-6a30-4356-9f8a-1f172b5a46aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:08:18.783183 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-d8c8d82c-6a30-4356-9f8a-1f172b5a46aa None None] MFA Rules not processed for user `b018ac10ad804c6cbbe7fdcc1cec61e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:08:18.784415 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d8c8d82c-6a30-4356-9f8a-1f172b5a46aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:08:18.797187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1142/2275] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 09:08:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:08:18.822053 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10130d-dffa-41dc-a7cb-bb067b0216ab None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:08:18.825157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-fe10130d-dffa-41dc-a7cb-bb067b0216ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:08:18.840215 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10130d-dffa-41dc-a7cb-bb067b0216ab None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:08:18.844840 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acfee4-1627-4cba-a259-939edac43aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:08:18.845476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acfee4-1627-4cba-a259-939edac43aba service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:08:18.845753 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acfee4-1627-4cba-a259-939edac43aba service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:08:18.846025 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acfee4-1627-4cba-a259-939edac43aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:08:18.856093 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acfee4-1627-4cba-a259-939edac43aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:08:18.857949 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acfee4-1627-4cba-a259-939edac43aba service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:08:18.872945 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1134/2276] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:08:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:08:19.015215 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342d432-755a-4a6c-afb8-947305a232c7 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:08:19.015720 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342d432-755a-4a6c-afb8-947305a232c7 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:08:19.016213 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342d432-755a-4a6c-afb8-947305a232c7 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:08:19.019294 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1143/2277] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 09:08:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 09:08:19.031707 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbcb60-1ac0-4cae-a984-add42ddf6876 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:08:19.032285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbcb60-1ac0-4cae-a984-add42ddf6876 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:08:19.032872 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbcb60-1ac0-4cae-a984-add42ddf6876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:08:19.065208 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-9cfbcb60-1ac0-4cae-a984-add42ddf6876 None None] MFA Rules not processed for user `c30bc55c6a1348bb961f0d010422da87`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:08:19.066522 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-9cfbcb60-1ac0-4cae-a984-add42ddf6876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:08:19.077365 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1135/2278] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 09:08:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:08:19.091314 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342d432-755a-4a6c-afb8-947305a232c7 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:08:19.093377 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4342d432-755a-4a6c-afb8-947305a232c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:08:19.109153 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342d432-755a-4a6c-afb8-947305a232c7 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:08:19.113055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a09d11-b872-49a6-8c6b-16541c77d4f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:08:19.113700 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a09d11-b872-49a6-8c6b-16541c77d4f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:08:19.113974 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a09d11-b872-49a6-8c6b-16541c77d4f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:08:19.114246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a09d11-b872-49a6-8c6b-16541c77d4f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:08:19.126964 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a09d11-b872-49a6-8c6b-16541c77d4f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:08:19.128388 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a09d11-b872-49a6-8c6b-16541c77d4f5 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:08:19.142082 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1144/2279] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:08:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:08:22.100634 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee08082-c824-4e02-bfff-3bc66e0af226 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:08:22.101192 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee08082-c824-4e02-bfff-3bc66e0af226 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:08:22.101609 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee08082-c824-4e02-bfff-3bc66e0af226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:08:22.137774 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-aee08082-c824-4e02-bfff-3bc66e0af226 None None] MFA Rules not processed for user `c607472800fc49d5a75c5e6acb33f2a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:08:22.140021 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-aee08082-c824-4e02-bfff-3bc66e0af226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:08:22.152807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1136/2280] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 09:08:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:08:22.167723 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a09d11-b872-49a6-8c6b-16541c77d4f5 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:08:22.181769 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a09d11-b872-49a6-8c6b-16541c77d4f5 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:08:22.190067 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509919c7-b4b7-47cb-b9fb-d7d51a29c963 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158ea5c9dd5142eebd903d5f732997ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:08:22.190743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509919c7-b4b7-47cb-b9fb-d7d51a29c963 service swift] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:08:22.191023 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509919c7-b4b7-47cb-b9fb-d7d51a29c963 service swift] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:08:22.191297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509919c7-b4b7-47cb-b9fb-d7d51a29c963 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:08:22.202156 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509919c7-b4b7-47cb-b9fb-d7d51a29c963 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:08:22.203978 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509919c7-b4b7-47cb-b9fb-d7d51a29c963 service swift] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:08:22.214087 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1145/2281] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 09:08:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 09:08:32.128778 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=43 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:08:32.209909 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=41 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:08:48.145536 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c59a8d-a8cb-4c69-8b61-d2b729ea8e97 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:08:48.146492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c59a8d-a8cb-4c69-8b61-d2b729ea8e97 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:08:48.146492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c59a8d-a8cb-4c69-8b61-d2b729ea8e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:08:48.178178 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-27c59a8d-a8cb-4c69-8b61-d2b729ea8e97 None None] MFA Rules not processed for user `c607472800fc49d5a75c5e6acb33f2a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:08:48.180366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-27c59a8d-a8cb-4c69-8b61-d2b729ea8e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:08:48.200517 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1137/2282] 10.222.0.65 () {58 vars in 967 bytes} [Wed Jul 27 09:08:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:08:48.216294 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509919c7-b4b7-47cb-b9fb-d7d51a29c963 service swift] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:08:48.235366 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509919c7-b4b7-47cb-b9fb-d7d51a29c963 service swift] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:08:48.244221 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ffb28-f6ec-4985-bac7-27d5a73dd3ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158ea5c9dd5142eebd903d5f732997ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:08:48.246436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ffb28-f6ec-4985-bac7-27d5a73dd3ab service swift] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:08:48.246963 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ffb28-f6ec-4985-bac7-27d5a73dd3ab service swift] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:08:48.247443 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ffb28-f6ec-4985-bac7-27d5a73dd3ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:08:48.265692 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ffb28-f6ec-4985-bac7-27d5a73dd3ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:08:48.268956 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ffb28-f6ec-4985-bac7-27d5a73dd3ab service swift] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:08:48.286896 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1146/2283] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 09:08:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 09:08:58.169398 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:08:58.280004 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=6 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:09:26.079477 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4723167-de05-41ee-8192-08cd73c05b6a None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:09:26.080105 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4723167-de05-41ee-8192-08cd73c05b6a None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:09:26.080382 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4723167-de05-41ee-8192-08cd73c05b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:09:26.108979 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-b4723167-de05-41ee-8192-08cd73c05b6a None None] MFA Rules not processed for user `5f1dfc498c1f4ccfa214d8c4777a2b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:09:26.110999 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-b4723167-de05-41ee-8192-08cd73c05b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:09:26.196371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1138/2284] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:09:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:09:36.189107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=25 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:09:47.356729 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ffb28-f6ec-4985-bac7-27d5a73dd3ab service swift] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:09:47.358636 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-776ffb28-f6ec-4985-bac7-27d5a73dd3ab service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:09:47.424192 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ffb28-f6ec-4985-bac7-27d5a73dd3ab service swift] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:09:47.427867 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de030122-0c01-42c8-a95d-519c34e87d2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:09:47.428420 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de030122-0c01-42c8-a95d-519c34e87d2f service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:09:47.428697 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de030122-0c01-42c8-a95d-519c34e87d2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:09:47.428967 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de030122-0c01-42c8-a95d-519c34e87d2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:09:47.430774 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-de030122-0c01-42c8-a95d-519c34e87d2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:09:47.443328 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de030122-0c01-42c8-a95d-519c34e87d2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:09:47.444807 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de030122-0c01-42c8-a95d-519c34e87d2f service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:09:47.455718 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1147/2285] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:09:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:09:50.470717 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4723167-de05-41ee-8192-08cd73c05b6a None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:09:50.483172 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4723167-de05-41ee-8192-08cd73c05b6a None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:09:50.487157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f1bc4-b48f-411f-9b93-d51fd4d36739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:09:50.487972 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f1bc4-b48f-411f-9b93-d51fd4d36739 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:09:50.488184 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f1bc4-b48f-411f-9b93-d51fd4d36739 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:09:50.488452 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f1bc4-b48f-411f-9b93-d51fd4d36739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:09:50.490514 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-a05f1bc4-b48f-411f-9b93-d51fd4d36739 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:09:50.506162 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f1bc4-b48f-411f-9b93-d51fd4d36739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:09:50.507740 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f1bc4-b48f-411f-9b93-d51fd4d36739 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:09:50.523446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1139/2286] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:09:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:09:51.748446 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de030122-0c01-42c8-a95d-519c34e87d2f service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:09:51.759541 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de030122-0c01-42c8-a95d-519c34e87d2f service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:09:51.764976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947689e-505c-4b5a-965a-a7b32d1c9e54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:09:51.765494 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947689e-505c-4b5a-965a-a7b32d1c9e54 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:09:51.765795 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947689e-505c-4b5a-965a-a7b32d1c9e54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:09:51.766119 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947689e-505c-4b5a-965a-a7b32d1c9e54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:09:51.768393 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-0947689e-505c-4b5a-965a-a7b32d1c9e54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:09:51.785218 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947689e-505c-4b5a-965a-a7b32d1c9e54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:09:51.786749 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947689e-505c-4b5a-965a-a7b32d1c9e54 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:09:51.801348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1148/2287] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:09:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:09:56.758518 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea11dac-0bf6-412c-a373-8682e0c0ff74 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:09:56.759125 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea11dac-0bf6-412c-a373-8682e0c0ff74 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:09:56.759484 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea11dac-0bf6-412c-a373-8682e0c0ff74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:09:56.791522 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-6ea11dac-0bf6-412c-a373-8682e0c0ff74 None None] MFA Rules not processed for user `ae3fe5b4d9344c3bb7ae21b030377313`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:09:56.792846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-6ea11dac-0bf6-412c-a373-8682e0c0ff74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:09:56.801031 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1140/2288] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:09:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:09:57.160251 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947689e-505c-4b5a-965a-a7b32d1c9e54 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:09:57.170379 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947689e-505c-4b5a-965a-a7b32d1c9e54 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:09:57.174389 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43345af9-6267-48fb-bf27-15e3ada6ba81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:09:57.175083 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43345af9-6267-48fb-bf27-15e3ada6ba81 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:09:57.175480 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43345af9-6267-48fb-bf27-15e3ada6ba81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:09:57.175821 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43345af9-6267-48fb-bf27-15e3ada6ba81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:09:57.177814 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-43345af9-6267-48fb-bf27-15e3ada6ba81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:09:57.189136 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43345af9-6267-48fb-bf27-15e3ada6ba81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:09:57.190660 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43345af9-6267-48fb-bf27-15e3ada6ba81 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:09:57.200759 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1149/2289] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:09:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:09:57.530287 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea11dac-0bf6-412c-a373-8682e0c0ff74 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:09:57.532252 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-6ea11dac-0bf6-412c-a373-8682e0c0ff74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:09:57.555445 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea11dac-0bf6-412c-a373-8682e0c0ff74 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:09:57.564723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc862ff-8b33-42cc-814d-5c4ad9a8b755 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:09:57.565684 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc862ff-8b33-42cc-814d-5c4ad9a8b755 service nova] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:09:57.566155 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc862ff-8b33-42cc-814d-5c4ad9a8b755 service nova] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:09:57.566644 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc862ff-8b33-42cc-814d-5c4ad9a8b755 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:09:57.569154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-7dc862ff-8b33-42cc-814d-5c4ad9a8b755 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:09:57.607911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43345af9-6267-48fb-bf27-15e3ada6ba81 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:09:57.633367 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43345af9-6267-48fb-bf27-15e3ada6ba81 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:09:57.647421 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338f4ec-042f-4bec-8e67-cb3aca035e3e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d69004d02f9426b86e07907a553e523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:09:57.648384 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338f4ec-042f-4bec-8e67-cb3aca035e3e service placement] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:09:57.648859 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338f4ec-042f-4bec-8e67-cb3aca035e3e service placement] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:09:57.649427 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338f4ec-042f-4bec-8e67-cb3aca035e3e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:09:57.652187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4338f4ec-042f-4bec-8e67-cb3aca035e3e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:09:57.669912 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc862ff-8b33-42cc-814d-5c4ad9a8b755 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:09:57.671651 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338f4ec-042f-4bec-8e67-cb3aca035e3e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:09:57.672939 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc862ff-8b33-42cc-814d-5c4ad9a8b755 service nova] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:09:57.674974 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338f4ec-042f-4bec-8e67-cb3aca035e3e service placement] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:09:57.688383 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1141/2290] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:09:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:09:57.691160 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1150/2291] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:09:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:10:07.682715 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=37 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:10:07.685169 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=44 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:10:09.797959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc862ff-8b33-42cc-814d-5c4ad9a8b755 service nova] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:10:09.813663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc862ff-8b33-42cc-814d-5c4ad9a8b755 service nova] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:10:09.818230 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001c6da-b80c-4a92-820f-696d19a6c4b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:10:09.819010 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001c6da-b80c-4a92-820f-696d19a6c4b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:10:09.819396 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001c6da-b80c-4a92-820f-696d19a6c4b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:10:09.819770 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001c6da-b80c-4a92-820f-696d19a6c4b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:10:09.822177 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-9001c6da-b80c-4a92-820f-696d19a6c4b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:10:09.836889 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001c6da-b80c-4a92-820f-696d19a6c4b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:10:09.839171 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001c6da-b80c-4a92-820f-696d19a6c4b4 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:10:09.852507 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1142/2292] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:10:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:10:10.194049 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4fc8a-7288-4d81-a46e-1349b926e60c None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:10:10.194717 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4fc8a-7288-4d81-a46e-1349b926e60c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:10:10.195035 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4fc8a-7288-4d81-a46e-1349b926e60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:10:10.229030 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-e2f4fc8a-7288-4d81-a46e-1349b926e60c None None] MFA Rules not processed for user `f67b7dc78caf4da490739ff96f436764`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:10:10.231211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e2f4fc8a-7288-4d81-a46e-1349b926e60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:10:10.243946 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1151/2293] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:10:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:10:10.640769 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001c6da-b80c-4a92-820f-696d19a6c4b4 service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:10:10.650473 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001c6da-b80c-4a92-820f-696d19a6c4b4 service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:10:10.655251 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f382ba5-aed7-48d2-b462-3837ba4da7eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:10:10.656029 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f382ba5-aed7-48d2-b462-3837ba4da7eb service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:10:10.656409 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f382ba5-aed7-48d2-b462-3837ba4da7eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:10:10.656781 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f382ba5-aed7-48d2-b462-3837ba4da7eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:10:10.658949 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-6f382ba5-aed7-48d2-b462-3837ba4da7eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:10:10.670833 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f382ba5-aed7-48d2-b462-3837ba4da7eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:10:10.672315 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f382ba5-aed7-48d2-b462-3837ba4da7eb service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:10:10.681478 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1143/2294] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:10:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:10:14.263164 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4fc8a-7288-4d81-a46e-1349b926e60c None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:10:14.266725 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e2f4fc8a-7288-4d81-a46e-1349b926e60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:10:14.299898 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4fc8a-7288-4d81-a46e-1349b926e60c None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:10:14.310205 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2983a-f6c7-4788-aff6-6e75835dea05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:10:14.311520 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2983a-f6c7-4788-aff6-6e75835dea05 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:10:14.312320 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2983a-f6c7-4788-aff6-6e75835dea05 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:10:14.312872 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2983a-f6c7-4788-aff6-6e75835dea05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:10:14.316179 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-10e2983a-f6c7-4788-aff6-6e75835dea05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:10:14.340054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2983a-f6c7-4788-aff6-6e75835dea05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:10:14.343801 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2983a-f6c7-4788-aff6-6e75835dea05 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:10:14.374507 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1152/2295] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:10:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:10:14.762553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f382ba5-aed7-48d2-b462-3837ba4da7eb service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:10:14.799294 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f382ba5-aed7-48d2-b462-3837ba4da7eb service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:10:14.827271 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8d4d5-1771-41a5-839d-f8290b8ad0eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:10:14.828481 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8d4d5-1771-41a5-839d-f8290b8ad0eb service nova] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:10:14.829053 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8d4d5-1771-41a5-839d-f8290b8ad0eb service nova] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:10:14.829635 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8d4d5-1771-41a5-839d-f8290b8ad0eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:10:14.837566 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-15d8d4d5-1771-41a5-839d-f8290b8ad0eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:10:14.884928 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8d4d5-1771-41a5-839d-f8290b8ad0eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:10:14.888891 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8d4d5-1771-41a5-839d-f8290b8ad0eb service nova] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:10:14.913223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1144/2296] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:10:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:10:24.357988 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=9 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:10:24.903061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=18 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:10:39.667063 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2983a-f6c7-4788-aff6-6e75835dea05 service nova] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:10:39.678640 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2983a-f6c7-4788-aff6-6e75835dea05 service nova] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:10:39.682611 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bbd689-3593-4a92-84e8-f184f044fd6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:10:39.683264 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbd689-3593-4a92-84e8-f184f044fd6b service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:10:39.683548 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbd689-3593-4a92-84e8-f184f044fd6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:10:39.683826 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbd689-3593-4a92-84e8-f184f044fd6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:10:39.686909 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-11bbd689-3593-4a92-84e8-f184f044fd6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:10:39.699666 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bbd689-3593-4a92-84e8-f184f044fd6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:10:39.701630 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bbd689-3593-4a92-84e8-f184f044fd6b service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:10:39.713192 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1153/2297] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:10:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:10:41.833549 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8d4d5-1771-41a5-839d-f8290b8ad0eb service nova] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:10:41.836039 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-15d8d4d5-1771-41a5-839d-f8290b8ad0eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:10:41.857038 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8d4d5-1771-41a5-839d-f8290b8ad0eb service nova] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:10:41.863463 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93b72b-7042-4a3b-8a9c-7325a1e8036b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:10:41.864516 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93b72b-7042-4a3b-8a9c-7325a1e8036b service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:10:41.865011 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93b72b-7042-4a3b-8a9c-7325a1e8036b service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:10:41.865469 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93b72b-7042-4a3b-8a9c-7325a1e8036b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:10:41.868688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-1e93b72b-7042-4a3b-8a9c-7325a1e8036b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:10:41.956773 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93b72b-7042-4a3b-8a9c-7325a1e8036b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:10:41.958251 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93b72b-7042-4a3b-8a9c-7325a1e8036b service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:10:41.969502 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1145/2298] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:10:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:10:49.708314 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=6 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:10:51.964486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=28 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:10:53.690855 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6537344-ecc2-4854-ab82-d778b772c4c8 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:10:53.691727 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6537344-ecc2-4854-ab82-d778b772c4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:10:53.691727 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6537344-ecc2-4854-ab82-d778b772c4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:10:53.720541 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f6537344-ecc2-4854-ab82-d778b772c4c8 None None] MFA Rules not processed for user `1d586ea72a1a4865941b30fa77103a52`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:10:53.721975 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f6537344-ecc2-4854-ab82-d778b772c4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:10:53.731828 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1154/2299] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:10:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:10:57.200347 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3b240-771e-4132-8579-3f88c778e350 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:10:57.203075 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3b240-771e-4132-8579-3f88c778e350 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:10:57.203546 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3b240-771e-4132-8579-3f88c778e350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:10:57.247276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-12e3b240-771e-4132-8579-3f88c778e350 None None] MFA Rules not processed for user `c607472800fc49d5a75c5e6acb33f2a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:10:57.250593 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-12e3b240-771e-4132-8579-3f88c778e350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:10:57.266582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1146/2300] 10.222.0.65 () {58 vars in 967 bytes} [Wed Jul 27 09:10:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:10:57.356051 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6537344-ecc2-4854-ab82-d778b772c4c8 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:10:57.375534 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6537344-ecc2-4854-ab82-d778b772c4c8 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:10:57.381617 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda98c48-8a9b-4eb1-b349-0cc903021fd6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158ea5c9dd5142eebd903d5f732997ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:10:57.382492 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda98c48-8a9b-4eb1-b349-0cc903021fd6 service swift] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:10:57.382820 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda98c48-8a9b-4eb1-b349-0cc903021fd6 service swift] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:10:57.383045 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda98c48-8a9b-4eb1-b349-0cc903021fd6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:10:57.396729 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda98c48-8a9b-4eb1-b349-0cc903021fd6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:10:57.398467 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda98c48-8a9b-4eb1-b349-0cc903021fd6 service swift] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:10:57.410590 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1155/2301] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 09:10:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 09:11:03.938051 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3b240-771e-4132-8579-3f88c778e350 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:03.957366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3b240-771e-4132-8579-3f88c778e350 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:03.963803 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925985d-e471-4a48-aa68-ae42ac97662e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d69004d02f9426b86e07907a553e523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:03.965051 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925985d-e471-4a48-aa68-ae42ac97662e service placement] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:03.965424 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925985d-e471-4a48-aa68-ae42ac97662e service placement] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:03.965920 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925985d-e471-4a48-aa68-ae42ac97662e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:03.969587 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-2925985d-e471-4a48-aa68-ae42ac97662e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:03.986866 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925985d-e471-4a48-aa68-ae42ac97662e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:03.988993 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925985d-e471-4a48-aa68-ae42ac97662e service placement] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:04.002999 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1147/2302] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:11:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:11:07.303941 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda98c48-8a9b-4eb1-b349-0cc903021fd6 service swift] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:07.314872 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda98c48-8a9b-4eb1-b349-0cc903021fd6 service swift] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:07.320475 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11dd76-3009-4a45-8e6f-9c29ca3ebe19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:07.321853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11dd76-3009-4a45-8e6f-9c29ca3ebe19 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:07.322138 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11dd76-3009-4a45-8e6f-9c29ca3ebe19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:07.322690 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11dd76-3009-4a45-8e6f-9c29ca3ebe19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:07.326713 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-0a11dd76-3009-4a45-8e6f-9c29ca3ebe19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:07.491230 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11dd76-3009-4a45-8e6f-9c29ca3ebe19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:07.494159 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11dd76-3009-4a45-8e6f-9c29ca3ebe19 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:07.512873 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1156/2303] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:11:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:11:08.423816 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925985d-e471-4a48-aa68-ae42ac97662e service placement] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:08.448163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925985d-e471-4a48-aa68-ae42ac97662e service placement] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:08.460697 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a227bf3-8fb9-45e3-9150-16f44f634cfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:08.463617 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a227bf3-8fb9-45e3-9150-16f44f634cfe service nova] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:08.464541 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a227bf3-8fb9-45e3-9150-16f44f634cfe service nova] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:08.465340 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a227bf3-8fb9-45e3-9150-16f44f634cfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:08.471621 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-3a227bf3-8fb9-45e3-9150-16f44f634cfe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:08.497655 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a227bf3-8fb9-45e3-9150-16f44f634cfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:08.504938 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a227bf3-8fb9-45e3-9150-16f44f634cfe service nova] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:08.539792 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1148/2304] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:11:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:11:08.665249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96ac5c-1064-4347-a9dd-76e972df9e11 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:08.666176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96ac5c-1064-4347-a9dd-76e972df9e11 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:08.666176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96ac5c-1064-4347-a9dd-76e972df9e11 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:08.676475 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1157/2305] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 09:11:08 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 09:11:08.731150 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5a36b-38fa-4593-84cb-66c6fa8fccac None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:08.731432 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5a36b-38fa-4593-84cb-66c6fa8fccac None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:08.732381 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5a36b-38fa-4593-84cb-66c6fa8fccac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:08.758473 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-21b5a36b-38fa-4593-84cb-66c6fa8fccac None None] MFA Rules not processed for user `3d69004d02f9426b86e07907a553e523`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:11:08.760279 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-21b5a36b-38fa-4593-84cb-66c6fa8fccac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:08.773232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1149/2306] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 09:11:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:11:08.792579 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96ac5c-1064-4347-a9dd-76e972df9e11 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:08.796745 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ca96ac5c-1064-4347-a9dd-76e972df9e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:08.838528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5a36b-38fa-4593-84cb-66c6fa8fccac None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:08.840935 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-21b5a36b-38fa-4593-84cb-66c6fa8fccac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:08.861055 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5a36b-38fa-4593-84cb-66c6fa8fccac None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:08.862887 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96ac5c-1064-4347-a9dd-76e972df9e11 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:08.867238 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833edab-2848-4ce8-a9c0-96dca05dab6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:08.867998 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833edab-2848-4ce8-a9c0-96dca05dab6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:08.868356 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833edab-2848-4ce8-a9c0-96dca05dab6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:08.868870 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833edab-2848-4ce8-a9c0-96dca05dab6f admin admin] PATH_INFO: `/v3/users/8af873e303054ca7ad58f09a6bdb677d` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:08.870692 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833edab-2848-4ce8-a9c0-96dca05dab6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8af873e303054ca7ad58f09a6bdb677d)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:08.872934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833edab-2848-4ce8-a9c0-96dca05dab6f admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:08.882206 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbeaef-4883-4568-b312-90df5cf2389c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d69004d02f9426b86e07907a553e523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:08.883954 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbeaef-4883-4568-b312-90df5cf2389c service placement] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:08.884249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbeaef-4883-4568-b312-90df5cf2389c service placement] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:08.884529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbeaef-4883-4568-b312-90df5cf2389c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:08.916084 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbeaef-4883-4568-b312-90df5cf2389c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:08.917965 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbeaef-4883-4568-b312-90df5cf2389c service placement] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:08.948082 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1158/2307] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:11:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:11:08.960992 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-4833edab-2848-4ce8-a9c0-96dca05dab6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8af873e303054ca7ad58f09a6bdb677d'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:08.961894 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-4833edab-2848-4ce8-a9c0-96dca05dab6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8af873e303054ca7ad58f09a6bdb677d'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:08.962793 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-4833edab-2848-4ce8-a9c0-96dca05dab6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8af873e303054ca7ad58f09a6bdb677d'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:08.975224 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-4833edab-2848-4ce8-a9c0-96dca05dab6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8af873e303054ca7ad58f09a6bdb677d'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:09.003996 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-4833edab-2848-4ce8-a9c0-96dca05dab6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8af873e303054ca7ad58f09a6bdb677d'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:09.058675 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1150/2308] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:11:08 2022] DELETE /identity/v3/users/8af873e303054ca7ad58f09a6bdb677d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:11:09.286535 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbeaef-4883-4568-b312-90df5cf2389c service placement] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:09.305176 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbeaef-4883-4568-b312-90df5cf2389c service placement] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:09.405572 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fdd7da-099d-4146-a272-1800d993c972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:09.406751 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdd7da-099d-4146-a272-1800d993c972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:09.407242 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdd7da-099d-4146-a272-1800d993c972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:09.407735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdd7da-099d-4146-a272-1800d993c972 admin admin] PATH_INFO: `/v3/projects/42793a66b7cf4e22aac9c927451538e7` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:09.410390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fdd7da-099d-4146-a272-1800d993c972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42793a66b7cf4e22aac9c927451538e7)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:09.416387 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fdd7da-099d-4146-a272-1800d993c972 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:09.549302 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a6fdd7da-099d-4146-a272-1800d993c972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42793a66b7cf4e22aac9c927451538e7', 'request_id': 'req-a6fdd7da-099d-4146-a272-1800d993c972'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:09.564473 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a6fdd7da-099d-4146-a272-1800d993c972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42793a66b7cf4e22aac9c927451538e7', 'request_id': 'req-a6fdd7da-099d-4146-a272-1800d993c972'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:09.576369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a6fdd7da-099d-4146-a272-1800d993c972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42793a66b7cf4e22aac9c927451538e7', 'request_id': 'req-a6fdd7da-099d-4146-a272-1800d993c972'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:09.580078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:09.605419 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a6fdd7da-099d-4146-a272-1800d993c972 admin admin] The token cache is being invalidate because project 42793a66b7cf4e22aac9c927451538e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:11:09.606050 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a6fdd7da-099d-4146-a272-1800d993c972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:09.609114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a6fdd7da-099d-4146-a272-1800d993c972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:09.611206 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1159/2309] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:11:09 2022] DELETE /identity/v3/projects/42793a66b7cf4e22aac9c927451538e7 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:11:09.616750 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833edab-2848-4ce8-a9c0-96dca05dab6f admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:09.618668 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-4833edab-2848-4ce8-a9c0-96dca05dab6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:09.654664 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833edab-2848-4ce8-a9c0-96dca05dab6f admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:09.744550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38111bf3-1a22-4be2-852c-6e1405f21c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:09.745233 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38111bf3-1a22-4be2-852c-6e1405f21c8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:09.745522 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38111bf3-1a22-4be2-852c-6e1405f21c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:09.745809 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38111bf3-1a22-4be2-852c-6e1405f21c8b admin admin] PATH_INFO: `/v3/users/ffeb0bacb3fa46829bed3aeccaa442c3` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:09.747200 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38111bf3-1a22-4be2-852c-6e1405f21c8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffeb0bacb3fa46829bed3aeccaa442c3)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:09.749385 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38111bf3-1a22-4be2-852c-6e1405f21c8b admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:09.800563 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:09.815057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-38111bf3-1a22-4be2-852c-6e1405f21c8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffeb0bacb3fa46829bed3aeccaa442c3'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:09.815788 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-38111bf3-1a22-4be2-852c-6e1405f21c8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffeb0bacb3fa46829bed3aeccaa442c3'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:09.816932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-38111bf3-1a22-4be2-852c-6e1405f21c8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffeb0bacb3fa46829bed3aeccaa442c3'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:09.827971 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-38111bf3-1a22-4be2-852c-6e1405f21c8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffeb0bacb3fa46829bed3aeccaa442c3'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:09.846915 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-38111bf3-1a22-4be2-852c-6e1405f21c8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffeb0bacb3fa46829bed3aeccaa442c3'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:09.863869 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1151/2310] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:11:09 2022] DELETE /identity/v3/users/ffeb0bacb3fa46829bed3aeccaa442c3 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:11:10.086813 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fdd7da-099d-4146-a272-1800d993c972 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:10.088583 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a6fdd7da-099d-4146-a272-1800d993c972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:10.109830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fdd7da-099d-4146-a272-1800d993c972 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:10.212077 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee1fd0-e147-41ed-9795-8f72879ad549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:10.213421 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee1fd0-e147-41ed-9795-8f72879ad549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:10.214156 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee1fd0-e147-41ed-9795-8f72879ad549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:10.214697 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee1fd0-e147-41ed-9795-8f72879ad549 admin admin] PATH_INFO: `/v3/projects/7008bd3606a945b8a252cdb93dd7fff7` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:10.217129 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee1fd0-e147-41ed-9795-8f72879ad549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7008bd3606a945b8a252cdb93dd7fff7)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:10.221217 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee1fd0-e147-41ed-9795-8f72879ad549 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:10.308612 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4eee1fd0-e147-41ed-9795-8f72879ad549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7008bd3606a945b8a252cdb93dd7fff7', 'request_id': 'req-4eee1fd0-e147-41ed-9795-8f72879ad549'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:10.319294 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4eee1fd0-e147-41ed-9795-8f72879ad549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7008bd3606a945b8a252cdb93dd7fff7', 'request_id': 'req-4eee1fd0-e147-41ed-9795-8f72879ad549'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:10.328012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4eee1fd0-e147-41ed-9795-8f72879ad549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7008bd3606a945b8a252cdb93dd7fff7', 'request_id': 'req-4eee1fd0-e147-41ed-9795-8f72879ad549'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:10.347684 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4eee1fd0-e147-41ed-9795-8f72879ad549 admin admin] The token cache is being invalidate because project 7008bd3606a945b8a252cdb93dd7fff7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:11:10.348035 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4eee1fd0-e147-41ed-9795-8f72879ad549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:10.348731 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4eee1fd0-e147-41ed-9795-8f72879ad549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:10.350782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1160/2311] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:11:10 2022] DELETE /identity/v3/projects/7008bd3606a945b8a252cdb93dd7fff7 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:11:10.356573 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cd41e-6207-4b9a-a73b-9916c3dac26c None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:10.357110 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cd41e-6207-4b9a-a73b-9916c3dac26c None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:10.357306 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cd41e-6207-4b9a-a73b-9916c3dac26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:10.399341 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-fc8cd41e-6207-4b9a-a73b-9916c3dac26c None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:11:10.402226 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-fc8cd41e-6207-4b9a-a73b-9916c3dac26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:10.532379 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1152/2312] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:11:10.540876 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1a000-0e4f-49b1-925f-54b5faa4f183 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:10.541215 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1a000-0e4f-49b1-925f-54b5faa4f183 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:10.541496 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1a000-0e4f-49b1-925f-54b5faa4f183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:10.567031 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f9d1a000-0e4f-49b1-925f-54b5faa4f183 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:11:10.568203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f9d1a000-0e4f-49b1-925f-54b5faa4f183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:10.594503 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1161/2313] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:11:10.602206 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cd41e-6207-4b9a-a73b-9916c3dac26c None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:10.621988 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cd41e-6207-4b9a-a73b-9916c3dac26c None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:10.630554 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de2d29-9a09-4f4e-8f59-e02ebe68ad16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:10.631523 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de2d29-9a09-4f4e-8f59-e02ebe68ad16 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:10.631969 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de2d29-9a09-4f4e-8f59-e02ebe68ad16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:10.632420 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de2d29-9a09-4f4e-8f59-e02ebe68ad16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:10.633333 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de2d29-9a09-4f4e-8f59-e02ebe68ad16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:11:10.633822 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de2d29-9a09-4f4e-8f59-e02ebe68ad16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:10.635847 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de2d29-9a09-4f4e-8f59-e02ebe68ad16 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:10.656627 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1153/2314] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:11:10.657812 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1a000-0e4f-49b1-925f-54b5faa4f183 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:10.671081 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1a000-0e4f-49b1-925f-54b5faa4f183 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:10.677888 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67430288-870b-47cf-a9d9-5b35b4d4ecc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:10.678676 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67430288-870b-47cf-a9d9-5b35b4d4ecc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:10.679099 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67430288-870b-47cf-a9d9-5b35b4d4ecc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:10.679509 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67430288-870b-47cf-a9d9-5b35b4d4ecc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:10.680385 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67430288-870b-47cf-a9d9-5b35b4d4ecc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:10.683759 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67430288-870b-47cf-a9d9-5b35b4d4ecc8 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:10.736644 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1162/2315] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:11:10 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:11:10.741561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de2d29-9a09-4f4e-8f59-e02ebe68ad16 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:10.758629 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de2d29-9a09-4f4e-8f59-e02ebe68ad16 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:10.880762 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440cb573-fc36-4ae6-b852-d46517f8d7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:10.881844 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cb573-fc36-4ae6-b852-d46517f8d7f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:10.882561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cb573-fc36-4ae6-b852-d46517f8d7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:10.883123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cb573-fc36-4ae6-b852-d46517f8d7f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:10.884759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440cb573-fc36-4ae6-b852-d46517f8d7f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:10.887266 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440cb573-fc36-4ae6-b852-d46517f8d7f2 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:10.921927 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1154/2316] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:11:10 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:11:10.926864 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67430288-870b-47cf-a9d9-5b35b4d4ecc8 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:10.946698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67430288-870b-47cf-a9d9-5b35b4d4ecc8 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:10.955484 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05e87d-4e74-4679-a81e-ef7a7cd9ee63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:10.956406 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05e87d-4e74-4679-a81e-ef7a7cd9ee63 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:10.956841 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05e87d-4e74-4679-a81e-ef7a7cd9ee63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:10.957254 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05e87d-4e74-4679-a81e-ef7a7cd9ee63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:10.958591 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05e87d-4e74-4679-a81e-ef7a7cd9ee63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:10.964162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05e87d-4e74-4679-a81e-ef7a7cd9ee63 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:10.993100 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1163/2317] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:11:10.995109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440cb573-fc36-4ae6-b852-d46517f8d7f2 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:11.019376 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440cb573-fc36-4ae6-b852-d46517f8d7f2 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:11.027134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc30b88-3cda-4c09-a7aa-428c30e9829d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:11.028214 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc30b88-3cda-4c09-a7aa-428c30e9829d admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:11.028711 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc30b88-3cda-4c09-a7aa-428c30e9829d admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:11.029327 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc30b88-3cda-4c09-a7aa-428c30e9829d admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:11.030703 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc30b88-3cda-4c09-a7aa-428c30e9829d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:11.033881 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc30b88-3cda-4c09-a7aa-428c30e9829d admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:11.059043 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1155/2318] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:11:11.062714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05e87d-4e74-4679-a81e-ef7a7cd9ee63 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:11.084012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05e87d-4e74-4679-a81e-ef7a7cd9ee63 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:11.093119 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf2b65-a304-49d6-b92f-ab26db898c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:11.094455 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf2b65-a304-49d6-b92f-ab26db898c98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:11.095055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf2b65-a304-49d6-b92f-ab26db898c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:11.095635 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf2b65-a304-49d6-b92f-ab26db898c98 admin admin] PATH_INFO: `/v3/projects/114b08acd1eb43e985762921b090a37a/users/81a7cc8bd9ef48e6b97213cd71e4ca36/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:11.132818 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf2b65-a304-49d6-b92f-ab26db898c98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=114b08acd1eb43e985762921b090a37a, user_id=81a7cc8bd9ef48e6b97213cd71e4ca36, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:11.138515 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf2b65-a304-49d6-b92f-ab26db898c98 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:11.164623 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1164/2319] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:11:11 2022] PUT /identity/v3/projects/114b08acd1eb43e985762921b090a37a/users/81a7cc8bd9ef48e6b97213cd71e4ca36/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:11:11.173090 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f52f32-127d-411a-83cc-116f3c0e50f8 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:11.173707 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f52f32-127d-411a-83cc-116f3c0e50f8 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:11.174367 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f52f32-127d-411a-83cc-116f3c0e50f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:11.208904 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-67f52f32-127d-411a-83cc-116f3c0e50f8 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:11:11.210476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-67f52f32-127d-411a-83cc-116f3c0e50f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:11.228211 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:11.310362 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1156/2320] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:11:11.346881 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf2b65-a304-49d6-b92f-ab26db898c98 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:11.350737 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-52bf2b65-a304-49d6-b92f-ab26db898c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:11.397957 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:11.515879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf2b65-a304-49d6-b92f-ab26db898c98 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:11.526251 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78265f-79bc-4d19-89d6-7261de3e6d16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:11.527690 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78265f-79bc-4d19-89d6-7261de3e6d16 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:11.528299 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78265f-79bc-4d19-89d6-7261de3e6d16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:11.528906 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78265f-79bc-4d19-89d6-7261de3e6d16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:11.548855 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78265f-79bc-4d19-89d6-7261de3e6d16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:11.552590 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78265f-79bc-4d19-89d6-7261de3e6d16 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:11.593057 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1165/2321] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:11:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:11:13.013257 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f52f32-127d-411a-83cc-116f3c0e50f8 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:13.015863 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-67f52f32-127d-411a-83cc-116f3c0e50f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:13.055881 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f52f32-127d-411a-83cc-116f3c0e50f8 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:13.067590 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c822b9c-1f78-4794-8733-7fec31e9d673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:13.068722 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c822b9c-1f78-4794-8733-7fec31e9d673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:13.069219 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c822b9c-1f78-4794-8733-7fec31e9d673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:13.069712 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c822b9c-1f78-4794-8733-7fec31e9d673 admin admin] PATH_INFO: `/v3/users/5f1dfc498c1f4ccfa214d8c4777a2b1a` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:13.072495 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c822b9c-1f78-4794-8733-7fec31e9d673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f1dfc498c1f4ccfa214d8c4777a2b1a)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:13.076730 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c822b9c-1f78-4794-8733-7fec31e9d673 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:13.182992 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-5c822b9c-1f78-4794-8733-7fec31e9d673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f1dfc498c1f4ccfa214d8c4777a2b1a'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:13.185882 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-5c822b9c-1f78-4794-8733-7fec31e9d673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f1dfc498c1f4ccfa214d8c4777a2b1a'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:13.187696 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-5c822b9c-1f78-4794-8733-7fec31e9d673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f1dfc498c1f4ccfa214d8c4777a2b1a'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:13.203246 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-5c822b9c-1f78-4794-8733-7fec31e9d673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f1dfc498c1f4ccfa214d8c4777a2b1a'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:13.225300 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-5c822b9c-1f78-4794-8733-7fec31e9d673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f1dfc498c1f4ccfa214d8c4777a2b1a'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:13.243128 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1157/2322] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:11:13 2022] DELETE /identity/v3/users/5f1dfc498c1f4ccfa214d8c4777a2b1a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:11:13.565997 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78265f-79bc-4d19-89d6-7261de3e6d16 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:13.584679 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78265f-79bc-4d19-89d6-7261de3e6d16 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:13.730482 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87a4b1-4690-4874-bdc2-edd7f625e8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:13.731708 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87a4b1-4690-4874-bdc2-edd7f625e8ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:13.732481 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87a4b1-4690-4874-bdc2-edd7f625e8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:13.733558 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87a4b1-4690-4874-bdc2-edd7f625e8ad admin admin] PATH_INFO: `/v3/projects/126eab441c494c56893817343530eff8` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:13.736890 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87a4b1-4690-4874-bdc2-edd7f625e8ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=126eab441c494c56893817343530eff8)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:13.740842 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87a4b1-4690-4874-bdc2-edd7f625e8ad admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:13.843431 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-cd87a4b1-4690-4874-bdc2-edd7f625e8ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '126eab441c494c56893817343530eff8', 'request_id': 'req-cd87a4b1-4690-4874-bdc2-edd7f625e8ad'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:13.853465 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-cd87a4b1-4690-4874-bdc2-edd7f625e8ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '126eab441c494c56893817343530eff8', 'request_id': 'req-cd87a4b1-4690-4874-bdc2-edd7f625e8ad'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:13.865964 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-cd87a4b1-4690-4874-bdc2-edd7f625e8ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '126eab441c494c56893817343530eff8', 'request_id': 'req-cd87a4b1-4690-4874-bdc2-edd7f625e8ad'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:13.884380 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-cd87a4b1-4690-4874-bdc2-edd7f625e8ad admin admin] The token cache is being invalidate because project 126eab441c494c56893817343530eff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:11:13.884739 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-cd87a4b1-4690-4874-bdc2-edd7f625e8ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:13.885494 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-cd87a4b1-4690-4874-bdc2-edd7f625e8ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:13.887476 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1166/2323] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:11:13 2022] DELETE /identity/v3/projects/126eab441c494c56893817343530eff8 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:11:13.893523 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618aa7b-b5f6-400f-9b3e-7b29c223901a None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:13.898545 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618aa7b-b5f6-400f-9b3e-7b29c223901a None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:13.898545 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618aa7b-b5f6-400f-9b3e-7b29c223901a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:13.951394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-0618aa7b-b5f6-400f-9b3e-7b29c223901a None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:11:13.958672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-0618aa7b-b5f6-400f-9b3e-7b29c223901a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:14.166848 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1158/2324] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:11:14.171652 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9d861-f3a7-4355-8915-08144ffb931d None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:14.172280 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9d861-f3a7-4355-8915-08144ffb931d None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:14.172791 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9d861-f3a7-4355-8915-08144ffb931d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:14.219578 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-9ee9d861-f3a7-4355-8915-08144ffb931d None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:11:14.220989 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9ee9d861-f3a7-4355-8915-08144ffb931d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:14.252398 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1167/2325] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:11:14.256280 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618aa7b-b5f6-400f-9b3e-7b29c223901a None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:14.271664 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618aa7b-b5f6-400f-9b3e-7b29c223901a None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:14.288311 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb01a3-3047-4cca-ae94-01dabe560ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:14.290312 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb01a3-3047-4cca-ae94-01dabe560ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:14.290312 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb01a3-3047-4cca-ae94-01dabe560ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:14.290312 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb01a3-3047-4cca-ae94-01dabe560ce7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:14.300078 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb01a3-3047-4cca-ae94-01dabe560ce7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:11:14.300642 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb01a3-3047-4cca-ae94-01dabe560ce7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:14.304605 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb01a3-3047-4cca-ae94-01dabe560ce7 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:14.331944 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1159/2326] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:11:14.337178 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9d861-f3a7-4355-8915-08144ffb931d None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:14.367669 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9d861-f3a7-4355-8915-08144ffb931d None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:14.386084 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804e5b9-1813-4fc3-a688-3e9baadb328c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:14.387787 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804e5b9-1813-4fc3-a688-3e9baadb328c admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:14.388618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804e5b9-1813-4fc3-a688-3e9baadb328c admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:14.390137 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804e5b9-1813-4fc3-a688-3e9baadb328c admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:14.392268 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0804e5b9-1813-4fc3-a688-3e9baadb328c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:14.397783 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0804e5b9-1813-4fc3-a688-3e9baadb328c admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:14.474206 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1168/2327] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:11:14 2022] POST /identity/v3/projects => generated 381 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:11:14.479649 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb01a3-3047-4cca-ae94-01dabe560ce7 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:14.505567 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb01a3-3047-4cca-ae94-01dabe560ce7 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:14.532228 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:14.612193 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbff32f-7fcf-4634-b299-8b9e21929052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:14.612866 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbff32f-7fcf-4634-b299-8b9e21929052 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:14.613150 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbff32f-7fcf-4634-b299-8b9e21929052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:14.613592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbff32f-7fcf-4634-b299-8b9e21929052 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:14.614484 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbff32f-7fcf-4634-b299-8b9e21929052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:14.617650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbff32f-7fcf-4634-b299-8b9e21929052 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:14.663415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1160/2328] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:11:14 2022] POST /identity/v3/users => generated 291 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:11:14.665186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804e5b9-1813-4fc3-a688-3e9baadb328c admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:14.688249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804e5b9-1813-4fc3-a688-3e9baadb328c admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:14.699178 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd26ce-f156-4ac6-bc23-f625bfb8a309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:14.700827 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd26ce-f156-4ac6-bc23-f625bfb8a309 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:14.702815 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd26ce-f156-4ac6-bc23-f625bfb8a309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:14.703647 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd26ce-f156-4ac6-bc23-f625bfb8a309 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:14.705612 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd26ce-f156-4ac6-bc23-f625bfb8a309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:14.709649 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd26ce-f156-4ac6-bc23-f625bfb8a309 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:14.736310 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1169/2329] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:11:14.741011 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbff32f-7fcf-4634-b299-8b9e21929052 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:14.762770 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbff32f-7fcf-4634-b299-8b9e21929052 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:14.772493 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52f049-dc95-42c3-b3a9-c8530a765924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:14.773555 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52f049-dc95-42c3-b3a9-c8530a765924 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:14.774310 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52f049-dc95-42c3-b3a9-c8530a765924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:14.774816 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52f049-dc95-42c3-b3a9-c8530a765924 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:14.775960 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52f049-dc95-42c3-b3a9-c8530a765924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:14.778695 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52f049-dc95-42c3-b3a9-c8530a765924 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:14.809232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1161/2330] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:11:14.814461 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd26ce-f156-4ac6-bc23-f625bfb8a309 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:14.838180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd26ce-f156-4ac6-bc23-f625bfb8a309 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:14.845304 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a451a5f-ff6e-47bf-a110-6fcb3f38fa17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:14.846018 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a451a5f-ff6e-47bf-a110-6fcb3f38fa17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:14.846302 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a451a5f-ff6e-47bf-a110-6fcb3f38fa17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:14.846615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a451a5f-ff6e-47bf-a110-6fcb3f38fa17 admin admin] PATH_INFO: `/v3/projects/78ba2c73b55e43afb6781a68a49a1667/users/19c1ec0372474ff38cfb3e70ba23aca0/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:14.858935 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:14.876177 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a451a5f-ff6e-47bf-a110-6fcb3f38fa17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78ba2c73b55e43afb6781a68a49a1667, user_id=19c1ec0372474ff38cfb3e70ba23aca0, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:14.880447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a451a5f-ff6e-47bf-a110-6fcb3f38fa17 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:14.904292 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1170/2331] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:11:14 2022] PUT /identity/v3/projects/78ba2c73b55e43afb6781a68a49a1667/users/19c1ec0372474ff38cfb3e70ba23aca0/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:11:14.916322 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320682d-c16d-4b8f-87f1-abac09999041 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:14.916617 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320682d-c16d-4b8f-87f1-abac09999041 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:14.916931 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320682d-c16d-4b8f-87f1-abac09999041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:14.956952 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-1320682d-c16d-4b8f-87f1-abac09999041 None None] MFA Rules not processed for user `19c1ec0372474ff38cfb3e70ba23aca0`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:11:14.958255 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-1320682d-c16d-4b8f-87f1-abac09999041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:15.088591 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a451a5f-ff6e-47bf-a110-6fcb3f38fa17 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:15.090064 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1162/2332] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:11:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:11:15.184034 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a451a5f-ff6e-47bf-a110-6fcb3f38fa17 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:15.190771 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1f8ab-7380-437a-99b4-7127453f84b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:15.191423 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1f8ab-7380-437a-99b4-7127453f84b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:15.191722 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1f8ab-7380-437a-99b4-7127453f84b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:15.191977 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1f8ab-7380-437a-99b4-7127453f84b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:15.192663 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1f8ab-7380-437a-99b4-7127453f84b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:15.195154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1f8ab-7380-437a-99b4-7127453f84b2 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:15.246218 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1171/2333] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:11:15 2022] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:11:15.250126 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320682d-c16d-4b8f-87f1-abac09999041 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:15.270681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320682d-c16d-4b8f-87f1-abac09999041 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:15.386808 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1153fb2-68ba-4b5c-a5b4-98611c846d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:15.388747 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1153fb2-68ba-4b5c-a5b4-98611c846d10 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:15.389271 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1153fb2-68ba-4b5c-a5b4-98611c846d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:15.390306 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1153fb2-68ba-4b5c-a5b4-98611c846d10 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:15.391570 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1153fb2-68ba-4b5c-a5b4-98611c846d10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:15.396376 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1153fb2-68ba-4b5c-a5b4-98611c846d10 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:15.439579 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1163/2334] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:11:15 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:11:15.442253 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1f8ab-7380-437a-99b4-7127453f84b2 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:15.465166 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1f8ab-7380-437a-99b4-7127453f84b2 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:15.475189 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96cbdf-a28f-46b3-b9c5-0b19c0f296f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:15.476317 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96cbdf-a28f-46b3-b9c5-0b19c0f296f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:15.477077 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96cbdf-a28f-46b3-b9c5-0b19c0f296f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:15.477583 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96cbdf-a28f-46b3-b9c5-0b19c0f296f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:15.478973 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96cbdf-a28f-46b3-b9c5-0b19c0f296f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:15.483103 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96cbdf-a28f-46b3-b9c5-0b19c0f296f9 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:15.511729 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1172/2335] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:11:15.517369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1153fb2-68ba-4b5c-a5b4-98611c846d10 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:15.549687 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1153fb2-68ba-4b5c-a5b4-98611c846d10 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:15.559203 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9093b37-c60e-4490-bc20-99f873e05132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:15.560679 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9093b37-c60e-4490-bc20-99f873e05132 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:15.560679 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9093b37-c60e-4490-bc20-99f873e05132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:15.561610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9093b37-c60e-4490-bc20-99f873e05132 admin admin] PATH_INFO: `/v3/projects/a1f08b28c0bb44d99f1b0c074c968ed3/users/9982ef125c0848e78dc85fbeb5ed7be1/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:15.598258 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:15.610772 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9093b37-c60e-4490-bc20-99f873e05132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1f08b28c0bb44d99f1b0c074c968ed3, user_id=9982ef125c0848e78dc85fbeb5ed7be1, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:15.618828 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9093b37-c60e-4490-bc20-99f873e05132 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:15.647769 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1164/2336] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:11:15 2022] PUT /identity/v3/projects/a1f08b28c0bb44d99f1b0c074c968ed3/users/9982ef125c0848e78dc85fbeb5ed7be1/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:11:15.652625 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96cbdf-a28f-46b3-b9c5-0b19c0f296f9 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:15.676007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96cbdf-a28f-46b3-b9c5-0b19c0f296f9 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:15.879102 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccf6fd-43a0-43d0-9c48-644c32a0fac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:15.880740 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccf6fd-43a0-43d0-9c48-644c32a0fac4 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:15.881266 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccf6fd-43a0-43d0-9c48-644c32a0fac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:15.881759 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccf6fd-43a0-43d0-9c48-644c32a0fac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:15.884354 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ccf6fd-43a0-43d0-9c48-644c32a0fac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:15.886584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ccf6fd-43a0-43d0-9c48-644c32a0fac4 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:15.901983 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1173/2337] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:11:15.906969 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9093b37-c60e-4490-bc20-99f873e05132 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:15.919719 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9093b37-c60e-4490-bc20-99f873e05132 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:15.926572 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f8c2b-b45f-43dd-9a8e-76ccd14dd399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:15.927735 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f8c2b-b45f-43dd-9a8e-76ccd14dd399 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:15.928254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f8c2b-b45f-43dd-9a8e-76ccd14dd399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:15.928752 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f8c2b-b45f-43dd-9a8e-76ccd14dd399 admin admin] PATH_INFO: `/v3/projects/a1f08b28c0bb44d99f1b0c074c968ed3/users/9982ef125c0848e78dc85fbeb5ed7be1/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:15.931771 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f8c2b-b45f-43dd-9a8e-76ccd14dd399 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1f08b28c0bb44d99f1b0c074c968ed3, user_id=9982ef125c0848e78dc85fbeb5ed7be1, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:15.935053 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f8c2b-b45f-43dd-9a8e-76ccd14dd399 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:15.963986 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1165/2338] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:11:15 2022] PUT /identity/v3/projects/a1f08b28c0bb44d99f1b0c074c968ed3/users/9982ef125c0848e78dc85fbeb5ed7be1/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:11:15.976731 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fede451-6b27-40b1-9bb4-4c20c87768a2 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:15.977099 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fede451-6b27-40b1-9bb4-4c20c87768a2 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:15.977311 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fede451-6b27-40b1-9bb4-4c20c87768a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:16.027452 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-3fede451-6b27-40b1-9bb4-4c20c87768a2 None None] MFA Rules not processed for user `9982ef125c0848e78dc85fbeb5ed7be1`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:11:16.029451 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-3fede451-6b27-40b1-9bb4-4c20c87768a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:16.098299 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:16.150402 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1174/2339] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:11:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:11:16.160845 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f8c2b-b45f-43dd-9a8e-76ccd14dd399 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:16.162737 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-670f8c2b-b45f-43dd-9a8e-76ccd14dd399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:16.251359 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f8c2b-b45f-43dd-9a8e-76ccd14dd399 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:16.255414 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf388c18-3801-46b1-bd4e-1d7cd2a65dee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:16.256063 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf388c18-3801-46b1-bd4e-1d7cd2a65dee service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:16.256349 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf388c18-3801-46b1-bd4e-1d7cd2a65dee service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:16.256626 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf388c18-3801-46b1-bd4e-1d7cd2a65dee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:16.268650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf388c18-3801-46b1-bd4e-1d7cd2a65dee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:16.271380 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf388c18-3801-46b1-bd4e-1d7cd2a65dee service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:16.283893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1166/2340] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:11:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:11:16.382889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fede451-6b27-40b1-9bb4-4c20c87768a2 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:16.400112 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fede451-6b27-40b1-9bb4-4c20c87768a2 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:16.410804 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1beb19-1a38-41f9-be21-e55037224e76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:16.412162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1beb19-1a38-41f9-be21-e55037224e76 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:16.412803 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1beb19-1a38-41f9-be21-e55037224e76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:16.413438 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1beb19-1a38-41f9-be21-e55037224e76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:16.514862 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1beb19-1a38-41f9-be21-e55037224e76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:16.516672 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1beb19-1a38-41f9-be21-e55037224e76 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:16.527815 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1175/2341] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:11:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:11:19.263773 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f67e9-b415-4b52-b8b7-ba06ff531e07 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:19.265163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f67e9-b415-4b52-b8b7-ba06ff531e07 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:19.265163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f67e9-b415-4b52-b8b7-ba06ff531e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:19.303620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-6c9f67e9-b415-4b52-b8b7-ba06ff531e07 None None] MFA Rules not processed for user `81a7cc8bd9ef48e6b97213cd71e4ca36`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:11:19.305183 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-6c9f67e9-b415-4b52-b8b7-ba06ff531e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:19.432645 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1167/2342] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:11:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:11:19.439636 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1beb19-1a38-41f9-be21-e55037224e76 service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:19.441410 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fa1beb19-1a38-41f9-be21-e55037224e76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:19.582745 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1beb19-1a38-41f9-be21-e55037224e76 service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:19.591891 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609773e-aa67-4ce5-9f30-44ce86c250d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:19.593364 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609773e-aa67-4ce5-9f30-44ce86c250d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:19.593784 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609773e-aa67-4ce5-9f30-44ce86c250d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:19.594199 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609773e-aa67-4ce5-9f30-44ce86c250d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:19.595980 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609773e-aa67-4ce5-9f30-44ce86c250d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:19.598084 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609773e-aa67-4ce5-9f30-44ce86c250d0 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:19.661688 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1176/2343] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:11:19 2022] POST /identity/v3/projects => generated 371 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:11:19.667513 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f67e9-b415-4b52-b8b7-ba06ff531e07 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:19.692869 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f67e9-b415-4b52-b8b7-ba06ff531e07 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:19.796833 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c77a74-ac4d-45f1-a384-04d58ed614c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:19.797539 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c77a74-ac4d-45f1-a384-04d58ed614c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:19.797823 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c77a74-ac4d-45f1-a384-04d58ed614c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:19.798100 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c77a74-ac4d-45f1-a384-04d58ed614c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:19.798998 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c77a74-ac4d-45f1-a384-04d58ed614c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:19.801173 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c77a74-ac4d-45f1-a384-04d58ed614c5 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:19.823592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:19.846457 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1168/2344] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:11:19 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:11:19.853350 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609773e-aa67-4ce5-9f30-44ce86c250d0 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:19.868640 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609773e-aa67-4ce5-9f30-44ce86c250d0 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:19.874799 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb7e35-e86e-4a4d-8ef0-bc8d823de840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:19.875447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb7e35-e86e-4a4d-8ef0-bc8d823de840 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:19.876834 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb7e35-e86e-4a4d-8ef0-bc8d823de840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:19.876834 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb7e35-e86e-4a4d-8ef0-bc8d823de840 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:19.876834 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb7e35-e86e-4a4d-8ef0-bc8d823de840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:19.878553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb7e35-e86e-4a4d-8ef0-bc8d823de840 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:19.893526 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1177/2345] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:11:19.898862 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c77a74-ac4d-45f1-a384-04d58ed614c5 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:19.927029 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c77a74-ac4d-45f1-a384-04d58ed614c5 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:19.937415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad182d1-4933-40a3-a92d-51a777958d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:19.939276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad182d1-4933-40a3-a92d-51a777958d8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:19.939276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad182d1-4933-40a3-a92d-51a777958d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:19.939276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad182d1-4933-40a3-a92d-51a777958d8b admin admin] PATH_INFO: `/v3/projects/590e1fb5884744d687ff1a5bacc51b04/users/1c5df1ae39f846c5a186c5f03dcb151e/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:19.964998 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad182d1-4933-40a3-a92d-51a777958d8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=590e1fb5884744d687ff1a5bacc51b04, user_id=1c5df1ae39f846c5a186c5f03dcb151e, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:19.969904 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad182d1-4933-40a3-a92d-51a777958d8b admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:19.998565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1169/2346] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:11:19 2022] PUT /identity/v3/projects/590e1fb5884744d687ff1a5bacc51b04/users/1c5df1ae39f846c5a186c5f03dcb151e/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:11:20.005071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb7e35-e86e-4a4d-8ef0-bc8d823de840 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:20.026814 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb7e35-e86e-4a4d-8ef0-bc8d823de840 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:20.126144 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:20.135564 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689d2cd-0de5-46c2-9c7e-1c0e2cad926a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:20.136205 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689d2cd-0de5-46c2-9c7e-1c0e2cad926a admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:20.136483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689d2cd-0de5-46c2-9c7e-1c0e2cad926a admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:20.136917 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689d2cd-0de5-46c2-9c7e-1c0e2cad926a admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:20.137650 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689d2cd-0de5-46c2-9c7e-1c0e2cad926a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:20.139600 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689d2cd-0de5-46c2-9c7e-1c0e2cad926a admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:20.151589 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1178/2347] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:11:20.155975 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad182d1-4933-40a3-a92d-51a777958d8b admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:20.167045 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad182d1-4933-40a3-a92d-51a777958d8b admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:20.173407 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ab81b-01dc-46ff-9b65-232ed518eb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:20.174134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ab81b-01dc-46ff-9b65-232ed518eb5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:20.174433 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ab81b-01dc-46ff-9b65-232ed518eb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:20.174707 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ab81b-01dc-46ff-9b65-232ed518eb5b admin admin] PATH_INFO: `/v3/projects/590e1fb5884744d687ff1a5bacc51b04/users/1c5df1ae39f846c5a186c5f03dcb151e/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:20.176856 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ab81b-01dc-46ff-9b65-232ed518eb5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=590e1fb5884744d687ff1a5bacc51b04, user_id=1c5df1ae39f846c5a186c5f03dcb151e, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:20.179830 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ab81b-01dc-46ff-9b65-232ed518eb5b admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:20.194930 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1170/2348] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:11:20 2022] PUT /identity/v3/projects/590e1fb5884744d687ff1a5bacc51b04/users/1c5df1ae39f846c5a186c5f03dcb151e/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:11:24.927368 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689d2cd-0de5-46c2-9c7e-1c0e2cad926a admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:24.939645 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689d2cd-0de5-46c2-9c7e-1c0e2cad926a admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:25.029550 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec45f04-47a8-4bb1-a700-6655f3dfed00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:25.030892 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec45f04-47a8-4bb1-a700-6655f3dfed00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:25.032056 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec45f04-47a8-4bb1-a700-6655f3dfed00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:25.032056 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec45f04-47a8-4bb1-a700-6655f3dfed00 admin admin] PATH_INFO: `/v3/users/19c1ec0372474ff38cfb3e70ba23aca0` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:25.033071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec45f04-47a8-4bb1-a700-6655f3dfed00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19c1ec0372474ff38cfb3e70ba23aca0)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:25.035550 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec45f04-47a8-4bb1-a700-6655f3dfed00 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:25.099240 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-eec45f04-47a8-4bb1-a700-6655f3dfed00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19c1ec0372474ff38cfb3e70ba23aca0'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:25.110623 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-eec45f04-47a8-4bb1-a700-6655f3dfed00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19c1ec0372474ff38cfb3e70ba23aca0'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:25.111756 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-eec45f04-47a8-4bb1-a700-6655f3dfed00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19c1ec0372474ff38cfb3e70ba23aca0'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:25.135442 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-eec45f04-47a8-4bb1-a700-6655f3dfed00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19c1ec0372474ff38cfb3e70ba23aca0'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:25.136372 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-eec45f04-47a8-4bb1-a700-6655f3dfed00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19c1ec0372474ff38cfb3e70ba23aca0'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:25.159195 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1179/2349] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:11:24 2022] DELETE /identity/v3/users/19c1ec0372474ff38cfb3e70ba23aca0 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:11:25.165973 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea472e7-5d08-4d5c-8ce3-b64c897f5a7d None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:25.166951 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea472e7-5d08-4d5c-8ce3-b64c897f5a7d None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:25.167409 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea472e7-5d08-4d5c-8ce3-b64c897f5a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:25.196030 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-1ea472e7-5d08-4d5c-8ce3-b64c897f5a7d None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:11:25.198099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-1ea472e7-5d08-4d5c-8ce3-b64c897f5a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:25.305443 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1171/2350] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:11:25.315357 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec45f04-47a8-4bb1-a700-6655f3dfed00 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:25.319651 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-eec45f04-47a8-4bb1-a700-6655f3dfed00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:25.547668 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec45f04-47a8-4bb1-a700-6655f3dfed00 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:25.555393 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa87fdc-4906-41d9-ad04-fa9deb23851a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:25.556648 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa87fdc-4906-41d9-ad04-fa9deb23851a service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:25.557337 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa87fdc-4906-41d9-ad04-fa9deb23851a service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:25.557916 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa87fdc-4906-41d9-ad04-fa9deb23851a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:25.582016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa87fdc-4906-41d9-ad04-fa9deb23851a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:25.586802 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa87fdc-4906-41d9-ad04-fa9deb23851a service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:25.657152 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1180/2351] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:11:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:11:26.386036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea472e7-5d08-4d5c-8ce3-b64c897f5a7d None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:26.389091 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-1ea472e7-5d08-4d5c-8ce3-b64c897f5a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:26.442284 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea472e7-5d08-4d5c-8ce3-b64c897f5a7d None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:26.454051 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d7d0a-3bce-43bd-897e-8035f9312841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:26.455524 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d7d0a-3bce-43bd-897e-8035f9312841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:26.456432 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d7d0a-3bce-43bd-897e-8035f9312841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:26.457133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d7d0a-3bce-43bd-897e-8035f9312841 admin admin] PATH_INFO: `/v3/projects/78ba2c73b55e43afb6781a68a49a1667` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:26.460746 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d7d0a-3bce-43bd-897e-8035f9312841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78ba2c73b55e43afb6781a68a49a1667)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:26.465600 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d7d0a-3bce-43bd-897e-8035f9312841 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:26.624853 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-818d7d0a-3bce-43bd-897e-8035f9312841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78ba2c73b55e43afb6781a68a49a1667', 'request_id': 'req-818d7d0a-3bce-43bd-897e-8035f9312841'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:26.636460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-818d7d0a-3bce-43bd-897e-8035f9312841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78ba2c73b55e43afb6781a68a49a1667', 'request_id': 'req-818d7d0a-3bce-43bd-897e-8035f9312841'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:26.648978 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-818d7d0a-3bce-43bd-897e-8035f9312841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78ba2c73b55e43afb6781a68a49a1667', 'request_id': 'req-818d7d0a-3bce-43bd-897e-8035f9312841'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:26.666440 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-818d7d0a-3bce-43bd-897e-8035f9312841 admin admin] The token cache is being invalidate because project 78ba2c73b55e43afb6781a68a49a1667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:11:26.667285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-818d7d0a-3bce-43bd-897e-8035f9312841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:26.668651 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-818d7d0a-3bce-43bd-897e-8035f9312841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:26.672093 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1172/2352] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:11:26 2022] DELETE /identity/v3/projects/78ba2c73b55e43afb6781a68a49a1667 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:11:26.677393 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa87fdc-4906-41d9-ad04-fa9deb23851a service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:26.689085 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa87fdc-4906-41d9-ad04-fa9deb23851a service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:26.705808 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:26.740823 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820c8d6-9ccf-4cda-9f7f-60b9de6b4cf3 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:26.741437 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820c8d6-9ccf-4cda-9f7f-60b9de6b4cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:26.741683 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820c8d6-9ccf-4cda-9f7f-60b9de6b4cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:26.798870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed446feb-bf5e-4824-9675-f7fef84b1dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:26.799782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed446feb-bf5e-4824-9675-f7fef84b1dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:26.800165 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed446feb-bf5e-4824-9675-f7fef84b1dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:26.800548 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed446feb-bf5e-4824-9675-f7fef84b1dee admin admin] PATH_INFO: `/v3/users/9982ef125c0848e78dc85fbeb5ed7be1` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:26.802022 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed446feb-bf5e-4824-9675-f7fef84b1dee admin admin] RBAC: Authorizing `identity:delete_user(user_id=9982ef125c0848e78dc85fbeb5ed7be1)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:26.805391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed446feb-bf5e-4824-9675-f7fef84b1dee admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:26.806544 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-f820c8d6-9ccf-4cda-9f7f-60b9de6b4cf3 None None] MFA Rules not processed for user `1c5df1ae39f846c5a186c5f03dcb151e`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:11:26.808819 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-f820c8d6-9ccf-4cda-9f7f-60b9de6b4cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:26.882634 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:26.898339 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-ed446feb-bf5e-4824-9675-f7fef84b1dee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9982ef125c0848e78dc85fbeb5ed7be1'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:26.913699 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-ed446feb-bf5e-4824-9675-f7fef84b1dee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9982ef125c0848e78dc85fbeb5ed7be1'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:26.915257 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-ed446feb-bf5e-4824-9675-f7fef84b1dee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9982ef125c0848e78dc85fbeb5ed7be1'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:26.938767 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-ed446feb-bf5e-4824-9675-f7fef84b1dee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9982ef125c0848e78dc85fbeb5ed7be1'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:26.940133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-ed446feb-bf5e-4824-9675-f7fef84b1dee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9982ef125c0848e78dc85fbeb5ed7be1'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:26.951043 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1173/2353] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:11:26 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:11:26.967414 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820c8d6-9ccf-4cda-9f7f-60b9de6b4cf3 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:26.970211 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-f820c8d6-9ccf-4cda-9f7f-60b9de6b4cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:26.982382 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1181/2354] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:11:26 2022] DELETE /identity/v3/users/9982ef125c0848e78dc85fbeb5ed7be1 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:11:27.110569 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820c8d6-9ccf-4cda-9f7f-60b9de6b4cf3 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:27.261849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd2d39-3b4a-451a-b93f-834cacaf4dd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:27.263112 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd2d39-3b4a-451a-b93f-834cacaf4dd6 service nova] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:27.263688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd2d39-3b4a-451a-b93f-834cacaf4dd6 service nova] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:27.264188 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd2d39-3b4a-451a-b93f-834cacaf4dd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:27.268330 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-30fd2d39-3b4a-451a-b93f-834cacaf4dd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:27.374945 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd2d39-3b4a-451a-b93f-834cacaf4dd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:27.379143 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd2d39-3b4a-451a-b93f-834cacaf4dd6 service nova] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:27.399426 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1174/2355] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:11:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:11:27.445717 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed446feb-bf5e-4824-9675-f7fef84b1dee admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:27.448118 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ed446feb-bf5e-4824-9675-f7fef84b1dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:27.580044 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed446feb-bf5e-4824-9675-f7fef84b1dee admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:27.586938 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e186edf-eb52-4706-9f84-9507bb830119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:27.588034 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e186edf-eb52-4706-9f84-9507bb830119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:27.588564 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e186edf-eb52-4706-9f84-9507bb830119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:27.589592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e186edf-eb52-4706-9f84-9507bb830119 admin admin] PATH_INFO: `/v3/projects/a1f08b28c0bb44d99f1b0c074c968ed3` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:27.591834 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e186edf-eb52-4706-9f84-9507bb830119 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1f08b28c0bb44d99f1b0c074c968ed3)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:27.595261 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e186edf-eb52-4706-9f84-9507bb830119 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:27.694423 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:27.716434 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9e186edf-eb52-4706-9f84-9507bb830119 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1f08b28c0bb44d99f1b0c074c968ed3', 'request_id': 'req-9e186edf-eb52-4706-9f84-9507bb830119'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:27.729444 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9e186edf-eb52-4706-9f84-9507bb830119 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1f08b28c0bb44d99f1b0c074c968ed3', 'request_id': 'req-9e186edf-eb52-4706-9f84-9507bb830119'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:27.740085 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9e186edf-eb52-4706-9f84-9507bb830119 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1f08b28c0bb44d99f1b0c074c968ed3', 'request_id': 'req-9e186edf-eb52-4706-9f84-9507bb830119'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:27.766199 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9e186edf-eb52-4706-9f84-9507bb830119 admin admin] The token cache is being invalidate because project a1f08b28c0bb44d99f1b0c074c968ed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:11:27.766531 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9e186edf-eb52-4706-9f84-9507bb830119 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:27.768057 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9e186edf-eb52-4706-9f84-9507bb830119 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:27.777007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1182/2356] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:11:27 2022] DELETE /identity/v3/projects/a1f08b28c0bb44d99f1b0c074c968ed3 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:11:27.781453 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3efe71-f0e3-4b3e-8a7c-c72680242bf2 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:27.782056 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3efe71-f0e3-4b3e-8a7c-c72680242bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:27.782056 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3efe71-f0e3-4b3e-8a7c-c72680242bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:27.833268 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:27.845499 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-1a3efe71-f0e3-4b3e-8a7c-c72680242bf2 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:11:27.848138 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-1a3efe71-f0e3-4b3e-8a7c-c72680242bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:28.007619 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1175/2357] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:11:28.023441 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418cbc2-6745-4567-b74b-dbc4802b6db8 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:28.023726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418cbc2-6745-4567-b74b-dbc4802b6db8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:28.025013 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418cbc2-6745-4567-b74b-dbc4802b6db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:28.047146 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-4418cbc2-6745-4567-b74b-dbc4802b6db8 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:11:28.048471 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4418cbc2-6745-4567-b74b-dbc4802b6db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:28.083655 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1183/2358] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:11:28.090439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3efe71-f0e3-4b3e-8a7c-c72680242bf2 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:28.118103 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3efe71-f0e3-4b3e-8a7c-c72680242bf2 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:28.133557 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f69bcb-3d15-49ab-a6c8-41bfa6e0b760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:28.135904 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f69bcb-3d15-49ab-a6c8-41bfa6e0b760 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:28.137748 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f69bcb-3d15-49ab-a6c8-41bfa6e0b760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:28.140607 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f69bcb-3d15-49ab-a6c8-41bfa6e0b760 admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:28.141926 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f69bcb-3d15-49ab-a6c8-41bfa6e0b760 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:11:28.144218 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f69bcb-3d15-49ab-a6c8-41bfa6e0b760 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:28.151278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f69bcb-3d15-49ab-a6c8-41bfa6e0b760 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:28.183428 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1176/2359] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:11:28.190572 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418cbc2-6745-4567-b74b-dbc4802b6db8 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:28.203340 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418cbc2-6745-4567-b74b-dbc4802b6db8 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:28.210966 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae93284-b851-4ec9-86bc-784f779b3db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:28.211694 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae93284-b851-4ec9-86bc-784f779b3db0 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:28.211975 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae93284-b851-4ec9-86bc-784f779b3db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:28.212249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae93284-b851-4ec9-86bc-784f779b3db0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:28.212982 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae93284-b851-4ec9-86bc-784f779b3db0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:28.215271 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae93284-b851-4ec9-86bc-784f779b3db0 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:28.274226 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1184/2360] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:11:28 2022] POST /identity/v3/projects => generated 365 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:11:28.276454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f69bcb-3d15-49ab-a6c8-41bfa6e0b760 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:28.297409 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f69bcb-3d15-49ab-a6c8-41bfa6e0b760 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:28.403831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84a2be-46d6-48b5-829e-cd53943a1685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:28.405845 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84a2be-46d6-48b5-829e-cd53943a1685 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:28.406180 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84a2be-46d6-48b5-829e-cd53943a1685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:28.407023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84a2be-46d6-48b5-829e-cd53943a1685 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:28.408609 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84a2be-46d6-48b5-829e-cd53943a1685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:28.414000 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84a2be-46d6-48b5-829e-cd53943a1685 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:28.470412 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1177/2361] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:11:28 2022] POST /identity/v3/users => generated 283 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:11:28.474157 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae93284-b851-4ec9-86bc-784f779b3db0 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:28.487242 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae93284-b851-4ec9-86bc-784f779b3db0 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:28.493585 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7b6e3-5857-49fe-9991-edf77134a71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:28.494565 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7b6e3-5857-49fe-9991-edf77134a71c admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:28.495108 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7b6e3-5857-49fe-9991-edf77134a71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:28.495520 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7b6e3-5857-49fe-9991-edf77134a71c admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:28.496924 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7b6e3-5857-49fe-9991-edf77134a71c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:28.498791 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7b6e3-5857-49fe-9991-edf77134a71c admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:28.517660 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1185/2362] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:11:28.519835 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84a2be-46d6-48b5-829e-cd53943a1685 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:28.537765 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84a2be-46d6-48b5-829e-cd53943a1685 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:28.544096 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cab98-1a17-4933-a0c0-27cca7b1833e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:28.544877 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cab98-1a17-4933-a0c0-27cca7b1833e admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:28.545457 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cab98-1a17-4933-a0c0-27cca7b1833e admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:28.545649 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cab98-1a17-4933-a0c0-27cca7b1833e admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:28.546905 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549cab98-1a17-4933-a0c0-27cca7b1833e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:28.551035 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549cab98-1a17-4933-a0c0-27cca7b1833e admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:28.567721 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1178/2363] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:11:28.571257 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7b6e3-5857-49fe-9991-edf77134a71c admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:28.584455 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7b6e3-5857-49fe-9991-edf77134a71c admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:28.591592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4afbc-c339-48b6-9482-378669119e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:28.592527 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4afbc-c339-48b6-9482-378669119e35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:28.593695 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4afbc-c339-48b6-9482-378669119e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:28.594163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4afbc-c339-48b6-9482-378669119e35 admin admin] PATH_INFO: `/v3/projects/7f4d55ccf2cd4327be684029b03f921f/users/ec4ed8ef211a407a9e024a1ca0ff2373/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:28.633308 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d4afbc-c339-48b6-9482-378669119e35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4d55ccf2cd4327be684029b03f921f, user_id=ec4ed8ef211a407a9e024a1ca0ff2373, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:28.637996 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d4afbc-c339-48b6-9482-378669119e35 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:28.665381 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1186/2364] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:11:28 2022] PUT /identity/v3/projects/7f4d55ccf2cd4327be684029b03f921f/users/ec4ed8ef211a407a9e024a1ca0ff2373/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:11:28.667470 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb486de-ea2c-4d36-beef-f216d354d718 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:28.667889 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb486de-ea2c-4d36-beef-f216d354d718 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:28.668268 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb486de-ea2c-4d36-beef-f216d354d718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:28.706827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-cdb486de-ea2c-4d36-beef-f216d354d718 None None] MFA Rules not processed for user `ec4ed8ef211a407a9e024a1ca0ff2373`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:11:28.708193 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-cdb486de-ea2c-4d36-beef-f216d354d718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:28.810955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1179/2365] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:11:28 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:11:28.814043 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4afbc-c339-48b6-9482-378669119e35 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:29.024754 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4afbc-c339-48b6-9482-378669119e35 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:29.034569 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c6449-5925-4588-a352-8c4a33a18714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:29.036035 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c6449-5925-4588-a352-8c4a33a18714 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:29.036417 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c6449-5925-4588-a352-8c4a33a18714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:29.036932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c6449-5925-4588-a352-8c4a33a18714 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:29.037920 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c6449-5925-4588-a352-8c4a33a18714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:29.040976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c6449-5925-4588-a352-8c4a33a18714 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:29.097673 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1187/2366] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:11:28 2022] POST /identity/v3/projects => generated 363 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:11:29.098677 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb486de-ea2c-4d36-beef-f216d354d718 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:29.109551 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:29.119820 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb486de-ea2c-4d36-beef-f216d354d718 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:29.236403 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823ba43-139d-4f7b-97f3-9e21cc4e2c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:29.237296 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823ba43-139d-4f7b-97f3-9e21cc4e2c5d admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:29.237776 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823ba43-139d-4f7b-97f3-9e21cc4e2c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:29.238144 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823ba43-139d-4f7b-97f3-9e21cc4e2c5d admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:29.239474 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823ba43-139d-4f7b-97f3-9e21cc4e2c5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:29.243525 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823ba43-139d-4f7b-97f3-9e21cc4e2c5d admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:29.278887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1180/2367] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:11:29 2022] POST /identity/v3/users => generated 288 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:11:29.287348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c6449-5925-4588-a352-8c4a33a18714 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:29.313164 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c6449-5925-4588-a352-8c4a33a18714 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:29.331694 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165380c8-f6c9-46d6-ada4-8d88463f7da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:29.332775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165380c8-f6c9-46d6-ada4-8d88463f7da9 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:29.333263 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165380c8-f6c9-46d6-ada4-8d88463f7da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:29.333771 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165380c8-f6c9-46d6-ada4-8d88463f7da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:29.335146 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165380c8-f6c9-46d6-ada4-8d88463f7da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:29.338278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165380c8-f6c9-46d6-ada4-8d88463f7da9 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:29.362695 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1188/2368] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:11:29.367800 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823ba43-139d-4f7b-97f3-9e21cc4e2c5d admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:29.388142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823ba43-139d-4f7b-97f3-9e21cc4e2c5d admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:29.396969 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c83c0c-4300-4f8a-9535-cbf258e6c598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:29.398104 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c83c0c-4300-4f8a-9535-cbf258e6c598 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:29.398616 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c83c0c-4300-4f8a-9535-cbf258e6c598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:29.399057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c83c0c-4300-4f8a-9535-cbf258e6c598 admin admin] PATH_INFO: `/v3/projects/d214e37026fe42f6af5384fc4e3f8f8d/users/da497422ece143bc84ce21e4094e9bd7/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:29.428405 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c83c0c-4300-4f8a-9535-cbf258e6c598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d214e37026fe42f6af5384fc4e3f8f8d, user_id=da497422ece143bc84ce21e4094e9bd7, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:29.431637 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c83c0c-4300-4f8a-9535-cbf258e6c598 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:29.453170 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1181/2369] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:11:29 2022] PUT /identity/v3/projects/d214e37026fe42f6af5384fc4e3f8f8d/users/da497422ece143bc84ce21e4094e9bd7/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:11:29.459137 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165380c8-f6c9-46d6-ada4-8d88463f7da9 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:29.478561 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165380c8-f6c9-46d6-ada4-8d88463f7da9 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:29.537950 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:29.628942 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececa8dd-c94f-403f-a486-74043f997d59 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:29.629320 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececa8dd-c94f-403f-a486-74043f997d59 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:29.629642 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececa8dd-c94f-403f-a486-74043f997d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:29.643619 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48055e7-3701-4252-b158-5c47689ac3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:29.644933 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48055e7-3701-4252-b158-5c47689ac3fa admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:29.645954 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48055e7-3701-4252-b158-5c47689ac3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:29.645954 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48055e7-3701-4252-b158-5c47689ac3fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:29.647370 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48055e7-3701-4252-b158-5c47689ac3fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:29.650818 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48055e7-3701-4252-b158-5c47689ac3fa admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:29.666606 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-ececa8dd-c94f-403f-a486-74043f997d59 None None] MFA Rules not processed for user `81a7cc8bd9ef48e6b97213cd71e4ca36`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:11:29.667909 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-ececa8dd-c94f-403f-a486-74043f997d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:29.673424 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1189/2370] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:11:29.681609 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48055e7-3701-4252-b158-5c47689ac3fa admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:29.704254 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48055e7-3701-4252-b158-5c47689ac3fa admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:29.711757 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edf9fc-371f-4da9-ab32-df4b2c5f04f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:29.713874 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edf9fc-371f-4da9-ab32-df4b2c5f04f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:29.714377 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edf9fc-371f-4da9-ab32-df4b2c5f04f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:29.715066 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edf9fc-371f-4da9-ab32-df4b2c5f04f7 admin admin] PATH_INFO: `/v3/projects/d214e37026fe42f6af5384fc4e3f8f8d/users/da497422ece143bc84ce21e4094e9bd7/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:29.719441 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edf9fc-371f-4da9-ab32-df4b2c5f04f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d214e37026fe42f6af5384fc4e3f8f8d, user_id=da497422ece143bc84ce21e4094e9bd7, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:29.722772 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edf9fc-371f-4da9-ab32-df4b2c5f04f7 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:29.754981 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1190/2371] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:11:29 2022] PUT /identity/v3/projects/d214e37026fe42f6af5384fc4e3f8f8d/users/da497422ece143bc84ce21e4094e9bd7/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:11:29.760905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338abfe-0d0e-4bde-9d89-4929e05dda42 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:29.761198 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338abfe-0d0e-4bde-9d89-4929e05dda42 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:29.761477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338abfe-0d0e-4bde-9d89-4929e05dda42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:29.768855 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1182/2372] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:11:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:11:29.828810 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-4338abfe-0d0e-4bde-9d89-4929e05dda42 None None] MFA Rules not processed for user `da497422ece143bc84ce21e4094e9bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:11:29.832095 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4338abfe-0d0e-4bde-9d89-4929e05dda42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:29.992254 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1191/2373] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:11:29 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:11:30.012781 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececa8dd-c94f-403f-a486-74043f997d59 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:30.015465 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-ececa8dd-c94f-403f-a486-74043f997d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:30.139954 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececa8dd-c94f-403f-a486-74043f997d59 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:30.184615 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:30.219789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0396fad-41c8-4c8c-8e66-f56395db62ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:30.220333 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0396fad-41c8-4c8c-8e66-f56395db62ca service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:30.220637 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0396fad-41c8-4c8c-8e66-f56395db62ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:30.220914 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0396fad-41c8-4c8c-8e66-f56395db62ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:30.232223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0396fad-41c8-4c8c-8e66-f56395db62ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:30.234329 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0396fad-41c8-4c8c-8e66-f56395db62ca service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:30.246394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1183/2374] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:11:30 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:11:30.429234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338abfe-0d0e-4bde-9d89-4929e05dda42 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:30.459067 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338abfe-0d0e-4bde-9d89-4929e05dda42 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:30.466689 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781334f-d7bc-43ab-a1ed-72f331344717 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:30.468466 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781334f-d7bc-43ab-a1ed-72f331344717 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:30.469256 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781334f-d7bc-43ab-a1ed-72f331344717 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:30.469940 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781334f-d7bc-43ab-a1ed-72f331344717 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:30.557251 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e781334f-d7bc-43ab-a1ed-72f331344717 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:30.558276 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e781334f-d7bc-43ab-a1ed-72f331344717 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:30.570600 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1192/2375] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:11:30 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:11:38.909300 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0396fad-41c8-4c8c-8e66-f56395db62ca service cinder] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:39.006103 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0396fad-41c8-4c8c-8e66-f56395db62ca service cinder] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:39.014358 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b3745-4876-4464-8db6-1a512e3b8374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:39.016397 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b3745-4876-4464-8db6-1a512e3b8374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:39.016755 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b3745-4876-4464-8db6-1a512e3b8374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:39.017222 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b3745-4876-4464-8db6-1a512e3b8374 admin admin] PATH_INFO: `/v3/users/ec4ed8ef211a407a9e024a1ca0ff2373` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:39.019638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b3745-4876-4464-8db6-1a512e3b8374 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec4ed8ef211a407a9e024a1ca0ff2373)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:39.023757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b3745-4876-4464-8db6-1a512e3b8374 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:39.123936 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-940b3745-4876-4464-8db6-1a512e3b8374 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec4ed8ef211a407a9e024a1ca0ff2373'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:39.125890 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-940b3745-4876-4464-8db6-1a512e3b8374 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec4ed8ef211a407a9e024a1ca0ff2373'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:39.126924 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-940b3745-4876-4464-8db6-1a512e3b8374 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec4ed8ef211a407a9e024a1ca0ff2373'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:39.139392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-940b3745-4876-4464-8db6-1a512e3b8374 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec4ed8ef211a407a9e024a1ca0ff2373'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:39.157855 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-940b3745-4876-4464-8db6-1a512e3b8374 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec4ed8ef211a407a9e024a1ca0ff2373'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:39.182712 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1184/2376] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:11:38 2022] DELETE /identity/v3/users/ec4ed8ef211a407a9e024a1ca0ff2373 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:11:39.188737 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f73f0-e129-4064-a705-e1ef92bbd0da None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:39.189444 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f73f0-e129-4064-a705-e1ef92bbd0da None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:39.189444 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f73f0-e129-4064-a705-e1ef92bbd0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:39.212764 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-893f73f0-e129-4064-a705-e1ef92bbd0da None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:11:39.214451 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-893f73f0-e129-4064-a705-e1ef92bbd0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:39.261211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:39.299337 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1193/2377] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:11:39.311785 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b3745-4876-4464-8db6-1a512e3b8374 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:39.314039 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-940b3745-4876-4464-8db6-1a512e3b8374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:39.399033 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b3745-4876-4464-8db6-1a512e3b8374 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:39.403116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bad2b-b569-4e33-a92e-6b0303aaefcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:39.403881 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bad2b-b569-4e33-a92e-6b0303aaefcf service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:39.404260 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bad2b-b569-4e33-a92e-6b0303aaefcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:39.404632 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bad2b-b569-4e33-a92e-6b0303aaefcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:39.412908 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:39.418958 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bad2b-b569-4e33-a92e-6b0303aaefcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:39.420642 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bad2b-b569-4e33-a92e-6b0303aaefcf service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:39.435537 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1185/2378] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:11:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:11:39.884094 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f73f0-e129-4064-a705-e1ef92bbd0da None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:39.886934 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-893f73f0-e129-4064-a705-e1ef92bbd0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:39.902764 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f73f0-e129-4064-a705-e1ef92bbd0da None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:39.913381 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad93d01-d7ed-48b9-b932-cc34dd953284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:39.914478 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad93d01-d7ed-48b9-b932-cc34dd953284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:39.914854 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad93d01-d7ed-48b9-b932-cc34dd953284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:39.915267 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad93d01-d7ed-48b9-b932-cc34dd953284 admin admin] PATH_INFO: `/v3/projects/7f4d55ccf2cd4327be684029b03f921f` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:39.916916 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad93d01-d7ed-48b9-b932-cc34dd953284 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f4d55ccf2cd4327be684029b03f921f)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:39.919102 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad93d01-d7ed-48b9-b932-cc34dd953284 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:40.007776 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-aad93d01-d7ed-48b9-b932-cc34dd953284 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f4d55ccf2cd4327be684029b03f921f', 'request_id': 'req-aad93d01-d7ed-48b9-b932-cc34dd953284'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:40.017214 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-aad93d01-d7ed-48b9-b932-cc34dd953284 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f4d55ccf2cd4327be684029b03f921f', 'request_id': 'req-aad93d01-d7ed-48b9-b932-cc34dd953284'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:40.024678 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-aad93d01-d7ed-48b9-b932-cc34dd953284 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f4d55ccf2cd4327be684029b03f921f', 'request_id': 'req-aad93d01-d7ed-48b9-b932-cc34dd953284'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:40.044123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-aad93d01-d7ed-48b9-b932-cc34dd953284 admin admin] The token cache is being invalidate because project 7f4d55ccf2cd4327be684029b03f921f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:11:40.044604 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-aad93d01-d7ed-48b9-b932-cc34dd953284 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:40.045785 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-aad93d01-d7ed-48b9-b932-cc34dd953284 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:40.048747 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1194/2379] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:11:39 2022] DELETE /identity/v3/projects/7f4d55ccf2cd4327be684029b03f921f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:11:40.053734 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bad2b-b569-4e33-a92e-6b0303aaefcf service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:40.067339 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bad2b-b569-4e33-a92e-6b0303aaefcf service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:40.153274 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbfd13a-e979-421e-a1c8-94a66f6a0ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:40.153945 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfd13a-e979-421e-a1c8-94a66f6a0ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:40.154241 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfd13a-e979-421e-a1c8-94a66f6a0ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:40.154562 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfd13a-e979-421e-a1c8-94a66f6a0ae9 admin admin] PATH_INFO: `/v3/users/da497422ece143bc84ce21e4094e9bd7` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:40.157440 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbfd13a-e979-421e-a1c8-94a66f6a0ae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da497422ece143bc84ce21e4094e9bd7)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:40.160997 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbfd13a-e979-421e-a1c8-94a66f6a0ae9 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:40.239621 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-8dbfd13a-e979-421e-a1c8-94a66f6a0ae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da497422ece143bc84ce21e4094e9bd7'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:40.240517 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-8dbfd13a-e979-421e-a1c8-94a66f6a0ae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da497422ece143bc84ce21e4094e9bd7'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:40.241290 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-8dbfd13a-e979-421e-a1c8-94a66f6a0ae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da497422ece143bc84ce21e4094e9bd7'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:40.253829 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-8dbfd13a-e979-421e-a1c8-94a66f6a0ae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da497422ece143bc84ce21e4094e9bd7'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:40.270501 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-8dbfd13a-e979-421e-a1c8-94a66f6a0ae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da497422ece143bc84ce21e4094e9bd7'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:40.288865 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1186/2380] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:11:40 2022] DELETE /identity/v3/users/da497422ece143bc84ce21e4094e9bd7 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:11:40.662207 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad93d01-d7ed-48b9-b932-cc34dd953284 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:40.664756 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-aad93d01-d7ed-48b9-b932-cc34dd953284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:40.681798 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad93d01-d7ed-48b9-b932-cc34dd953284 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:40.756409 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b317e20-fa83-46b4-a705-724c92d658b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:40.757094 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b317e20-fa83-46b4-a705-724c92d658b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:40.757367 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b317e20-fa83-46b4-a705-724c92d658b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:40.757639 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b317e20-fa83-46b4-a705-724c92d658b3 admin admin] PATH_INFO: `/v3/projects/d214e37026fe42f6af5384fc4e3f8f8d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:40.758989 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b317e20-fa83-46b4-a705-724c92d658b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d214e37026fe42f6af5384fc4e3f8f8d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:40.760983 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b317e20-fa83-46b4-a705-724c92d658b3 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:40.820087 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4b317e20-fa83-46b4-a705-724c92d658b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd214e37026fe42f6af5384fc4e3f8f8d', 'request_id': 'req-4b317e20-fa83-46b4-a705-724c92d658b3'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:40.828161 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4b317e20-fa83-46b4-a705-724c92d658b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd214e37026fe42f6af5384fc4e3f8f8d', 'request_id': 'req-4b317e20-fa83-46b4-a705-724c92d658b3'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:40.834893 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4b317e20-fa83-46b4-a705-724c92d658b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd214e37026fe42f6af5384fc4e3f8f8d', 'request_id': 'req-4b317e20-fa83-46b4-a705-724c92d658b3'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:40.838153 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:40.853973 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4b317e20-fa83-46b4-a705-724c92d658b3 admin admin] The token cache is being invalidate because project d214e37026fe42f6af5384fc4e3f8f8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:11:40.854542 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4b317e20-fa83-46b4-a705-724c92d658b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:40.855391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4b317e20-fa83-46b4-a705-724c92d658b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:40.857350 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1195/2381] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:11:40 2022] DELETE /identity/v3/projects/d214e37026fe42f6af5384fc4e3f8f8d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:11:40.863109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a377f8-6406-454a-8081-cb509c4fe126 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:40.863585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a377f8-6406-454a-8081-cb509c4fe126 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:40.864012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a377f8-6406-454a-8081-cb509c4fe126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:40.888493 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-13a377f8-6406-454a-8081-cb509c4fe126 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:11:40.889754 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-13a377f8-6406-454a-8081-cb509c4fe126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:40.964337 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1187/2382] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:11:40.975862 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51277d7c-326b-462d-8f1c-c13f6e8208a3 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:40.976361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51277d7c-326b-462d-8f1c-c13f6e8208a3 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:40.976785 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51277d7c-326b-462d-8f1c-c13f6e8208a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:41.000193 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-51277d7c-326b-462d-8f1c-c13f6e8208a3 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:11:41.001666 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-51277d7c-326b-462d-8f1c-c13f6e8208a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:41.010577 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1196/2383] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:11:41.015896 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a377f8-6406-454a-8081-cb509c4fe126 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:41.028469 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a377f8-6406-454a-8081-cb509c4fe126 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:41.034650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6067e8e-401b-49fe-876f-4d37ff46fa7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:41.035407 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6067e8e-401b-49fe-876f-4d37ff46fa7b admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:41.035730 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6067e8e-401b-49fe-876f-4d37ff46fa7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:41.036076 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6067e8e-401b-49fe-876f-4d37ff46fa7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:41.036939 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6067e8e-401b-49fe-876f-4d37ff46fa7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:11:41.037293 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6067e8e-401b-49fe-876f-4d37ff46fa7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:41.039287 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6067e8e-401b-49fe-876f-4d37ff46fa7b admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:41.050082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:41.054777 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1188/2384] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 09:11:41.059001 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51277d7c-326b-462d-8f1c-c13f6e8208a3 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:41.069556 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51277d7c-326b-462d-8f1c-c13f6e8208a3 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:41.074644 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b35d5-75e1-4a37-a8eb-26a18356b546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:41.075205 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b35d5-75e1-4a37-a8eb-26a18356b546 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:41.075487 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b35d5-75e1-4a37-a8eb-26a18356b546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:41.075760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b35d5-75e1-4a37-a8eb-26a18356b546 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:41.076463 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b35d5-75e1-4a37-a8eb-26a18356b546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:41.079332 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b35d5-75e1-4a37-a8eb-26a18356b546 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:41.112490 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1197/2385] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:11:41 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:11:41.118276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6067e8e-401b-49fe-876f-4d37ff46fa7b admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:41.130222 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6067e8e-401b-49fe-876f-4d37ff46fa7b admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:41.198655 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8d599-e1a4-49b8-a412-79d5f38ecdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:41.199299 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8d599-e1a4-49b8-a412-79d5f38ecdd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:41.199582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8d599-e1a4-49b8-a412-79d5f38ecdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:41.199858 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8d599-e1a4-49b8-a412-79d5f38ecdd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:41.200554 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8d599-e1a4-49b8-a412-79d5f38ecdd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:41.203053 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8d599-e1a4-49b8-a412-79d5f38ecdd9 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:41.229498 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1189/2386] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:11:41 2022] POST /identity/v3/users => generated 283 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:11:41.236440 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b35d5-75e1-4a37-a8eb-26a18356b546 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:41.254696 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b35d5-75e1-4a37-a8eb-26a18356b546 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:41.263334 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da6624-641f-4b17-b4ee-8604b8bcef0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:41.264702 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da6624-641f-4b17-b4ee-8604b8bcef0e admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:41.265906 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da6624-641f-4b17-b4ee-8604b8bcef0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:41.266422 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da6624-641f-4b17-b4ee-8604b8bcef0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:41.267736 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da6624-641f-4b17-b4ee-8604b8bcef0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:41.270696 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da6624-641f-4b17-b4ee-8604b8bcef0e admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:41.288972 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1198/2387] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:11:41.293242 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8d599-e1a4-49b8-a412-79d5f38ecdd9 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:41.307894 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8d599-e1a4-49b8-a412-79d5f38ecdd9 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:41.313656 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d8486-d6fa-44e2-ae1b-e78bdc9616e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:41.314500 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d8486-d6fa-44e2-ae1b-e78bdc9616e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:41.314773 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d8486-d6fa-44e2-ae1b-e78bdc9616e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:41.315048 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d8486-d6fa-44e2-ae1b-e78bdc9616e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:41.316178 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d8486-d6fa-44e2-ae1b-e78bdc9616e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:41.317862 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d8486-d6fa-44e2-ae1b-e78bdc9616e7 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:41.331322 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1190/2388] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:11:41.337415 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da6624-641f-4b17-b4ee-8604b8bcef0e admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:41.349467 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da6624-641f-4b17-b4ee-8604b8bcef0e admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:41.355038 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329a93a-f4f7-4aa4-abbd-874bd5be48aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:41.355741 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329a93a-f4f7-4aa4-abbd-874bd5be48aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:41.356014 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329a93a-f4f7-4aa4-abbd-874bd5be48aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:41.356284 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329a93a-f4f7-4aa4-abbd-874bd5be48aa admin admin] PATH_INFO: `/v3/projects/285e91516cb649da8f1dd354c3afb394/users/b40f484a89bf4d8f8dcc5be29cbe4916/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:41.373753 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329a93a-f4f7-4aa4-abbd-874bd5be48aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=285e91516cb649da8f1dd354c3afb394, user_id=b40f484a89bf4d8f8dcc5be29cbe4916, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:41.377343 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329a93a-f4f7-4aa4-abbd-874bd5be48aa admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:41.394161 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1199/2389] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:11:41 2022] PUT /identity/v3/projects/285e91516cb649da8f1dd354c3afb394/users/b40f484a89bf4d8f8dcc5be29cbe4916/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:11:41.406457 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fda9d-1d3e-401e-b0ad-35ebb0cb8285 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:41.406872 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fda9d-1d3e-401e-b0ad-35ebb0cb8285 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:41.407032 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fda9d-1d3e-401e-b0ad-35ebb0cb8285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:41.455477 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-343fda9d-1d3e-401e-b0ad-35ebb0cb8285 None None] MFA Rules not processed for user `b40f484a89bf4d8f8dcc5be29cbe4916`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:11:41.458158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-343fda9d-1d3e-401e-b0ad-35ebb0cb8285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:41.546491 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1191/2390] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:11:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:11:41.552179 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329a93a-f4f7-4aa4-abbd-874bd5be48aa admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:41.628448 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329a93a-f4f7-4aa4-abbd-874bd5be48aa admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:41.633576 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88636dd1-0b42-435f-865f-b4d608b941bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:41.634255 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88636dd1-0b42-435f-865f-b4d608b941bc admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:41.634570 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88636dd1-0b42-435f-865f-b4d608b941bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:41.634849 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88636dd1-0b42-435f-865f-b4d608b941bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:41.635532 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88636dd1-0b42-435f-865f-b4d608b941bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:41.637503 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88636dd1-0b42-435f-865f-b4d608b941bc admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:41.670298 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1200/2391] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:11:41 2022] POST /identity/v3/projects => generated 363 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:11:41.675305 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fda9d-1d3e-401e-b0ad-35ebb0cb8285 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:41.687864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fda9d-1d3e-401e-b0ad-35ebb0cb8285 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:41.764429 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f815fbc-664a-4acb-bc96-f464dfb80e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:41.765098 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f815fbc-664a-4acb-bc96-f464dfb80e48 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:41.765392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f815fbc-664a-4acb-bc96-f464dfb80e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:41.765663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f815fbc-664a-4acb-bc96-f464dfb80e48 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:41.766377 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f815fbc-664a-4acb-bc96-f464dfb80e48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:41.768397 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f815fbc-664a-4acb-bc96-f464dfb80e48 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:41.787444 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:41.796182 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1192/2392] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:11:41 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:11:41.802406 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88636dd1-0b42-435f-865f-b4d608b941bc admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:41.813916 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88636dd1-0b42-435f-865f-b4d608b941bc admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:41.821498 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc498db-e95d-4ce6-aa00-f3017171ccff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:41.822851 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc498db-e95d-4ce6-aa00-f3017171ccff admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:41.823590 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc498db-e95d-4ce6-aa00-f3017171ccff admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:41.824087 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc498db-e95d-4ce6-aa00-f3017171ccff admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:41.825321 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc498db-e95d-4ce6-aa00-f3017171ccff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:41.828536 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc498db-e95d-4ce6-aa00-f3017171ccff admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:41.845931 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1201/2393] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:11:41.850647 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f815fbc-664a-4acb-bc96-f464dfb80e48 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:41.863193 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f815fbc-664a-4acb-bc96-f464dfb80e48 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:41.868864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae392e-e1f2-413b-b4d1-55245bc8b684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:41.869613 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae392e-e1f2-413b-b4d1-55245bc8b684 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:41.869933 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae392e-e1f2-413b-b4d1-55245bc8b684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:41.870274 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae392e-e1f2-413b-b4d1-55245bc8b684 admin admin] PATH_INFO: `/v3/projects/6210055a16c5476d9c2d0c174fe409ad/users/02b215be6ea8408b8ad964672e236a89/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:41.889428 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae392e-e1f2-413b-b4d1-55245bc8b684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6210055a16c5476d9c2d0c174fe409ad, user_id=02b215be6ea8408b8ad964672e236a89, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:41.893037 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae392e-e1f2-413b-b4d1-55245bc8b684 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:41.908158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1193/2394] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:11:41 2022] PUT /identity/v3/projects/6210055a16c5476d9c2d0c174fe409ad/users/02b215be6ea8408b8ad964672e236a89/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:11:41.913273 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc498db-e95d-4ce6-aa00-f3017171ccff admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:41.925331 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc498db-e95d-4ce6-aa00-f3017171ccff admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:41.993582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec46d01-82d2-4f2c-8461-dc27d79f8cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:41.994282 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec46d01-82d2-4f2c-8461-dc27d79f8cca admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:41.994727 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec46d01-82d2-4f2c-8461-dc27d79f8cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:41.995048 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec46d01-82d2-4f2c-8461-dc27d79f8cca admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:41.996006 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec46d01-82d2-4f2c-8461-dc27d79f8cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:41.997790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec46d01-82d2-4f2c-8461-dc27d79f8cca admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:42.004814 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:42.011796 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1202/2395] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:11:42.017954 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae392e-e1f2-413b-b4d1-55245bc8b684 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:42.036866 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae392e-e1f2-413b-b4d1-55245bc8b684 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:42.044716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290751e-4559-45a1-b03b-b47acec59a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:42.045876 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290751e-4559-45a1-b03b-b47acec59a5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:42.046418 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290751e-4559-45a1-b03b-b47acec59a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:42.046914 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290751e-4559-45a1-b03b-b47acec59a5e admin admin] PATH_INFO: `/v3/projects/6210055a16c5476d9c2d0c174fe409ad/users/02b215be6ea8408b8ad964672e236a89/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:42.050468 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290751e-4559-45a1-b03b-b47acec59a5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6210055a16c5476d9c2d0c174fe409ad, user_id=02b215be6ea8408b8ad964672e236a89, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:42.055639 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290751e-4559-45a1-b03b-b47acec59a5e admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:42.071485 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1194/2396] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:11:42 2022] PUT /identity/v3/projects/6210055a16c5476d9c2d0c174fe409ad/users/02b215be6ea8408b8ad964672e236a89/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:11:42.084211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529038d-7b17-4720-b90e-5047917fb6fe None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:42.084718 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529038d-7b17-4720-b90e-5047917fb6fe None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:42.085362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529038d-7b17-4720-b90e-5047917fb6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:42.129704 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-6529038d-7b17-4720-b90e-5047917fb6fe None None] MFA Rules not processed for user `02b215be6ea8408b8ad964672e236a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:11:42.130969 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6529038d-7b17-4720-b90e-5047917fb6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:42.211888 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1203/2397] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:11:42 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:11:42.224355 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290751e-4559-45a1-b03b-b47acec59a5e admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:42.226128 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-4290751e-4559-45a1-b03b-b47acec59a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:42.297967 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290751e-4559-45a1-b03b-b47acec59a5e admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:42.302891 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c12c74-e7ba-4b2c-8ba4-66dfc51cde9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:42.303900 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c12c74-e7ba-4b2c-8ba4-66dfc51cde9f service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:42.303900 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c12c74-e7ba-4b2c-8ba4-66dfc51cde9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:42.304294 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c12c74-e7ba-4b2c-8ba4-66dfc51cde9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:42.316983 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c12c74-e7ba-4b2c-8ba4-66dfc51cde9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:42.318486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c12c74-e7ba-4b2c-8ba4-66dfc51cde9f service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:42.330625 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1195/2398] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:11:42 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:11:42.441440 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529038d-7b17-4720-b90e-5047917fb6fe None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:42.452422 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529038d-7b17-4720-b90e-5047917fb6fe None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:42.456858 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e70f47-4c50-42bc-a8ce-560e33456c7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:42.457494 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e70f47-4c50-42bc-a8ce-560e33456c7f service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:42.457775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e70f47-4c50-42bc-a8ce-560e33456c7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:42.458084 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e70f47-4c50-42bc-a8ce-560e33456c7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:42.529729 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e70f47-4c50-42bc-a8ce-560e33456c7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:42.531767 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e70f47-4c50-42bc-a8ce-560e33456c7f service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:42.542405 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1204/2399] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:11:42 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:11:45.520084 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c12c74-e7ba-4b2c-8ba4-66dfc51cde9f service cinder] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:45.611880 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c12c74-e7ba-4b2c-8ba4-66dfc51cde9f service cinder] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:45.617291 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044dd29b-f211-4210-9455-95686aac2a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:45.617944 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044dd29b-f211-4210-9455-95686aac2a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:45.618227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044dd29b-f211-4210-9455-95686aac2a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:45.618531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044dd29b-f211-4210-9455-95686aac2a73 admin admin] PATH_INFO: `/v3/users/b40f484a89bf4d8f8dcc5be29cbe4916` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:45.619727 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044dd29b-f211-4210-9455-95686aac2a73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b40f484a89bf4d8f8dcc5be29cbe4916)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:45.621750 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044dd29b-f211-4210-9455-95686aac2a73 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:45.674108 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-044dd29b-f211-4210-9455-95686aac2a73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b40f484a89bf4d8f8dcc5be29cbe4916'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:45.674804 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-044dd29b-f211-4210-9455-95686aac2a73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b40f484a89bf4d8f8dcc5be29cbe4916'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:45.675407 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-044dd29b-f211-4210-9455-95686aac2a73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b40f484a89bf4d8f8dcc5be29cbe4916'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:45.683370 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-044dd29b-f211-4210-9455-95686aac2a73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b40f484a89bf4d8f8dcc5be29cbe4916'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:45.692492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:45.698417 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-044dd29b-f211-4210-9455-95686aac2a73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b40f484a89bf4d8f8dcc5be29cbe4916'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:45.713492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1196/2400] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:11:45 2022] DELETE /identity/v3/users/b40f484a89bf4d8f8dcc5be29cbe4916 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:11:45.718753 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce244f98-8e2b-4e8b-b3fb-a240993d3205 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:45.719501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce244f98-8e2b-4e8b-b3fb-a240993d3205 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:45.719501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce244f98-8e2b-4e8b-b3fb-a240993d3205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:45.741583 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-ce244f98-8e2b-4e8b-b3fb-a240993d3205 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:11:45.742845 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ce244f98-8e2b-4e8b-b3fb-a240993d3205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:45.823032 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1205/2401] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:11:45.833173 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044dd29b-f211-4210-9455-95686aac2a73 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:45.834651 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-044dd29b-f211-4210-9455-95686aac2a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:45.906249 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044dd29b-f211-4210-9455-95686aac2a73 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:45.912554 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78706a92-12fb-4821-b024-b17e4dffdee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:45.913610 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78706a92-12fb-4821-b024-b17e4dffdee2 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:45.914050 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78706a92-12fb-4821-b024-b17e4dffdee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:45.914542 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78706a92-12fb-4821-b024-b17e4dffdee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:45.930788 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78706a92-12fb-4821-b024-b17e4dffdee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:45.933361 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78706a92-12fb-4821-b024-b17e4dffdee2 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:45.949921 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1197/2402] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:11:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:11:46.360350 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce244f98-8e2b-4e8b-b3fb-a240993d3205 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:46.365504 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ce244f98-8e2b-4e8b-b3fb-a240993d3205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:46.388043 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce244f98-8e2b-4e8b-b3fb-a240993d3205 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:46.394949 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e7e19-5924-4e4d-95b9-bdc5f31ac2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:46.395692 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e7e19-5924-4e4d-95b9-bdc5f31ac2df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:46.395974 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e7e19-5924-4e4d-95b9-bdc5f31ac2df admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:46.396431 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e7e19-5924-4e4d-95b9-bdc5f31ac2df admin admin] PATH_INFO: `/v3/projects/285e91516cb649da8f1dd354c3afb394` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:46.397855 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e7e19-5924-4e4d-95b9-bdc5f31ac2df admin admin] RBAC: Authorizing `identity:delete_project(project_id=285e91516cb649da8f1dd354c3afb394)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:46.401553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e7e19-5924-4e4d-95b9-bdc5f31ac2df admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:46.430568 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:46.464977 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3a3e7e19-5924-4e4d-95b9-bdc5f31ac2df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '285e91516cb649da8f1dd354c3afb394', 'request_id': 'req-3a3e7e19-5924-4e4d-95b9-bdc5f31ac2df'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:46.472342 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3a3e7e19-5924-4e4d-95b9-bdc5f31ac2df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '285e91516cb649da8f1dd354c3afb394', 'request_id': 'req-3a3e7e19-5924-4e4d-95b9-bdc5f31ac2df'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:46.479323 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3a3e7e19-5924-4e4d-95b9-bdc5f31ac2df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '285e91516cb649da8f1dd354c3afb394', 'request_id': 'req-3a3e7e19-5924-4e4d-95b9-bdc5f31ac2df'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:46.494085 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3a3e7e19-5924-4e4d-95b9-bdc5f31ac2df admin admin] The token cache is being invalidate because project 285e91516cb649da8f1dd354c3afb394 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:11:46.494411 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3a3e7e19-5924-4e4d-95b9-bdc5f31ac2df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:46.495107 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3a3e7e19-5924-4e4d-95b9-bdc5f31ac2df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:46.496824 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1206/2403] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:11:46 2022] DELETE /identity/v3/projects/285e91516cb649da8f1dd354c3afb394 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:11:46.502415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78706a92-12fb-4821-b024-b17e4dffdee2 service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:46.513719 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78706a92-12fb-4821-b024-b17e4dffdee2 service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:46.591890 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a88652-ca5c-4897-af6d-0c0e09800760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:46.592936 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a88652-ca5c-4897-af6d-0c0e09800760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:46.592936 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a88652-ca5c-4897-af6d-0c0e09800760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:46.593828 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a88652-ca5c-4897-af6d-0c0e09800760 admin admin] PATH_INFO: `/v3/users/02b215be6ea8408b8ad964672e236a89` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:46.595461 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a88652-ca5c-4897-af6d-0c0e09800760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02b215be6ea8408b8ad964672e236a89)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:46.597877 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a88652-ca5c-4897-af6d-0c0e09800760 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:46.671053 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-08a88652-ca5c-4897-af6d-0c0e09800760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02b215be6ea8408b8ad964672e236a89'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:46.672964 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-08a88652-ca5c-4897-af6d-0c0e09800760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02b215be6ea8408b8ad964672e236a89'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:46.673760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-08a88652-ca5c-4897-af6d-0c0e09800760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02b215be6ea8408b8ad964672e236a89'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:46.684061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-08a88652-ca5c-4897-af6d-0c0e09800760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02b215be6ea8408b8ad964672e236a89'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:46.699485 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-08a88652-ca5c-4897-af6d-0c0e09800760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02b215be6ea8408b8ad964672e236a89'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:46.715511 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1198/2404] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:11:46 2022] DELETE /identity/v3/users/02b215be6ea8408b8ad964672e236a89 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:11:47.072013 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e7e19-5924-4e4d-95b9-bdc5f31ac2df admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:47.073592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-3a3e7e19-5924-4e4d-95b9-bdc5f31ac2df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:47.089776 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e7e19-5924-4e4d-95b9-bdc5f31ac2df admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:47.199094 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9b456-2509-453b-a6f5-2bf57e7d0f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:47.199761 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9b456-2509-453b-a6f5-2bf57e7d0f40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:47.200085 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9b456-2509-453b-a6f5-2bf57e7d0f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:47.200402 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9b456-2509-453b-a6f5-2bf57e7d0f40 admin admin] PATH_INFO: `/v3/projects/6210055a16c5476d9c2d0c174fe409ad` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:47.201845 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9b456-2509-453b-a6f5-2bf57e7d0f40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6210055a16c5476d9c2d0c174fe409ad)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:47.204768 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9b456-2509-453b-a6f5-2bf57e7d0f40 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:47.266994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-05b9b456-2509-453b-a6f5-2bf57e7d0f40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6210055a16c5476d9c2d0c174fe409ad', 'request_id': 'req-05b9b456-2509-453b-a6f5-2bf57e7d0f40'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:47.274400 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-05b9b456-2509-453b-a6f5-2bf57e7d0f40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6210055a16c5476d9c2d0c174fe409ad', 'request_id': 'req-05b9b456-2509-453b-a6f5-2bf57e7d0f40'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:47.281899 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-05b9b456-2509-453b-a6f5-2bf57e7d0f40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6210055a16c5476d9c2d0c174fe409ad', 'request_id': 'req-05b9b456-2509-453b-a6f5-2bf57e7d0f40'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:47.297843 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-05b9b456-2509-453b-a6f5-2bf57e7d0f40 admin admin] The token cache is being invalidate because project 6210055a16c5476d9c2d0c174fe409ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:11:47.298150 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-05b9b456-2509-453b-a6f5-2bf57e7d0f40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:47.299012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-05b9b456-2509-453b-a6f5-2bf57e7d0f40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:47.300650 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1207/2405] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:11:47 2022] DELETE /identity/v3/projects/6210055a16c5476d9c2d0c174fe409ad => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:11:47.306200 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7210e5-6856-4b00-813f-0863a85c6fa7 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:47.306663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7210e5-6856-4b00-813f-0863a85c6fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:47.307033 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7210e5-6856-4b00-813f-0863a85c6fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:47.317403 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:47.332779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-0c7210e5-6856-4b00-813f-0863a85c6fa7 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:11:47.335780 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-0c7210e5-6856-4b00-813f-0863a85c6fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:47.430293 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1199/2406] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:11:47.444078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7e60f-f721-4231-b767-9447dd1950b6 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:47.444593 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7e60f-f721-4231-b767-9447dd1950b6 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:47.445060 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7e60f-f721-4231-b767-9447dd1950b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:47.483643 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-b4e7e60f-f721-4231-b767-9447dd1950b6 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:11:47.485803 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b4e7e60f-f721-4231-b767-9447dd1950b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:47.498618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1208/2407] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:11:47.504234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7210e5-6856-4b00-813f-0863a85c6fa7 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:47.514347 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7210e5-6856-4b00-813f-0863a85c6fa7 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:47.520976 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365f37a-8be1-47f8-881c-9f0cc61e4efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:47.521618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365f37a-8be1-47f8-881c-9f0cc61e4efc admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:47.522028 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365f37a-8be1-47f8-881c-9f0cc61e4efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:47.522395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365f37a-8be1-47f8-881c-9f0cc61e4efc admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:47.523254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365f37a-8be1-47f8-881c-9f0cc61e4efc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:11:47.523557 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365f37a-8be1-47f8-881c-9f0cc61e4efc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:47.525431 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365f37a-8be1-47f8-881c-9f0cc61e4efc admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:47.539914 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1200/2408] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:11:47.546673 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7e60f-f721-4231-b767-9447dd1950b6 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:47.557895 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7e60f-f721-4231-b767-9447dd1950b6 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:47.563821 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a6fca-a8c5-4f09-a034-56b9628bf9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:47.564462 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a6fca-a8c5-4f09-a034-56b9628bf9c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:47.564739 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a6fca-a8c5-4f09-a034-56b9628bf9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:47.565013 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a6fca-a8c5-4f09-a034-56b9628bf9c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:47.565710 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a6fca-a8c5-4f09-a034-56b9628bf9c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:47.567717 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a6fca-a8c5-4f09-a034-56b9628bf9c3 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:47.600054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1209/2409] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:11:47 2022] POST /identity/v3/projects => generated 407 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:11:47.606463 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365f37a-8be1-47f8-881c-9f0cc61e4efc admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:47.619016 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365f37a-8be1-47f8-881c-9f0cc61e4efc admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:47.720788 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf0041-9903-4e1a-8ee2-c9dbbf8754bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:47.721994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf0041-9903-4e1a-8ee2-c9dbbf8754bf admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:47.722288 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf0041-9903-4e1a-8ee2-c9dbbf8754bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:47.722759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf0041-9903-4e1a-8ee2-c9dbbf8754bf admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:47.723489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf0041-9903-4e1a-8ee2-c9dbbf8754bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:47.725575 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf0041-9903-4e1a-8ee2-c9dbbf8754bf admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:47.756837 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1201/2410] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:11:47 2022] POST /identity/v3/users => generated 304 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:11:47.761258 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a6fca-a8c5-4f09-a034-56b9628bf9c3 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:47.774534 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a6fca-a8c5-4f09-a034-56b9628bf9c3 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:47.781506 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1323245-1dcd-4907-9c20-5750363c0db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:47.782761 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1323245-1dcd-4907-9c20-5750363c0db6 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:47.783103 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1323245-1dcd-4907-9c20-5750363c0db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:47.783389 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1323245-1dcd-4907-9c20-5750363c0db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:47.784129 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1323245-1dcd-4907-9c20-5750363c0db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:47.786169 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1323245-1dcd-4907-9c20-5750363c0db6 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:47.789182 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:47.808367 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1210/2411] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:11:47.811970 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf0041-9903-4e1a-8ee2-c9dbbf8754bf admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:47.824448 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf0041-9903-4e1a-8ee2-c9dbbf8754bf admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:47.830562 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e786041-a45e-41bd-b9aa-93fcf9cd439a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:47.831331 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e786041-a45e-41bd-b9aa-93fcf9cd439a admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:47.831674 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e786041-a45e-41bd-b9aa-93fcf9cd439a admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:47.832009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e786041-a45e-41bd-b9aa-93fcf9cd439a admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:47.832935 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e786041-a45e-41bd-b9aa-93fcf9cd439a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:47.835101 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e786041-a45e-41bd-b9aa-93fcf9cd439a admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:47.849815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1202/2412] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:11:47.854843 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1323245-1dcd-4907-9c20-5750363c0db6 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:47.866986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1323245-1dcd-4907-9c20-5750363c0db6 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:47.880154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb22ca9-d2ce-44d2-947c-f8fa65158def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:47.880938 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb22ca9-d2ce-44d2-947c-f8fa65158def admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:47.881222 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb22ca9-d2ce-44d2-947c-f8fa65158def admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:47.881497 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb22ca9-d2ce-44d2-947c-f8fa65158def admin admin] PATH_INFO: `/v3/projects/930f1c4cfc0c4f72a251a745b1570db0/users/8fe4013b82fb4080b8925e208b723668/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:47.904681 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb22ca9-d2ce-44d2-947c-f8fa65158def admin admin] RBAC: Authorizing `identity:create_grant(project_id=930f1c4cfc0c4f72a251a745b1570db0, user_id=8fe4013b82fb4080b8925e208b723668, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:47.910371 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb22ca9-d2ce-44d2-947c-f8fa65158def admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:47.931676 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1211/2413] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:11:47 2022] PUT /identity/v3/projects/930f1c4cfc0c4f72a251a745b1570db0/users/8fe4013b82fb4080b8925e208b723668/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:11:47.945990 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9548183-6542-4a34-bc6d-e48ce697b0cc None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:47.946479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9548183-6542-4a34-bc6d-e48ce697b0cc None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:47.946804 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9548183-6542-4a34-bc6d-e48ce697b0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:47.996773 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-a9548183-6542-4a34-bc6d-e48ce697b0cc None None] MFA Rules not processed for user `8fe4013b82fb4080b8925e208b723668`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:11:47.998974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-a9548183-6542-4a34-bc6d-e48ce697b0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:48.090263 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:48.096936 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1203/2414] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:11:47 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:11:48.102068 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb22ca9-d2ce-44d2-947c-f8fa65158def admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:48.177920 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb22ca9-d2ce-44d2-947c-f8fa65158def admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:48.183066 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590afc84-5da5-45c4-acba-a18df3a5f28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:48.183703 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590afc84-5da5-45c4-acba-a18df3a5f28f admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:48.183979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590afc84-5da5-45c4-acba-a18df3a5f28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:48.184254 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590afc84-5da5-45c4-acba-a18df3a5f28f admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:48.184933 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590afc84-5da5-45c4-acba-a18df3a5f28f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:48.187777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590afc84-5da5-45c4-acba-a18df3a5f28f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:48.216865 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1212/2415] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:11:48 2022] POST /identity/v3/projects => generated 407 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:11:48.221807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9548183-6542-4a34-bc6d-e48ce697b0cc None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:48.235640 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9548183-6542-4a34-bc6d-e48ce697b0cc None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:48.319847 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b6026-297f-4477-b574-f47c6159d4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:48.320478 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b6026-297f-4477-b574-f47c6159d4d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:48.320758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b6026-297f-4477-b574-f47c6159d4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:48.321030 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b6026-297f-4477-b574-f47c6159d4d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:48.321718 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b6026-297f-4477-b574-f47c6159d4d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:48.323739 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b6026-297f-4477-b574-f47c6159d4d2 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:48.349129 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1204/2416] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:11:48 2022] POST /identity/v3/users => generated 310 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:11:48.355859 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590afc84-5da5-45c4-acba-a18df3a5f28f admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:48.372535 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590afc84-5da5-45c4-acba-a18df3a5f28f admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:48.379538 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b5d08-f3bc-46bf-a344-2f870881a11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:48.380168 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b5d08-f3bc-46bf-a344-2f870881a11d admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:48.380449 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b5d08-f3bc-46bf-a344-2f870881a11d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:48.380725 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b5d08-f3bc-46bf-a344-2f870881a11d admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:48.381433 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b5d08-f3bc-46bf-a344-2f870881a11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:48.383128 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b5d08-f3bc-46bf-a344-2f870881a11d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:48.395523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1213/2417] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:11:48.400304 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b6026-297f-4477-b574-f47c6159d4d2 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:48.411380 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b6026-297f-4477-b574-f47c6159d4d2 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:48.417565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443400c6-8065-4e99-a5a6-34f5eeccc929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:48.418699 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443400c6-8065-4e99-a5a6-34f5eeccc929 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:48.418943 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443400c6-8065-4e99-a5a6-34f5eeccc929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:48.419370 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443400c6-8065-4e99-a5a6-34f5eeccc929 admin admin] PATH_INFO: `/v3/projects/2e13697d426e40cf8fda660f24aa355d/users/85e22f480e53441c8f569f095e211251/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:48.438685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443400c6-8065-4e99-a5a6-34f5eeccc929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e13697d426e40cf8fda660f24aa355d, user_id=85e22f480e53441c8f569f095e211251, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:48.441623 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443400c6-8065-4e99-a5a6-34f5eeccc929 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:48.458056 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1205/2418] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:11:48 2022] PUT /identity/v3/projects/2e13697d426e40cf8fda660f24aa355d/users/85e22f480e53441c8f569f095e211251/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:11:48.463205 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b5d08-f3bc-46bf-a344-2f870881a11d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:48.475076 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b5d08-f3bc-46bf-a344-2f870881a11d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:48.570050 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae2682-10fb-41fd-a732-f775c2fcc289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:48.570705 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae2682-10fb-41fd-a732-f775c2fcc289 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:48.570987 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae2682-10fb-41fd-a732-f775c2fcc289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:48.571283 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae2682-10fb-41fd-a732-f775c2fcc289 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:48.571966 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae2682-10fb-41fd-a732-f775c2fcc289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:48.573584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae2682-10fb-41fd-a732-f775c2fcc289 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:48.586748 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1214/2419] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:11:48.591332 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443400c6-8065-4e99-a5a6-34f5eeccc929 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:48.604781 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443400c6-8065-4e99-a5a6-34f5eeccc929 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:48.611142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea320c-d726-4c57-8a01-716fff3f3379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:48.612609 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea320c-d726-4c57-8a01-716fff3f3379 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:48.613129 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea320c-d726-4c57-8a01-716fff3f3379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:48.613324 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea320c-d726-4c57-8a01-716fff3f3379 admin admin] PATH_INFO: `/v3/projects/2e13697d426e40cf8fda660f24aa355d/users/85e22f480e53441c8f569f095e211251/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:48.615897 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea320c-d726-4c57-8a01-716fff3f3379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e13697d426e40cf8fda660f24aa355d, user_id=85e22f480e53441c8f569f095e211251, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:48.619050 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea320c-d726-4c57-8a01-716fff3f3379 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:48.633741 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1206/2420] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:11:48 2022] PUT /identity/v3/projects/2e13697d426e40cf8fda660f24aa355d/users/85e22f480e53441c8f569f095e211251/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:11:48.648158 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f38db6-d096-4a76-9f40-03c997f4b7f0 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:48.648767 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f38db6-d096-4a76-9f40-03c997f4b7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:48.649216 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f38db6-d096-4a76-9f40-03c997f4b7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:48.692706 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-40f38db6-d096-4a76-9f40-03c997f4b7f0 None None] MFA Rules not processed for user `85e22f480e53441c8f569f095e211251`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:11:48.694795 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-40f38db6-d096-4a76-9f40-03c997f4b7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:48.756375 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:48.842778 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1215/2421] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:11:48 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:11:48.867389 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea320c-d726-4c57-8a01-716fff3f3379 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:48.874902 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-94ea320c-d726-4c57-8a01-716fff3f3379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:48.982842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea320c-d726-4c57-8a01-716fff3f3379 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:48.988154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abf751-4894-4c17-8ee8-b796b8d3ee67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:48.988849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abf751-4894-4c17-8ee8-b796b8d3ee67 service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:48.989132 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abf751-4894-4c17-8ee8-b796b8d3ee67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:48.989410 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abf751-4894-4c17-8ee8-b796b8d3ee67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:49.006570 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9abf751-4894-4c17-8ee8-b796b8d3ee67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:49.007823 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9abf751-4894-4c17-8ee8-b796b8d3ee67 service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:49.024732 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1207/2422] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:11:48 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:11:49.268889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f38db6-d096-4a76-9f40-03c997f4b7f0 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:49.287218 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f38db6-d096-4a76-9f40-03c997f4b7f0 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:49.293316 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ab940-c47f-4890-b40e-dba92c7ff7f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:49.294310 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ab940-c47f-4890-b40e-dba92c7ff7f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:49.294685 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ab940-c47f-4890-b40e-dba92c7ff7f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:49.295098 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ab940-c47f-4890-b40e-dba92c7ff7f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:49.378118 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ab940-c47f-4890-b40e-dba92c7ff7f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:49.379653 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ab940-c47f-4890-b40e-dba92c7ff7f2 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:49.391070 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1216/2423] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:11:49 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:11:55.289003 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abf751-4894-4c17-8ee8-b796b8d3ee67 service cinder] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:55.390070 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:55.397970 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abf751-4894-4c17-8ee8-b796b8d3ee67 service cinder] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:55.407351 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece7a54-cd98-42e3-8f04-368774558489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:55.408489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece7a54-cd98-42e3-8f04-368774558489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:55.409006 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece7a54-cd98-42e3-8f04-368774558489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:55.409485 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece7a54-cd98-42e3-8f04-368774558489 admin admin] PATH_INFO: `/v3/users/8fe4013b82fb4080b8925e208b723668` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:55.411619 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece7a54-cd98-42e3-8f04-368774558489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fe4013b82fb4080b8925e208b723668)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:55.415295 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece7a54-cd98-42e3-8f04-368774558489 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:55.492862 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-cece7a54-cd98-42e3-8f04-368774558489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fe4013b82fb4080b8925e208b723668'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:55.493691 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-cece7a54-cd98-42e3-8f04-368774558489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fe4013b82fb4080b8925e208b723668'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:55.500672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-cece7a54-cd98-42e3-8f04-368774558489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fe4013b82fb4080b8925e208b723668'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:55.513481 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-cece7a54-cd98-42e3-8f04-368774558489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fe4013b82fb4080b8925e208b723668'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:55.537464 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-cece7a54-cd98-42e3-8f04-368774558489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fe4013b82fb4080b8925e208b723668'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:55.564404 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1208/2424] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:11:55 2022] DELETE /identity/v3/users/8fe4013b82fb4080b8925e208b723668 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:11:55.570490 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ef6e2-ae9c-4ae7-afbf-2982b9f4db3e None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:55.572058 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ef6e2-ae9c-4ae7-afbf-2982b9f4db3e None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:55.572641 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ef6e2-ae9c-4ae7-afbf-2982b9f4db3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:55.612292 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-022ef6e2-ae9c-4ae7-afbf-2982b9f4db3e None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:11:55.614630 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-022ef6e2-ae9c-4ae7-afbf-2982b9f4db3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:55.758381 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1217/2425] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:11:55.773706 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece7a54-cd98-42e3-8f04-368774558489 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:55.776336 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-cece7a54-cd98-42e3-8f04-368774558489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:56.128139 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece7a54-cd98-42e3-8f04-368774558489 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:56.152459 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744f3c1-62a3-4c4b-8d1a-d2284af86828 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:56.153583 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744f3c1-62a3-4c4b-8d1a-d2284af86828 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:56.154103 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744f3c1-62a3-4c4b-8d1a-d2284af86828 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:56.162817 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744f3c1-62a3-4c4b-8d1a-d2284af86828 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:56.207563 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744f3c1-62a3-4c4b-8d1a-d2284af86828 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:56.210623 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744f3c1-62a3-4c4b-8d1a-d2284af86828 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:56.235524 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1209/2426] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:11:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:11:57.014372 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ef6e2-ae9c-4ae7-afbf-2982b9f4db3e None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:57.020429 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-022ef6e2-ae9c-4ae7-afbf-2982b9f4db3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:57.063960 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ef6e2-ae9c-4ae7-afbf-2982b9f4db3e None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:57.074684 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2761415-31f2-4538-b20d-1a4e2e2c70e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:57.076047 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2761415-31f2-4538-b20d-1a4e2e2c70e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:57.077528 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2761415-31f2-4538-b20d-1a4e2e2c70e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:57.078819 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2761415-31f2-4538-b20d-1a4e2e2c70e9 admin admin] PATH_INFO: `/v3/projects/930f1c4cfc0c4f72a251a745b1570db0` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:57.084325 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2761415-31f2-4538-b20d-1a4e2e2c70e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=930f1c4cfc0c4f72a251a745b1570db0)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:57.090103 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2761415-31f2-4538-b20d-1a4e2e2c70e9 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:57.213674 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e2761415-31f2-4538-b20d-1a4e2e2c70e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '930f1c4cfc0c4f72a251a745b1570db0', 'request_id': 'req-e2761415-31f2-4538-b20d-1a4e2e2c70e9'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:57.236564 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e2761415-31f2-4538-b20d-1a4e2e2c70e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '930f1c4cfc0c4f72a251a745b1570db0', 'request_id': 'req-e2761415-31f2-4538-b20d-1a4e2e2c70e9'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:57.262882 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e2761415-31f2-4538-b20d-1a4e2e2c70e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '930f1c4cfc0c4f72a251a745b1570db0', 'request_id': 'req-e2761415-31f2-4538-b20d-1a4e2e2c70e9'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:57.299304 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:57.338911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e2761415-31f2-4538-b20d-1a4e2e2c70e9 admin admin] The token cache is being invalidate because project 930f1c4cfc0c4f72a251a745b1570db0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:11:57.340075 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e2761415-31f2-4538-b20d-1a4e2e2c70e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:57.342557 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e2761415-31f2-4538-b20d-1a4e2e2c70e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:57.351423 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1218/2427] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:11:57 2022] DELETE /identity/v3/projects/930f1c4cfc0c4f72a251a745b1570db0 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:11:57.358047 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744f3c1-62a3-4c4b-8d1a-d2284af86828 service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:57.385225 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744f3c1-62a3-4c4b-8d1a-d2284af86828 service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:57.539341 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd783526-9b2a-4091-b21c-ac03b58fc5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:57.540648 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd783526-9b2a-4091-b21c-ac03b58fc5f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:57.541515 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd783526-9b2a-4091-b21c-ac03b58fc5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:57.542511 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd783526-9b2a-4091-b21c-ac03b58fc5f6 admin admin] PATH_INFO: `/v3/users/85e22f480e53441c8f569f095e211251` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:57.545691 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd783526-9b2a-4091-b21c-ac03b58fc5f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85e22f480e53441c8f569f095e211251)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:57.551815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd783526-9b2a-4091-b21c-ac03b58fc5f6 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:57.617286 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:57.677791 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-bd783526-9b2a-4091-b21c-ac03b58fc5f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85e22f480e53441c8f569f095e211251'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:57.678635 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-bd783526-9b2a-4091-b21c-ac03b58fc5f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85e22f480e53441c8f569f095e211251'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:57.679393 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-bd783526-9b2a-4091-b21c-ac03b58fc5f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85e22f480e53441c8f569f095e211251'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:57.699529 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-bd783526-9b2a-4091-b21c-ac03b58fc5f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85e22f480e53441c8f569f095e211251'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:57.740327 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-bd783526-9b2a-4091-b21c-ac03b58fc5f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85e22f480e53441c8f569f095e211251'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:57.790722 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1210/2428] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:11:57 2022] DELETE /identity/v3/users/85e22f480e53441c8f569f095e211251 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:11:58.647079 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2761415-31f2-4538-b20d-1a4e2e2c70e9 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:58.650076 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e2761415-31f2-4538-b20d-1a4e2e2c70e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:58.667686 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2761415-31f2-4538-b20d-1a4e2e2c70e9 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:58.818384 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40693e6-02bf-48f6-af82-edb85bac103f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:58.819401 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40693e6-02bf-48f6-af82-edb85bac103f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:58.819887 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40693e6-02bf-48f6-af82-edb85bac103f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:58.820530 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40693e6-02bf-48f6-af82-edb85bac103f admin admin] PATH_INFO: `/v3/projects/2e13697d426e40cf8fda660f24aa355d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:58.822097 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40693e6-02bf-48f6-af82-edb85bac103f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e13697d426e40cf8fda660f24aa355d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:58.824534 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40693e6-02bf-48f6-af82-edb85bac103f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:58.921295 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d40693e6-02bf-48f6-af82-edb85bac103f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e13697d426e40cf8fda660f24aa355d', 'request_id': 'req-d40693e6-02bf-48f6-af82-edb85bac103f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:58.936703 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d40693e6-02bf-48f6-af82-edb85bac103f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e13697d426e40cf8fda660f24aa355d', 'request_id': 'req-d40693e6-02bf-48f6-af82-edb85bac103f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:58.952155 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d40693e6-02bf-48f6-af82-edb85bac103f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e13697d426e40cf8fda660f24aa355d', 'request_id': 'req-d40693e6-02bf-48f6-af82-edb85bac103f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:58.971527 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d40693e6-02bf-48f6-af82-edb85bac103f admin admin] The token cache is being invalidate because project 2e13697d426e40cf8fda660f24aa355d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:11:58.971988 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d40693e6-02bf-48f6-af82-edb85bac103f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:58.973720 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d40693e6-02bf-48f6-af82-edb85bac103f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:11:58.975875 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1219/2429] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:11:58 2022] DELETE /identity/v3/projects/2e13697d426e40cf8fda660f24aa355d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:11:58.981626 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8d25d-08e3-4bd4-a921-b59edc7efec9 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:58.982264 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8d25d-08e3-4bd4-a921-b59edc7efec9 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:58.982643 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8d25d-08e3-4bd4-a921-b59edc7efec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:59.025668 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-dbf8d25d-08e3-4bd4-a921-b59edc7efec9 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:11:59.029158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-dbf8d25d-08e3-4bd4-a921-b59edc7efec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:59.182553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1211/2430] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:11:59.288375 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b1da0-fe9b-466f-983b-3f75c210d5c3 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:59.288840 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b1da0-fe9b-466f-983b-3f75c210d5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:59.289378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b1da0-fe9b-466f-983b-3f75c210d5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:59.333131 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-135b1da0-fe9b-466f-983b-3f75c210d5c3 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:11:59.336085 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-135b1da0-fe9b-466f-983b-3f75c210d5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:11:59.358417 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1220/2431] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:11:59.365558 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8d25d-08e3-4bd4-a921-b59edc7efec9 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:59.383339 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8d25d-08e3-4bd4-a921-b59edc7efec9 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:59.391293 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d58bb7-bacf-498f-ac8f-44510ba27fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:59.392120 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d58bb7-bacf-498f-ac8f-44510ba27fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:59.392536 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d58bb7-bacf-498f-ac8f-44510ba27fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:59.392974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d58bb7-bacf-498f-ac8f-44510ba27fc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:59.393832 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d58bb7-bacf-498f-ac8f-44510ba27fc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:11:59.394294 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d58bb7-bacf-498f-ac8f-44510ba27fc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:59.396482 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d58bb7-bacf-498f-ac8f-44510ba27fc9 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:59.414025 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1212/2432] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:11:59.419287 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b1da0-fe9b-466f-983b-3f75c210d5c3 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:59.434831 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b1da0-fe9b-466f-983b-3f75c210d5c3 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:59.474958 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d3f6f-145d-4fd3-bc29-752535ba3da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:59.477011 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d3f6f-145d-4fd3-bc29-752535ba3da9 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:59.477756 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d3f6f-145d-4fd3-bc29-752535ba3da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:59.478234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d3f6f-145d-4fd3-bc29-752535ba3da9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:59.479894 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d3f6f-145d-4fd3-bc29-752535ba3da9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:59.484611 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d3f6f-145d-4fd3-bc29-752535ba3da9 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:59.542385 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1221/2433] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:11:59 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:11:59.547279 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d58bb7-bacf-498f-ac8f-44510ba27fc9 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:59.560447 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d58bb7-bacf-498f-ac8f-44510ba27fc9 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:59.660296 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa6e49-e84e-4bfc-871a-edbc71075718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:59.660935 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa6e49-e84e-4bfc-871a-edbc71075718 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:59.661217 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa6e49-e84e-4bfc-871a-edbc71075718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:59.661490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa6e49-e84e-4bfc-871a-edbc71075718 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:59.662613 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa6e49-e84e-4bfc-871a-edbc71075718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:59.664424 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa6e49-e84e-4bfc-871a-edbc71075718 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:59.699401 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1213/2434] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:11:59 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:11:59.701292 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d3f6f-145d-4fd3-bc29-752535ba3da9 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:59.714696 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d3f6f-145d-4fd3-bc29-752535ba3da9 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:59.721928 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bd2e9-55a2-43b4-b04e-177fc4d107f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:59.722848 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bd2e9-55a2-43b4-b04e-177fc4d107f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:59.723370 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bd2e9-55a2-43b4-b04e-177fc4d107f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:59.723894 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bd2e9-55a2-43b4-b04e-177fc4d107f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:59.725067 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901bd2e9-55a2-43b4-b04e-177fc4d107f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:59.727863 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901bd2e9-55a2-43b4-b04e-177fc4d107f0 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:59.743334 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1222/2435] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:11:59.749767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa6e49-e84e-4bfc-871a-edbc71075718 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:59.770861 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa6e49-e84e-4bfc-871a-edbc71075718 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:59.780765 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935e17b-ec9b-40fc-ad9a-a446f9d4baf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:59.782897 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935e17b-ec9b-40fc-ad9a-a446f9d4baf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:59.783449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935e17b-ec9b-40fc-ad9a-a446f9d4baf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:59.784095 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935e17b-ec9b-40fc-ad9a-a446f9d4baf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:59.786178 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935e17b-ec9b-40fc-ad9a-a446f9d4baf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:59.789503 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935e17b-ec9b-40fc-ad9a-a446f9d4baf3 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:59.808152 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1214/2436] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:11:59.814292 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bd2e9-55a2-43b4-b04e-177fc4d107f0 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:11:59.827385 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bd2e9-55a2-43b4-b04e-177fc4d107f0 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:11:59.832735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363b888-e9da-4ccf-ba22-2c163c67a090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:11:59.835282 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363b888-e9da-4ccf-ba22-2c163c67a090 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:59.835757 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363b888-e9da-4ccf-ba22-2c163c67a090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:59.836248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363b888-e9da-4ccf-ba22-2c163c67a090 admin admin] PATH_INFO: `/v3/projects/719279116dc74c0cac44f1d0c0fecf47/users/0223ad2c972b48318d3d0936b8972bd1/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:59.863161 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363b888-e9da-4ccf-ba22-2c163c67a090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=719279116dc74c0cac44f1d0c0fecf47, user_id=0223ad2c972b48318d3d0936b8972bd1, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:11:59.865823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363b888-e9da-4ccf-ba22-2c163c67a090 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:11:59.882894 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1223/2437] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:11:59 2022] PUT /identity/v3/projects/719279116dc74c0cac44f1d0c0fecf47/users/0223ad2c972b48318d3d0936b8972bd1/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:11:59.889629 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c79371-dfb8-4f29-805f-bab38145e511 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:11:59.890126 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c79371-dfb8-4f29-805f-bab38145e511 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:11:59.891188 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c79371-dfb8-4f29-805f-bab38145e511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:11:59.903069 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:11:59.926334 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-83c79371-dfb8-4f29-805f-bab38145e511 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:11:59.929229 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-83c79371-dfb8-4f29-805f-bab38145e511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:12:00.045364 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1215/2438] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:12:00.056437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363b888-e9da-4ccf-ba22-2c163c67a090 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:12:00.059281 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4363b888-e9da-4ccf-ba22-2c163c67a090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:12:00.091478 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:12:00.158770 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363b888-e9da-4ccf-ba22-2c163c67a090 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:12:00.163642 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bacaf4-ee1d-4ab1-b692-fbc9cadc737b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:12:00.164289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bacaf4-ee1d-4ab1-b692-fbc9cadc737b service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:00.164575 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bacaf4-ee1d-4ab1-b692-fbc9cadc737b service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:00.164878 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bacaf4-ee1d-4ab1-b692-fbc9cadc737b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:00.176467 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bacaf4-ee1d-4ab1-b692-fbc9cadc737b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:12:00.178039 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bacaf4-ee1d-4ab1-b692-fbc9cadc737b service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:12:00.189773 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1224/2439] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:12:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:12:01.258754 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c39661-2847-4bd0-acd5-4b46d124da0f None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:01.259620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c39661-2847-4bd0-acd5-4b46d124da0f None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:01.259620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c39661-2847-4bd0-acd5-4b46d124da0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:01.282087 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-09c39661-2847-4bd0-acd5-4b46d124da0f None None] MFA Rules not processed for user `ae3fe5b4d9344c3bb7ae21b030377313`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:12:01.283489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-09c39661-2847-4bd0-acd5-4b46d124da0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:12:01.356283 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1216/2440] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:12:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:12:01.491332 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c639ff4-cc69-4980-87b7-ba095c74fc46 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:01.492169 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c639ff4-cc69-4980-87b7-ba095c74fc46 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:01.492169 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c639ff4-cc69-4980-87b7-ba095c74fc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:01.539724 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-6c639ff4-cc69-4980-87b7-ba095c74fc46 None None] MFA Rules not processed for user `0223ad2c972b48318d3d0936b8972bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:12:01.541059 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6c639ff4-cc69-4980-87b7-ba095c74fc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:12:01.633283 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1225/2441] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:12:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:12:01.638301 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c39661-2847-4bd0-acd5-4b46d124da0f None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:12:01.651227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c39661-2847-4bd0-acd5-4b46d124da0f None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:12:01.658686 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e04f2-7c87-4f30-8f05-6a27444a214f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:12:01.660084 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e04f2-7c87-4f30-8f05-6a27444a214f admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:01.660424 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e04f2-7c87-4f30-8f05-6a27444a214f admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:01.660705 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e04f2-7c87-4f30-8f05-6a27444a214f admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:01.661652 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e04f2-7c87-4f30-8f05-6a27444a214f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:12:01.664467 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e04f2-7c87-4f30-8f05-6a27444a214f admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:12:01.715609 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1217/2442] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:12:01 2022] POST /identity/v3/projects => generated 371 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:12:01.721101 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c639ff4-cc69-4980-87b7-ba095c74fc46 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:12:01.739757 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c639ff4-cc69-4980-87b7-ba095c74fc46 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:12:01.817474 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faed34f-c470-40af-9101-0e8a3e2c2416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:12:01.818113 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faed34f-c470-40af-9101-0e8a3e2c2416 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:01.818438 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faed34f-c470-40af-9101-0e8a3e2c2416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:01.818728 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faed34f-c470-40af-9101-0e8a3e2c2416 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:01.819408 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faed34f-c470-40af-9101-0e8a3e2c2416 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:12:01.821443 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faed34f-c470-40af-9101-0e8a3e2c2416 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:12:01.850631 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1226/2443] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:12:01 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:12:01.855163 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e04f2-7c87-4f30-8f05-6a27444a214f admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:12:01.869425 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e04f2-7c87-4f30-8f05-6a27444a214f admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:12:01.874452 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4c754-c863-4076-a172-51f38cabedd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:12:01.875648 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4c754-c863-4076-a172-51f38cabedd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:01.876127 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4c754-c863-4076-a172-51f38cabedd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:01.876396 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4c754-c863-4076-a172-51f38cabedd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:01.877113 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4c754-c863-4076-a172-51f38cabedd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:12:01.878823 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4c754-c863-4076-a172-51f38cabedd3 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:12:01.891262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1218/2444] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:12:01.899474 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faed34f-c470-40af-9101-0e8a3e2c2416 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:12:01.916208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faed34f-c470-40af-9101-0e8a3e2c2416 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:12:01.926628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e91b77-d77f-41dd-88b9-8c2f5cc8caaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:12:01.927454 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e91b77-d77f-41dd-88b9-8c2f5cc8caaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:01.927796 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e91b77-d77f-41dd-88b9-8c2f5cc8caaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:01.928073 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e91b77-d77f-41dd-88b9-8c2f5cc8caaa admin admin] PATH_INFO: `/v3/projects/6b085a3c98af4294852923eb3d19e1fa/users/357f83d2106e45039ea21505b53364a8/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:01.964641 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e91b77-d77f-41dd-88b9-8c2f5cc8caaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b085a3c98af4294852923eb3d19e1fa, user_id=357f83d2106e45039ea21505b53364a8, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:12:01.967526 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e91b77-d77f-41dd-88b9-8c2f5cc8caaa admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:12:01.987767 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1227/2445] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:12:01 2022] PUT /identity/v3/projects/6b085a3c98af4294852923eb3d19e1fa/users/357f83d2106e45039ea21505b53364a8/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:12:01.993860 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4c754-c863-4076-a172-51f38cabedd3 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:12:02.011769 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4c754-c863-4076-a172-51f38cabedd3 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:12:02.111980 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fadfc2-2a47-4d80-8a95-262cfb12059e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:12:02.113021 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fadfc2-2a47-4d80-8a95-262cfb12059e admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:02.119437 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fadfc2-2a47-4d80-8a95-262cfb12059e admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:02.120020 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fadfc2-2a47-4d80-8a95-262cfb12059e admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:02.121477 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fadfc2-2a47-4d80-8a95-262cfb12059e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:12:02.125706 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fadfc2-2a47-4d80-8a95-262cfb12059e admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:12:02.147105 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1219/2446] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:12:02.153111 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e91b77-d77f-41dd-88b9-8c2f5cc8caaa admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:12:02.164720 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e91b77-d77f-41dd-88b9-8c2f5cc8caaa admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:12:02.170070 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a4e6a-3bb8-4990-9eb8-60d37c0543a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:12:02.170657 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a4e6a-3bb8-4990-9eb8-60d37c0543a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:02.170930 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a4e6a-3bb8-4990-9eb8-60d37c0543a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:02.171211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a4e6a-3bb8-4990-9eb8-60d37c0543a7 admin admin] PATH_INFO: `/v3/projects/6b085a3c98af4294852923eb3d19e1fa/users/357f83d2106e45039ea21505b53364a8/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:02.176896 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a4e6a-3bb8-4990-9eb8-60d37c0543a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b085a3c98af4294852923eb3d19e1fa, user_id=357f83d2106e45039ea21505b53364a8, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:12:02.182113 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a4e6a-3bb8-4990-9eb8-60d37c0543a7 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:12:02.207381 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1228/2447] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:12:02 2022] PUT /identity/v3/projects/6b085a3c98af4294852923eb3d19e1fa/users/357f83d2106e45039ea21505b53364a8/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:12:03.421075 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798de5e6-f22b-45c3-b16f-80e05a91ac11 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:03.422466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798de5e6-f22b-45c3-b16f-80e05a91ac11 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:03.422661 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798de5e6-f22b-45c3-b16f-80e05a91ac11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:03.451447 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:12:03.467066 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-798de5e6-f22b-45c3-b16f-80e05a91ac11 None None] MFA Rules not processed for user `357f83d2106e45039ea21505b53364a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:12:03.469002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-798de5e6-f22b-45c3-b16f-80e05a91ac11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:12:03.616036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1220/2448] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:12:03 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:12:03.627647 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e41bba-59bc-4a44-9902-824215e973b8 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:03.628520 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e41bba-59bc-4a44-9902-824215e973b8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:03.628996 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e41bba-59bc-4a44-9902-824215e973b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:03.645920 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:12:03.688841 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-e2e41bba-59bc-4a44-9902-824215e973b8 None None] MFA Rules not processed for user `0223ad2c972b48318d3d0936b8972bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:12:03.692357 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e2e41bba-59bc-4a44-9902-824215e973b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:12:03.870624 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1229/2449] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:12:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:12:03.995620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798de5e6-f22b-45c3-b16f-80e05a91ac11 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:12:03.997244 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-798de5e6-f22b-45c3-b16f-80e05a91ac11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:12:04.116276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798de5e6-f22b-45c3-b16f-80e05a91ac11 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:12:04.127911 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96406232-351f-4833-b73f-580945921d1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:12:04.128988 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96406232-351f-4833-b73f-580945921d1a service nova] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:04.129491 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96406232-351f-4833-b73f-580945921d1a service nova] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:04.129973 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96406232-351f-4833-b73f-580945921d1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:04.145668 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96406232-351f-4833-b73f-580945921d1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:12:04.148228 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96406232-351f-4833-b73f-580945921d1a service nova] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:12:04.165147 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1221/2450] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:12:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:12:08.559148 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e41bba-59bc-4a44-9902-824215e973b8 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:12:08.651347 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e41bba-59bc-4a44-9902-824215e973b8 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:12:08.656603 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8042e88-42ee-4b8c-aaa2-6ebf28370ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:12:08.657586 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8042e88-42ee-4b8c-aaa2-6ebf28370ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:08.658013 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8042e88-42ee-4b8c-aaa2-6ebf28370ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:08.658181 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8042e88-42ee-4b8c-aaa2-6ebf28370ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:08.660571 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c8042e88-42ee-4b8c-aaa2-6ebf28370ad1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:12:08.766239 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8042e88-42ee-4b8c-aaa2-6ebf28370ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:12:08.769114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8042e88-42ee-4b8c-aaa2-6ebf28370ad1 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:12:08.794019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1230/2451] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:12:08 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:12:14.157569 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=63 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:12:18.781441 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=74 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:12:25.481392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96406232-351f-4833-b73f-580945921d1a service nova] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:12:25.483013 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-96406232-351f-4833-b73f-580945921d1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:12:25.602592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96406232-351f-4833-b73f-580945921d1a service nova] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:12:25.606855 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f457907-963d-43aa-b3dd-3cc457a5dac6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:12:25.607493 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f457907-963d-43aa-b3dd-3cc457a5dac6 service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:25.607770 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f457907-963d-43aa-b3dd-3cc457a5dac6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:25.608104 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f457907-963d-43aa-b3dd-3cc457a5dac6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:25.652114 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f457907-963d-43aa-b3dd-3cc457a5dac6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:12:25.653568 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f457907-963d-43aa-b3dd-3cc457a5dac6 service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:12:25.666093 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1222/2452] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:12:25 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:12:26.358587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2933b-4a34-4a55-88de-5625303f7464 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:26.359114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2933b-4a34-4a55-88de-5625303f7464 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:26.359540 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2933b-4a34-4a55-88de-5625303f7464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:26.412583 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-b8b2933b-4a34-4a55-88de-5625303f7464 None None] MFA Rules not processed for user `c607472800fc49d5a75c5e6acb33f2a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:12:26.414702 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b8b2933b-4a34-4a55-88de-5625303f7464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:12:26.508373 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1231/2453] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 09:12:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:12:26.576303 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f457907-963d-43aa-b3dd-3cc457a5dac6 service cinder] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:12:26.577839 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-1f457907-963d-43aa-b3dd-3cc457a5dac6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:12:26.713374 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f457907-963d-43aa-b3dd-3cc457a5dac6 service cinder] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:12:26.721959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6c1ed-9b8e-4bf6-b0df-f9c84f85944b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158ea5c9dd5142eebd903d5f732997ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:12:26.722945 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6c1ed-9b8e-4bf6-b0df-f9c84f85944b service swift] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:26.723378 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6c1ed-9b8e-4bf6-b0df-f9c84f85944b service swift] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:26.723762 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6c1ed-9b8e-4bf6-b0df-f9c84f85944b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:26.738903 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6c1ed-9b8e-4bf6-b0df-f9c84f85944b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:12:26.741617 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6c1ed-9b8e-4bf6-b0df-f9c84f85944b service swift] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:12:26.757777 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1223/2454] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 09:12:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 09:12:36.494044 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=32 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:12:36.751081 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=80 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:12:44.734657 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6386bf-2cbd-4fe9-b842-abe4920ddb32 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:44.736221 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6386bf-2cbd-4fe9-b842-abe4920ddb32 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:44.736221 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6386bf-2cbd-4fe9-b842-abe4920ddb32 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:44.736810 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1232/2455] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 09:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 09:12:44.746620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ba133-61c3-4faa-aa8b-fdf2abbec5fb None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:44.747785 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ba133-61c3-4faa-aa8b-fdf2abbec5fb None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:44.748065 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ba133-61c3-4faa-aa8b-fdf2abbec5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:44.828645 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-269ba133-61c3-4faa-aa8b-fdf2abbec5fb None None] MFA Rules not processed for user `c30bc55c6a1348bb961f0d010422da87`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:12:44.831446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-269ba133-61c3-4faa-aa8b-fdf2abbec5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:12:44.865458 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1224/2456] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 09:12:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:12:44.887183 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6386bf-2cbd-4fe9-b842-abe4920ddb32 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:12:44.889138 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fc6386bf-2cbd-4fe9-b842-abe4920ddb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:12:44.981091 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6386bf-2cbd-4fe9-b842-abe4920ddb32 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:12:44.986034 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32acf4e1-a5cc-49c4-b2f6-ecc294a3cf5a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713805e0f1174a01987014319075ec03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:12:44.987197 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acf4e1-a5cc-49c4-b2f6-ecc294a3cf5a service glance] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:44.987545 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acf4e1-a5cc-49c4-b2f6-ecc294a3cf5a service glance] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:44.987899 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acf4e1-a5cc-49c4-b2f6-ecc294a3cf5a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:45.004076 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32acf4e1-a5cc-49c4-b2f6-ecc294a3cf5a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:12:45.006278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32acf4e1-a5cc-49c4-b2f6-ecc294a3cf5a service glance] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:12:45.020050 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1233/2457] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:12:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:12:45.125901 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c8242-dba9-47c5-8e6a-4938ce43866d None None] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:45.126199 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c8242-dba9-47c5-8e6a-4938ce43866d None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:45.126530 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c8242-dba9-47c5-8e6a-4938ce43866d None None] PATH_INFO: `/` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:45.128063 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1225/2458] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 09:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 09:12:45.138294 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b2976-fed9-428a-980a-9f55852f8fdf None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:45.139037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b2976-fed9-428a-980a-9f55852f8fdf None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:45.139803 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b2976-fed9-428a-980a-9f55852f8fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:45.228788 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-732b2976-fed9-428a-980a-9f55852f8fdf None None] MFA Rules not processed for user `b018ac10ad804c6cbbe7fdcc1cec61e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:12:45.230166 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-732b2976-fed9-428a-980a-9f55852f8fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:12:45.262495 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1234/2459] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 09:12:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:12:45.276367 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c8242-dba9-47c5-8e6a-4938ce43866d None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:12:45.279035 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-c59c8242-dba9-47c5-8e6a-4938ce43866d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:12:45.305256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c8242-dba9-47c5-8e6a-4938ce43866d None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:12:45.312305 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c712a4-86da-403c-8c4a-404f19fa9322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:12:45.315976 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c712a4-86da-403c-8c4a-404f19fa9322 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:45.316457 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c712a4-86da-403c-8c4a-404f19fa9322 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:45.316941 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c712a4-86da-403c-8c4a-404f19fa9322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:45.331938 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c712a4-86da-403c-8c4a-404f19fa9322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:12:45.334821 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c712a4-86da-403c-8c4a-404f19fa9322 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:12:45.352373 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1226/2460] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:12:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:12:45.489254 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c58a93-f6a8-4012-b86f-7bc322d71953 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:45.489767 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c58a93-f6a8-4012-b86f-7bc322d71953 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:45.490283 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c58a93-f6a8-4012-b86f-7bc322d71953 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:45.492450 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1235/2461] 10.222.0.65 () {54 vars in 921 bytes} [Wed Jul 27 09:12:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 09:12:45.500997 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350ec1a-f38b-4eea-9a40-0fcef53fe87f None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:45.501358 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350ec1a-f38b-4eea-9a40-0fcef53fe87f None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:45.501824 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350ec1a-f38b-4eea-9a40-0fcef53fe87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:45.527980 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-9350ec1a-f38b-4eea-9a40-0fcef53fe87f None None] MFA Rules not processed for user `c30bc55c6a1348bb961f0d010422da87`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:12:45.529233 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-9350ec1a-f38b-4eea-9a40-0fcef53fe87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:12:45.544217 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1227/2462] 10.222.0.65 () {58 vars in 1018 bytes} [Wed Jul 27 09:12:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:12:45.559155 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c58a93-f6a8-4012-b86f-7bc322d71953 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:12:45.575184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c58a93-f6a8-4012-b86f-7bc322d71953 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:12:45.581512 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ae65f-88d2-4970-a2cd-d8d19ab006ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:12:45.582786 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ae65f-88d2-4970-a2cd-d8d19ab006ba service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:45.583206 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ae65f-88d2-4970-a2cd-d8d19ab006ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:45.584155 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ae65f-88d2-4970-a2cd-d8d19ab006ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:45.604457 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ae65f-88d2-4970-a2cd-d8d19ab006ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:12:45.608815 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ae65f-88d2-4970-a2cd-d8d19ab006ba service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:12:45.632510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1236/2463] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:12:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:12:47.929835 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6cf96-114c-4d89-bee1-abeefeecdac9 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:47.930659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6cf96-114c-4d89-bee1-abeefeecdac9 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:47.931941 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6cf96-114c-4d89-bee1-abeefeecdac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:47.960100 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-70b6cf96-114c-4d89-bee1-abeefeecdac9 None None] MFA Rules not processed for user `c607472800fc49d5a75c5e6acb33f2a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:12:47.961248 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-70b6cf96-114c-4d89-bee1-abeefeecdac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:12:47.968792 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1228/2464] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 09:12:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:12:47.982451 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ae65f-88d2-4970-a2cd-d8d19ab006ba service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:12:48.002075 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ae65f-88d2-4970-a2cd-d8d19ab006ba service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:12:48.008403 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0238b-858c-4076-a146-7a8219368218 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158ea5c9dd5142eebd903d5f732997ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:12:48.009051 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0238b-858c-4076-a146-7a8219368218 service swift] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:48.009335 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0238b-858c-4076-a146-7a8219368218 service swift] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:48.009605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0238b-858c-4076-a146-7a8219368218 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:48.020831 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d0238b-858c-4076-a146-7a8219368218 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:12:48.022635 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d0238b-858c-4076-a146-7a8219368218 service swift] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:12:48.032636 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1237/2465] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 09:12:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 09:12:50.304999 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6cf96-114c-4d89-bee1-abeefeecdac9 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:12:50.448012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6cf96-114c-4d89-bee1-abeefeecdac9 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:12:50.454709 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f5f1d-04ec-484d-ab66-83aeb3676c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:12:50.455643 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f5f1d-04ec-484d-ab66-83aeb3676c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:50.456057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f5f1d-04ec-484d-ab66-83aeb3676c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:50.456382 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f5f1d-04ec-484d-ab66-83aeb3676c5f admin admin] PATH_INFO: `/v3/users/0223ad2c972b48318d3d0936b8972bd1` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:50.457745 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f5f1d-04ec-484d-ab66-83aeb3676c5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0223ad2c972b48318d3d0936b8972bd1)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:12:50.459701 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f5f1d-04ec-484d-ab66-83aeb3676c5f admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:12:50.542500 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-f37f5f1d-04ec-484d-ab66-83aeb3676c5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0223ad2c972b48318d3d0936b8972bd1'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:12:50.543524 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-f37f5f1d-04ec-484d-ab66-83aeb3676c5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0223ad2c972b48318d3d0936b8972bd1'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:12:50.544223 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-f37f5f1d-04ec-484d-ab66-83aeb3676c5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0223ad2c972b48318d3d0936b8972bd1'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:12:50.555536 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-f37f5f1d-04ec-484d-ab66-83aeb3676c5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0223ad2c972b48318d3d0936b8972bd1'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:12:50.572033 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-f37f5f1d-04ec-484d-ab66-83aeb3676c5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0223ad2c972b48318d3d0936b8972bd1'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:12:50.584342 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:12:50.592038 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1229/2466] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:12:50 2022] DELETE /identity/v3/users/0223ad2c972b48318d3d0936b8972bd1 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:12:50.863079 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0238b-858c-4076-a146-7a8219368218 service swift] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:12:50.877558 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0238b-858c-4076-a146-7a8219368218 service swift] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:12:50.974438 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a441e2-8c25-4afe-9d39-e0703be32416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:12:50.975147 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a441e2-8c25-4afe-9d39-e0703be32416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:50.975453 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a441e2-8c25-4afe-9d39-e0703be32416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:50.975740 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a441e2-8c25-4afe-9d39-e0703be32416 admin admin] PATH_INFO: `/v3/projects/719279116dc74c0cac44f1d0c0fecf47` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:50.977095 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a441e2-8c25-4afe-9d39-e0703be32416 admin admin] RBAC: Authorizing `identity:delete_project(project_id=719279116dc74c0cac44f1d0c0fecf47)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:12:50.979202 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a441e2-8c25-4afe-9d39-e0703be32416 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:12:51.056576 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b7a441e2-8c25-4afe-9d39-e0703be32416 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '719279116dc74c0cac44f1d0c0fecf47', 'request_id': 'req-b7a441e2-8c25-4afe-9d39-e0703be32416'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:12:51.061204 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:12:51.068605 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b7a441e2-8c25-4afe-9d39-e0703be32416 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '719279116dc74c0cac44f1d0c0fecf47', 'request_id': 'req-b7a441e2-8c25-4afe-9d39-e0703be32416'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:12:51.080189 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b7a441e2-8c25-4afe-9d39-e0703be32416 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '719279116dc74c0cac44f1d0c0fecf47', 'request_id': 'req-b7a441e2-8c25-4afe-9d39-e0703be32416'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:12:51.137242 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b7a441e2-8c25-4afe-9d39-e0703be32416 admin admin] The token cache is being invalidate because project 719279116dc74c0cac44f1d0c0fecf47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:12:51.138035 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b7a441e2-8c25-4afe-9d39-e0703be32416 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:12:51.139250 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b7a441e2-8c25-4afe-9d39-e0703be32416 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:12:51.145128 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1238/2467] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:12:50 2022] DELETE /identity/v3/projects/719279116dc74c0cac44f1d0c0fecf47 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:12:51.147123 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f5f1d-04ec-484d-ab66-83aeb3676c5f admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:12:51.149559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-f37f5f1d-04ec-484d-ab66-83aeb3676c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:12:51.168454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f5f1d-04ec-484d-ab66-83aeb3676c5f admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:12:51.292124 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa6449-b28e-4671-99fa-1a8bd51885a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:12:51.293378 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa6449-b28e-4671-99fa-1a8bd51885a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:51.293814 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa6449-b28e-4671-99fa-1a8bd51885a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:51.294311 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa6449-b28e-4671-99fa-1a8bd51885a2 admin admin] PATH_INFO: `/v3/users/357f83d2106e45039ea21505b53364a8` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:51.296444 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa6449-b28e-4671-99fa-1a8bd51885a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=357f83d2106e45039ea21505b53364a8)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:12:51.301032 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa6449-b28e-4671-99fa-1a8bd51885a2 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:12:51.416905 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-08fa6449-b28e-4671-99fa-1a8bd51885a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '357f83d2106e45039ea21505b53364a8'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:12:51.418503 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-08fa6449-b28e-4671-99fa-1a8bd51885a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '357f83d2106e45039ea21505b53364a8'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:12:51.419520 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-08fa6449-b28e-4671-99fa-1a8bd51885a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '357f83d2106e45039ea21505b53364a8'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:12:51.442370 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-08fa6449-b28e-4671-99fa-1a8bd51885a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '357f83d2106e45039ea21505b53364a8'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:12:51.472836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-08fa6449-b28e-4671-99fa-1a8bd51885a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '357f83d2106e45039ea21505b53364a8'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:12:51.514957 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1230/2468] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:12:51 2022] DELETE /identity/v3/users/357f83d2106e45039ea21505b53364a8 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:12:51.841653 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a441e2-8c25-4afe-9d39-e0703be32416 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:12:51.845981 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b7a441e2-8c25-4afe-9d39-e0703be32416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:12:51.899869 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a441e2-8c25-4afe-9d39-e0703be32416 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:12:51.984853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d52ca-fe63-44ed-93a0-c67623e33082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:12:51.986108 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d52ca-fe63-44ed-93a0-c67623e33082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:51.986561 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d52ca-fe63-44ed-93a0-c67623e33082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:51.987496 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d52ca-fe63-44ed-93a0-c67623e33082 admin admin] PATH_INFO: `/v3/projects/6b085a3c98af4294852923eb3d19e1fa` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:51.988557 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d52ca-fe63-44ed-93a0-c67623e33082 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b085a3c98af4294852923eb3d19e1fa)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:12:51.990699 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d52ca-fe63-44ed-93a0-c67623e33082 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:12:52.083959 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-093d52ca-fe63-44ed-93a0-c67623e33082 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b085a3c98af4294852923eb3d19e1fa', 'request_id': 'req-093d52ca-fe63-44ed-93a0-c67623e33082'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:12:52.093800 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-093d52ca-fe63-44ed-93a0-c67623e33082 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b085a3c98af4294852923eb3d19e1fa', 'request_id': 'req-093d52ca-fe63-44ed-93a0-c67623e33082'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:12:52.101040 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-093d52ca-fe63-44ed-93a0-c67623e33082 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b085a3c98af4294852923eb3d19e1fa', 'request_id': 'req-093d52ca-fe63-44ed-93a0-c67623e33082'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:12:52.123631 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-093d52ca-fe63-44ed-93a0-c67623e33082 admin admin] The token cache is being invalidate because project 6b085a3c98af4294852923eb3d19e1fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:12:52.124227 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-093d52ca-fe63-44ed-93a0-c67623e33082 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:12:52.125501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-093d52ca-fe63-44ed-93a0-c67623e33082 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:12:52.129568 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1239/2469] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:12:51 2022] DELETE /identity/v3/projects/6b085a3c98af4294852923eb3d19e1fa => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:12:52.135007 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df61cc2-e0a8-4d34-9c37-eb859cabfb25 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:52.135326 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df61cc2-e0a8-4d34-9c37-eb859cabfb25 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:52.135654 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df61cc2-e0a8-4d34-9c37-eb859cabfb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:52.219506 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-0df61cc2-e0a8-4d34-9c37-eb859cabfb25 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:12:52.229240 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-0df61cc2-e0a8-4d34-9c37-eb859cabfb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:12:52.332149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:12:52.349379 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1231/2470] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:12:52.362353 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ad3cb-5e4d-4c35-b8b6-15a1ff639c41 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:52.363173 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ad3cb-5e4d-4c35-b8b6-15a1ff639c41 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:52.363623 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ad3cb-5e4d-4c35-b8b6-15a1ff639c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:52.388123 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-1d0ad3cb-5e4d-4c35-b8b6-15a1ff639c41 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:12:52.389433 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1d0ad3cb-5e4d-4c35-b8b6-15a1ff639c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:12:52.399496 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1240/2471] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:12:52.405044 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df61cc2-e0a8-4d34-9c37-eb859cabfb25 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:12:52.431200 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df61cc2-e0a8-4d34-9c37-eb859cabfb25 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:12:52.439181 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663eba0-c20f-42e3-9712-eae545a93fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:12:52.439837 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663eba0-c20f-42e3-9712-eae545a93fbd admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:52.440124 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663eba0-c20f-42e3-9712-eae545a93fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:52.440401 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663eba0-c20f-42e3-9712-eae545a93fbd admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:52.441161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663eba0-c20f-42e3-9712-eae545a93fbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:12:52.441474 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663eba0-c20f-42e3-9712-eae545a93fbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:12:52.443192 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663eba0-c20f-42e3-9712-eae545a93fbd admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:12:52.459013 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1232/2472] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:12:52.464399 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ad3cb-5e4d-4c35-b8b6-15a1ff639c41 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:12:52.477647 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ad3cb-5e4d-4c35-b8b6-15a1ff639c41 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:12:52.483731 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2814c-8d90-4388-b24d-10fe639d5ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:12:52.484373 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2814c-8d90-4388-b24d-10fe639d5ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:52.484664 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2814c-8d90-4388-b24d-10fe639d5ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:52.485142 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2814c-8d90-4388-b24d-10fe639d5ed7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:52.486629 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2814c-8d90-4388-b24d-10fe639d5ed7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:12:52.489180 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2814c-8d90-4388-b24d-10fe639d5ed7 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:12:52.537615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1241/2473] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:12:52 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:12:52.543288 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663eba0-c20f-42e3-9712-eae545a93fbd admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:12:52.575294 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663eba0-c20f-42e3-9712-eae545a93fbd admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:12:52.651013 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25bc13f-de34-4275-b463-78fcfe8ba65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:12:52.651651 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bc13f-de34-4275-b463-78fcfe8ba65a admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:52.651923 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bc13f-de34-4275-b463-78fcfe8ba65a admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:52.652195 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bc13f-de34-4275-b463-78fcfe8ba65a admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:52.653183 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25bc13f-de34-4275-b463-78fcfe8ba65a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:12:52.655257 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25bc13f-de34-4275-b463-78fcfe8ba65a admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:12:52.684034 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1233/2474] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:12:52 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:12:52.689040 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2814c-8d90-4388-b24d-10fe639d5ed7 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:12:52.709008 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2814c-8d90-4388-b24d-10fe639d5ed7 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:12:52.715521 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b92347-2b58-4e1f-9eb7-07ca0b5182fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:12:52.716150 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b92347-2b58-4e1f-9eb7-07ca0b5182fe admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:52.716456 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b92347-2b58-4e1f-9eb7-07ca0b5182fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:52.716729 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b92347-2b58-4e1f-9eb7-07ca0b5182fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:52.717461 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b92347-2b58-4e1f-9eb7-07ca0b5182fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:12:52.719206 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b92347-2b58-4e1f-9eb7-07ca0b5182fe admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:12:52.739372 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1242/2475] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:12:52.745878 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25bc13f-de34-4275-b463-78fcfe8ba65a admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:12:52.760273 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25bc13f-de34-4275-b463-78fcfe8ba65a admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:12:52.765776 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2db55e-3b42-4805-b032-e92648177eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:12:52.767023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2db55e-3b42-4805-b032-e92648177eed admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:52.767379 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2db55e-3b42-4805-b032-e92648177eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:52.767562 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2db55e-3b42-4805-b032-e92648177eed admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:52.768324 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2db55e-3b42-4805-b032-e92648177eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:12:52.770004 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2db55e-3b42-4805-b032-e92648177eed admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:12:52.786389 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1234/2476] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:12:52.789809 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b92347-2b58-4e1f-9eb7-07ca0b5182fe admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:12:52.803500 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b92347-2b58-4e1f-9eb7-07ca0b5182fe admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:12:52.808966 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744627ec-318c-4678-936b-9d3ef00b6832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:12:52.809675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744627ec-318c-4678-936b-9d3ef00b6832 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:52.809997 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744627ec-318c-4678-936b-9d3ef00b6832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:52.810275 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744627ec-318c-4678-936b-9d3ef00b6832 admin admin] PATH_INFO: `/v3/projects/cc840092c765407290b1a0aa1d153b2b/users/fff4b436aed94676b7fc5b587fb009bb/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:52.829942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744627ec-318c-4678-936b-9d3ef00b6832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc840092c765407290b1a0aa1d153b2b, user_id=fff4b436aed94676b7fc5b587fb009bb, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:12:52.833265 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744627ec-318c-4678-936b-9d3ef00b6832 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:12:52.837242 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:12:52.858689 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1243/2477] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:12:52 2022] PUT /identity/v3/projects/cc840092c765407290b1a0aa1d153b2b/users/fff4b436aed94676b7fc5b587fb009bb/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:12:52.879778 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c39b9-46c1-46dc-af32-2807a64f888f None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:52.880288 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c39b9-46c1-46dc-af32-2807a64f888f None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:52.880704 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c39b9-46c1-46dc-af32-2807a64f888f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:52.927965 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-7b4c39b9-46c1-46dc-af32-2807a64f888f None None] MFA Rules not processed for user `fff4b436aed94676b7fc5b587fb009bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:12:52.929988 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-7b4c39b9-46c1-46dc-af32-2807a64f888f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:12:53.044801 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1235/2478] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:12:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:12:53.057555 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744627ec-318c-4678-936b-9d3ef00b6832 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:12:53.059539 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-744627ec-318c-4678-936b-9d3ef00b6832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:12:53.163688 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744627ec-318c-4678-936b-9d3ef00b6832 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:12:53.167661 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51803e-6ac0-4846-b2c7-dff005d2d773 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:12:53.168310 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51803e-6ac0-4846-b2c7-dff005d2d773 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:12:53.168584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51803e-6ac0-4846-b2c7-dff005d2d773 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:12:53.168857 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51803e-6ac0-4846-b2c7-dff005d2d773 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:12:53.179328 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51803e-6ac0-4846-b2c7-dff005d2d773 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:12:53.180878 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51803e-6ac0-4846-b2c7-dff005d2d773 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:12:53.193877 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1244/2479] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:12:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:13:03.041174 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=73,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:03.187168 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=37 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:05.028584 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c39b9-46c1-46dc-af32-2807a64f888f None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:05.102972 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c39b9-46c1-46dc-af32-2807a64f888f None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:05.107836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2175478-1376-4c0b-9b8b-bba56443114c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:05.108918 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2175478-1376-4c0b-9b8b-bba56443114c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:05.109273 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2175478-1376-4c0b-9b8b-bba56443114c admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:05.109601 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2175478-1376-4c0b-9b8b-bba56443114c admin admin] PATH_INFO: `/v3/users/fff4b436aed94676b7fc5b587fb009bb` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:05.111939 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2175478-1376-4c0b-9b8b-bba56443114c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fff4b436aed94676b7fc5b587fb009bb)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:05.114239 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2175478-1376-4c0b-9b8b-bba56443114c admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:05.178794 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-a2175478-1376-4c0b-9b8b-bba56443114c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fff4b436aed94676b7fc5b587fb009bb'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:05.179542 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-a2175478-1376-4c0b-9b8b-bba56443114c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fff4b436aed94676b7fc5b587fb009bb'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:05.180376 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-a2175478-1376-4c0b-9b8b-bba56443114c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fff4b436aed94676b7fc5b587fb009bb'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:05.190452 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-a2175478-1376-4c0b-9b8b-bba56443114c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fff4b436aed94676b7fc5b587fb009bb'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:05.209090 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-a2175478-1376-4c0b-9b8b-bba56443114c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fff4b436aed94676b7fc5b587fb009bb'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:05.227080 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1236/2480] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:13:05 2022] DELETE /identity/v3/users/fff4b436aed94676b7fc5b587fb009bb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:13:05.232064 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d5de8-f743-4684-bd7e-bcb98ba0e3d0 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:05.232942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d5de8-f743-4684-bd7e-bcb98ba0e3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:05.233405 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d5de8-f743-4684-bd7e-bcb98ba0e3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:05.256519 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-fa8d5de8-f743-4684-bd7e-bcb98ba0e3d0 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:13:05.257686 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fa8d5de8-f743-4684-bd7e-bcb98ba0e3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:05.337770 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1245/2481] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:13:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:13:05.349252 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2175478-1376-4c0b-9b8b-bba56443114c admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:05.351286 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-a2175478-1376-4c0b-9b8b-bba56443114c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:05.421502 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2175478-1376-4c0b-9b8b-bba56443114c admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:05.426199 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6db21-88df-45b7-b2d1-186fa01b914d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:05.426880 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6db21-88df-45b7-b2d1-186fa01b914d service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:05.427164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6db21-88df-45b7-b2d1-186fa01b914d service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:05.427468 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6db21-88df-45b7-b2d1-186fa01b914d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:05.437935 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6db21-88df-45b7-b2d1-186fa01b914d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:05.440249 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6db21-88df-45b7-b2d1-186fa01b914d service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:05.451211 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1237/2482] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:13:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:13:05.868877 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d5de8-f743-4684-bd7e-bcb98ba0e3d0 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:05.871107 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fa8d5de8-f743-4684-bd7e-bcb98ba0e3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:05.889574 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d5de8-f743-4684-bd7e-bcb98ba0e3d0 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:05.900162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93720f4-397e-4583-a5f7-0be1bde25028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:05.901244 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93720f4-397e-4583-a5f7-0be1bde25028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:05.901596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93720f4-397e-4583-a5f7-0be1bde25028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:05.902090 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93720f4-397e-4583-a5f7-0be1bde25028 admin admin] PATH_INFO: `/v3/projects/cc840092c765407290b1a0aa1d153b2b` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:05.903816 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93720f4-397e-4583-a5f7-0be1bde25028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc840092c765407290b1a0aa1d153b2b)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:05.906622 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93720f4-397e-4583-a5f7-0be1bde25028 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:05.986989 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c93720f4-397e-4583-a5f7-0be1bde25028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc840092c765407290b1a0aa1d153b2b', 'request_id': 'req-c93720f4-397e-4583-a5f7-0be1bde25028'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:05.996029 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c93720f4-397e-4583-a5f7-0be1bde25028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc840092c765407290b1a0aa1d153b2b', 'request_id': 'req-c93720f4-397e-4583-a5f7-0be1bde25028'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:06.003959 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c93720f4-397e-4583-a5f7-0be1bde25028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc840092c765407290b1a0aa1d153b2b', 'request_id': 'req-c93720f4-397e-4583-a5f7-0be1bde25028'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:06.023932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c93720f4-397e-4583-a5f7-0be1bde25028 admin admin] The token cache is being invalidate because project cc840092c765407290b1a0aa1d153b2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:13:06.024399 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c93720f4-397e-4583-a5f7-0be1bde25028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:06.025511 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c93720f4-397e-4583-a5f7-0be1bde25028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:06.027998 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1246/2483] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:13:05 2022] DELETE /identity/v3/projects/cc840092c765407290b1a0aa1d153b2b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:13:06.035270 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181f051-9479-4891-bfe1-51713d8da21c None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:06.036084 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181f051-9479-4891-bfe1-51713d8da21c None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:06.036084 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181f051-9479-4891-bfe1-51713d8da21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:06.070009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-9181f051-9479-4891-bfe1-51713d8da21c None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:13:06.072202 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-9181f051-9479-4891-bfe1-51713d8da21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:06.103935 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:06.215557 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1238/2484] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:13:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:13:06.230884 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eabb85-603e-4f23-8a71-956883838f50 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:06.231392 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eabb85-603e-4f23-8a71-956883838f50 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:06.231897 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eabb85-603e-4f23-8a71-956883838f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:06.264539 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-94eabb85-603e-4f23-8a71-956883838f50 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:13:06.266657 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-94eabb85-603e-4f23-8a71-956883838f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:06.280010 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1247/2485] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:13:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:13:06.286494 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181f051-9479-4891-bfe1-51713d8da21c None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:06.307017 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181f051-9479-4891-bfe1-51713d8da21c None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:06.315588 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728997f-da97-4920-8b1a-3d3a4eb44730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:06.316524 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728997f-da97-4920-8b1a-3d3a4eb44730 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:06.316989 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728997f-da97-4920-8b1a-3d3a4eb44730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:06.317455 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728997f-da97-4920-8b1a-3d3a4eb44730 admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:06.318724 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7728997f-da97-4920-8b1a-3d3a4eb44730 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:13:06.319225 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7728997f-da97-4920-8b1a-3d3a4eb44730 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:06.322508 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7728997f-da97-4920-8b1a-3d3a4eb44730 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:06.343255 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1239/2486] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:13:06.348728 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eabb85-603e-4f23-8a71-956883838f50 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:06.361478 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eabb85-603e-4f23-8a71-956883838f50 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:06.367161 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef449a9-c14a-4f4c-8bd5-44784ab4e174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:06.368150 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef449a9-c14a-4f4c-8bd5-44784ab4e174 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:06.368537 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef449a9-c14a-4f4c-8bd5-44784ab4e174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:06.368998 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef449a9-c14a-4f4c-8bd5-44784ab4e174 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:06.369769 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef449a9-c14a-4f4c-8bd5-44784ab4e174 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:06.372558 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef449a9-c14a-4f4c-8bd5-44784ab4e174 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:06.413907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1248/2487] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:13:06 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:13:06.419545 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728997f-da97-4920-8b1a-3d3a4eb44730 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:06.431860 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728997f-da97-4920-8b1a-3d3a4eb44730 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:06.507538 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c8ac2-caf9-44fe-afbe-4ed96207c1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:06.508330 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c8ac2-caf9-44fe-afbe-4ed96207c1d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:06.508726 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c8ac2-caf9-44fe-afbe-4ed96207c1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:06.509100 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c8ac2-caf9-44fe-afbe-4ed96207c1d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:06.510112 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c8ac2-caf9-44fe-afbe-4ed96207c1d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:06.512570 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c8ac2-caf9-44fe-afbe-4ed96207c1d6 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:06.547684 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1240/2488] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:13:06 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:13:06.549591 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef449a9-c14a-4f4c-8bd5-44784ab4e174 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:06.565854 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef449a9-c14a-4f4c-8bd5-44784ab4e174 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:06.573210 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1fed7-1176-45d7-91d0-3122919722eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:06.574250 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1fed7-1176-45d7-91d0-3122919722eb admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:06.574787 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1fed7-1176-45d7-91d0-3122919722eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:06.575275 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1fed7-1176-45d7-91d0-3122919722eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:06.576529 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1fed7-1176-45d7-91d0-3122919722eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:06.580049 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1fed7-1176-45d7-91d0-3122919722eb admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:06.600488 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1249/2489] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:13:06.604749 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c8ac2-caf9-44fe-afbe-4ed96207c1d6 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:06.616509 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c8ac2-caf9-44fe-afbe-4ed96207c1d6 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:06.621536 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554d6dc-1ae1-49c3-bb56-af28d28077cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:06.622181 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554d6dc-1ae1-49c3-bb56-af28d28077cf admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:06.622500 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554d6dc-1ae1-49c3-bb56-af28d28077cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:06.622786 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554d6dc-1ae1-49c3-bb56-af28d28077cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:06.623508 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554d6dc-1ae1-49c3-bb56-af28d28077cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:06.625169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554d6dc-1ae1-49c3-bb56-af28d28077cf admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:06.636934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1241/2490] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:13:06.643783 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1fed7-1176-45d7-91d0-3122919722eb admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:06.662509 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1fed7-1176-45d7-91d0-3122919722eb admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:06.671062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7e3c4-6de5-420f-b3a9-a6680db0911a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:06.672229 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7e3c4-6de5-420f-b3a9-a6680db0911a admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:06.672727 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7e3c4-6de5-420f-b3a9-a6680db0911a admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:06.674459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7e3c4-6de5-420f-b3a9-a6680db0911a admin admin] PATH_INFO: `/v3/projects/ed417c359d064c678a34df323e743478/users/df249aada9644365b79f24283d8e3407/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:06.703343 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7e3c4-6de5-420f-b3a9-a6680db0911a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed417c359d064c678a34df323e743478, user_id=df249aada9644365b79f24283d8e3407, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:06.708783 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7e3c4-6de5-420f-b3a9-a6680db0911a admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:06.734584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1250/2491] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:13:06 2022] PUT /identity/v3/projects/ed417c359d064c678a34df323e743478/users/df249aada9644365b79f24283d8e3407/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:13:06.742654 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8ffc1-7e2a-4416-83b7-2ddccbe2fc79 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:06.743074 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8ffc1-7e2a-4416-83b7-2ddccbe2fc79 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:06.743439 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8ffc1-7e2a-4416-83b7-2ddccbe2fc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:06.765701 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-9af8ffc1-7e2a-4416-83b7-2ddccbe2fc79 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:13:06.767707 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-9af8ffc1-7e2a-4416-83b7-2ddccbe2fc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:06.856592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1242/2492] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:13:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:13:06.868618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7e3c4-6de5-420f-b3a9-a6680db0911a admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:06.872167 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-8ea7e3c4-6de5-420f-b3a9-a6680db0911a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:06.914683 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:06.965086 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7e3c4-6de5-420f-b3a9-a6680db0911a admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:06.969461 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3bc9c-6f3f-47ed-beca-b90a0c062c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:06.970233 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3bc9c-6f3f-47ed-beca-b90a0c062c38 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:06.970566 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3bc9c-6f3f-47ed-beca-b90a0c062c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:06.970852 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3bc9c-6f3f-47ed-beca-b90a0c062c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:06.988848 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3bc9c-6f3f-47ed-beca-b90a0c062c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:06.992223 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3bc9c-6f3f-47ed-beca-b90a0c062c38 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:07.013479 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1251/2493] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:13:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:13:08.477096 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25282f69-62a6-435b-b47d-49efd0337f4b None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:08.477850 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25282f69-62a6-435b-b47d-49efd0337f4b None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:08.478120 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25282f69-62a6-435b-b47d-49efd0337f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:08.530776 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-25282f69-62a6-435b-b47d-49efd0337f4b None None] MFA Rules not processed for user `df249aada9644365b79f24283d8e3407`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:13:08.532281 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-25282f69-62a6-435b-b47d-49efd0337f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:08.568079 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:08.669362 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1243/2494] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:13:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:13:08.684405 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3bc9c-6f3f-47ed-beca-b90a0c062c38 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:08.687887 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-bfc3bc9c-6f3f-47ed-beca-b90a0c062c38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:08.764175 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3bc9c-6f3f-47ed-beca-b90a0c062c38 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:08.769618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885b816-b470-4c70-81b1-4d59c4a2989d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:08.770724 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885b816-b470-4c70-81b1-4d59c4a2989d service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:08.771191 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885b816-b470-4c70-81b1-4d59c4a2989d service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:08.771582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885b816-b470-4c70-81b1-4d59c4a2989d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:08.785477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885b816-b470-4c70-81b1-4d59c4a2989d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:08.787073 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885b816-b470-4c70-81b1-4d59c4a2989d service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:08.802174 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1252/2495] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:13:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:13:10.411791 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570fe26-216d-44bf-886a-1de9d7891dd7 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:10.412409 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570fe26-216d-44bf-886a-1de9d7891dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:10.412409 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570fe26-216d-44bf-886a-1de9d7891dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:10.436138 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-6570fe26-216d-44bf-886a-1de9d7891dd7 None None] MFA Rules not processed for user `df249aada9644365b79f24283d8e3407`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:13:10.437529 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-6570fe26-216d-44bf-886a-1de9d7891dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:10.447423 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1244/2496] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:13:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:13:12.462449 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d3620-f7b3-4433-875e-0ebff0d7582a None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:12.463257 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d3620-f7b3-4433-875e-0ebff0d7582a None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:12.463257 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d3620-f7b3-4433-875e-0ebff0d7582a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:12.488382 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-761d3620-f7b3-4433-875e-0ebff0d7582a None None] MFA Rules not processed for user `c607472800fc49d5a75c5e6acb33f2a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:13:12.489761 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-761d3620-f7b3-4433-875e-0ebff0d7582a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:12.573660 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1253/2497] 10.222.0.65 () {58 vars in 967 bytes} [Wed Jul 27 09:13:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:13:12.587612 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570fe26-216d-44bf-886a-1de9d7891dd7 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:12.589143 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-6570fe26-216d-44bf-886a-1de9d7891dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:12.680227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570fe26-216d-44bf-886a-1de9d7891dd7 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:12.685387 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56d4a8-dc30-4313-84b2-1eb65c36ea01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158ea5c9dd5142eebd903d5f732997ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:12.686349 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56d4a8-dc30-4313-84b2-1eb65c36ea01 service swift] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:12.686641 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56d4a8-dc30-4313-84b2-1eb65c36ea01 service swift] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:12.686910 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56d4a8-dc30-4313-84b2-1eb65c36ea01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:12.697607 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56d4a8-dc30-4313-84b2-1eb65c36ea01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:12.699698 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56d4a8-dc30-4313-84b2-1eb65c36ea01 service swift] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:12.710756 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1245/2498] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 09:13:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 09:13:12.918857 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d3620-f7b3-4433-875e-0ebff0d7582a None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:12.921716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-761d3620-f7b3-4433-875e-0ebff0d7582a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:13.102610 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:13.137027 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d3620-f7b3-4433-875e-0ebff0d7582a None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:13.145628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd181d1-f56e-4555-8303-d59c20a0371e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d69004d02f9426b86e07907a553e523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:13.146737 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd181d1-f56e-4555-8303-d59c20a0371e service placement] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:13.147240 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd181d1-f56e-4555-8303-d59c20a0371e service placement] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:13.147733 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd181d1-f56e-4555-8303-d59c20a0371e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:13.151216 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-7dd181d1-f56e-4555-8303-d59c20a0371e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:13.174688 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd181d1-f56e-4555-8303-d59c20a0371e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:13.177806 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd181d1-f56e-4555-8303-d59c20a0371e service placement] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:13.199028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1254/2499] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:13:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:13:22.706685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=54 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:23.188812 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=9 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:26.813749 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56d4a8-dc30-4313-84b2-1eb65c36ea01 service swift] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:26.825913 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56d4a8-dc30-4313-84b2-1eb65c36ea01 service swift] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:26.832589 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a249769-62dc-4225-a04f-a24e794041d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:26.833465 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a249769-62dc-4225-a04f-a24e794041d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:26.833867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a249769-62dc-4225-a04f-a24e794041d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:26.834259 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a249769-62dc-4225-a04f-a24e794041d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:26.837097 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-2a249769-62dc-4225-a04f-a24e794041d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:26.853775 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a249769-62dc-4225-a04f-a24e794041d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:26.855381 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a249769-62dc-4225-a04f-a24e794041d7 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:26.869458 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1246/2500] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:13:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:13:31.733907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd181d1-f56e-4555-8303-d59c20a0371e service placement] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:31.738268 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-7dd181d1-f56e-4555-8303-d59c20a0371e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:31.761484 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd181d1-f56e-4555-8303-d59c20a0371e service placement] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:31.766842 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4c4ea-41e8-4789-a557-a023c55a5ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:31.767640 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4c4ea-41e8-4789-a557-a023c55a5ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:31.768131 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4c4ea-41e8-4789-a557-a023c55a5ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:31.768436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4c4ea-41e8-4789-a557-a023c55a5ee0 admin admin] PATH_INFO: `/v3/users/1d586ea72a1a4865941b30fa77103a52` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:31.770056 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4c4ea-41e8-4789-a557-a023c55a5ee0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d586ea72a1a4865941b30fa77103a52)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:31.772318 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4c4ea-41e8-4789-a557-a023c55a5ee0 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:31.849542 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a0b4c4ea-41e8-4789-a557-a023c55a5ee0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d586ea72a1a4865941b30fa77103a52'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:31.862130 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a0b4c4ea-41e8-4789-a557-a023c55a5ee0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d586ea72a1a4865941b30fa77103a52'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:31.863221 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a0b4c4ea-41e8-4789-a557-a023c55a5ee0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d586ea72a1a4865941b30fa77103a52'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:31.885299 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a0b4c4ea-41e8-4789-a557-a023c55a5ee0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d586ea72a1a4865941b30fa77103a52'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:31.886282 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a0b4c4ea-41e8-4789-a557-a023c55a5ee0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d586ea72a1a4865941b30fa77103a52'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:31.914438 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1255/2501] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:13:31 2022] DELETE /identity/v3/users/1d586ea72a1a4865941b30fa77103a52 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:13:32.152435 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a249769-62dc-4225-a04f-a24e794041d7 service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:32.171210 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a249769-62dc-4225-a04f-a24e794041d7 service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:32.251789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c10d3-91e7-4ffd-aa19-8ca16f2a1dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:32.252536 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c10d3-91e7-4ffd-aa19-8ca16f2a1dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:32.252916 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c10d3-91e7-4ffd-aa19-8ca16f2a1dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:32.253240 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c10d3-91e7-4ffd-aa19-8ca16f2a1dc6 admin admin] PATH_INFO: `/v3/projects/7ea24cd3c1954982bcf018d3946e9c08` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:32.254987 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c10d3-91e7-4ffd-aa19-8ca16f2a1dc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ea24cd3c1954982bcf018d3946e9c08)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:32.257578 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c10d3-91e7-4ffd-aa19-8ca16f2a1dc6 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:32.319101 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-d49c10d3-91e7-4ffd-aa19-8ca16f2a1dc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ea24cd3c1954982bcf018d3946e9c08', 'request_id': 'req-d49c10d3-91e7-4ffd-aa19-8ca16f2a1dc6'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:32.326041 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-d49c10d3-91e7-4ffd-aa19-8ca16f2a1dc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ea24cd3c1954982bcf018d3946e9c08', 'request_id': 'req-d49c10d3-91e7-4ffd-aa19-8ca16f2a1dc6'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:32.339716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-d49c10d3-91e7-4ffd-aa19-8ca16f2a1dc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ea24cd3c1954982bcf018d3946e9c08', 'request_id': 'req-d49c10d3-91e7-4ffd-aa19-8ca16f2a1dc6'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:32.359860 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-d49c10d3-91e7-4ffd-aa19-8ca16f2a1dc6 admin admin] The token cache is being invalidate because project 7ea24cd3c1954982bcf018d3946e9c08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:13:32.360145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-d49c10d3-91e7-4ffd-aa19-8ca16f2a1dc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:32.361390 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-d49c10d3-91e7-4ffd-aa19-8ca16f2a1dc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:32.363048 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1247/2502] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:13:32 2022] DELETE /identity/v3/projects/7ea24cd3c1954982bcf018d3946e9c08 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:13:32.368261 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ac102-fd6d-4ac6-94dd-033badb09d68 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:32.368552 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ac102-fd6d-4ac6-94dd-033badb09d68 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:32.368837 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ac102-fd6d-4ac6-94dd-033badb09d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:32.397493 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-588ac102-fd6d-4ac6-94dd-033badb09d68 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:13:32.399700 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-588ac102-fd6d-4ac6-94dd-033badb09d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:32.519002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1256/2503] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:13:32.527985 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda58ea-fbd9-41ac-aa45-4fb7d0a0835d None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:32.528271 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda58ea-fbd9-41ac-aa45-4fb7d0a0835d None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:32.528549 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda58ea-fbd9-41ac-aa45-4fb7d0a0835d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:32.551600 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-feda58ea-fbd9-41ac-aa45-4fb7d0a0835d None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:13:32.552856 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-feda58ea-fbd9-41ac-aa45-4fb7d0a0835d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:32.565287 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1248/2504] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:13:32.569806 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ac102-fd6d-4ac6-94dd-033badb09d68 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:32.581047 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ac102-fd6d-4ac6-94dd-033badb09d68 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:32.586593 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3387175-ac89-42e4-ad00-b3e9bcdb2276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:32.587266 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3387175-ac89-42e4-ad00-b3e9bcdb2276 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:32.587602 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3387175-ac89-42e4-ad00-b3e9bcdb2276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:32.587887 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3387175-ac89-42e4-ad00-b3e9bcdb2276 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:32.588665 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3387175-ac89-42e4-ad00-b3e9bcdb2276 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:13:32.588978 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3387175-ac89-42e4-ad00-b3e9bcdb2276 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:32.590680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3387175-ac89-42e4-ad00-b3e9bcdb2276 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:32.605988 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1257/2505] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 09:13:32.612388 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda58ea-fbd9-41ac-aa45-4fb7d0a0835d None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:32.629642 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda58ea-fbd9-41ac-aa45-4fb7d0a0835d None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:32.637698 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d54485-6dd8-4f8b-b535-bb001b5138b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:32.638822 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d54485-6dd8-4f8b-b535-bb001b5138b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:32.639322 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d54485-6dd8-4f8b-b535-bb001b5138b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:32.639950 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d54485-6dd8-4f8b-b535-bb001b5138b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:32.641296 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d54485-6dd8-4f8b-b535-bb001b5138b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:32.645375 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d54485-6dd8-4f8b-b535-bb001b5138b9 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:32.691478 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1249/2506] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:13:32 2022] POST /identity/v3/projects => generated 405 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:13:32.696276 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3387175-ac89-42e4-ad00-b3e9bcdb2276 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:32.708504 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3387175-ac89-42e4-ad00-b3e9bcdb2276 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:32.791938 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f0d77-70eb-4ae1-9ff5-d1756e866e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:32.793481 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f0d77-70eb-4ae1-9ff5-d1756e866e16 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:32.794416 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f0d77-70eb-4ae1-9ff5-d1756e866e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:32.794792 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f0d77-70eb-4ae1-9ff5-d1756e866e16 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:32.795909 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f0d77-70eb-4ae1-9ff5-d1756e866e16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:32.799863 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f0d77-70eb-4ae1-9ff5-d1756e866e16 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:32.809121 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:32.829579 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1258/2507] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:13:32 2022] POST /identity/v3/users => generated 303 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:13:32.835050 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d54485-6dd8-4f8b-b535-bb001b5138b9 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:32.850887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d54485-6dd8-4f8b-b535-bb001b5138b9 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:32.860551 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82150a53-264a-4120-8e08-01e3b7bc39ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:32.861699 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82150a53-264a-4120-8e08-01e3b7bc39ec admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:32.862242 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82150a53-264a-4120-8e08-01e3b7bc39ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:32.862766 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82150a53-264a-4120-8e08-01e3b7bc39ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:32.864119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82150a53-264a-4120-8e08-01e3b7bc39ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:32.866273 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82150a53-264a-4120-8e08-01e3b7bc39ec admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:32.878717 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1250/2508] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:13:32.883192 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f0d77-70eb-4ae1-9ff5-d1756e866e16 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:32.894621 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f0d77-70eb-4ae1-9ff5-d1756e866e16 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:32.899688 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805e8ba-f7fc-4a29-b0d2-1a2a1ae9c04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:32.900331 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805e8ba-f7fc-4a29-b0d2-1a2a1ae9c04a admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:32.900616 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805e8ba-f7fc-4a29-b0d2-1a2a1ae9c04a admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:32.900886 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805e8ba-f7fc-4a29-b0d2-1a2a1ae9c04a admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:32.901600 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805e8ba-f7fc-4a29-b0d2-1a2a1ae9c04a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:32.903319 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805e8ba-f7fc-4a29-b0d2-1a2a1ae9c04a admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:32.917035 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1259/2509] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:13:32.922126 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82150a53-264a-4120-8e08-01e3b7bc39ec admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:32.933495 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82150a53-264a-4120-8e08-01e3b7bc39ec admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:32.940137 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adde80-6168-4ff6-9c23-580b21d934f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:32.940953 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adde80-6168-4ff6-9c23-580b21d934f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:32.941288 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adde80-6168-4ff6-9c23-580b21d934f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:32.941615 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adde80-6168-4ff6-9c23-580b21d934f7 admin admin] PATH_INFO: `/v3/projects/cd89c1d8f1f24f8f8c07b57bb7c1fcd1/users/69cf7064ccb84cb88653778e4b8a798a/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:32.960491 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9adde80-6168-4ff6-9c23-580b21d934f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd89c1d8f1f24f8f8c07b57bb7c1fcd1, user_id=69cf7064ccb84cb88653778e4b8a798a, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:32.963664 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9adde80-6168-4ff6-9c23-580b21d934f7 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:32.991257 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1251/2510] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:13:32 2022] PUT /identity/v3/projects/cd89c1d8f1f24f8f8c07b57bb7c1fcd1/users/69cf7064ccb84cb88653778e4b8a798a/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:13:33.004556 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff521e49-b9b8-4e85-8b56-a552ab6ddced None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:33.005163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff521e49-b9b8-4e85-8b56-a552ab6ddced None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:33.005651 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff521e49-b9b8-4e85-8b56-a552ab6ddced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:33.053558 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-ff521e49-b9b8-4e85-8b56-a552ab6ddced None None] MFA Rules not processed for user `69cf7064ccb84cb88653778e4b8a798a`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:13:33.054896 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ff521e49-b9b8-4e85-8b56-a552ab6ddced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:33.154132 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1260/2511] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:13:33 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:13:33.160111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adde80-6168-4ff6-9c23-580b21d934f7 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:33.178535 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:33.242353 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adde80-6168-4ff6-9c23-580b21d934f7 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:33.247985 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d0ff0-d88b-4c40-b74b-c161fd410cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:33.248637 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d0ff0-d88b-4c40-b74b-c161fd410cd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:33.248923 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d0ff0-d88b-4c40-b74b-c161fd410cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:33.249201 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d0ff0-d88b-4c40-b74b-c161fd410cd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:33.249881 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d0ff0-d88b-4c40-b74b-c161fd410cd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:33.252280 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d0ff0-d88b-4c40-b74b-c161fd410cd3 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:33.296202 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1252/2512] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:13:33 2022] POST /identity/v3/projects => generated 405 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:13:33.297432 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff521e49-b9b8-4e85-8b56-a552ab6ddced None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:33.309726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff521e49-b9b8-4e85-8b56-a552ab6ddced None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:33.404571 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06ef0b-25d4-4e76-8b12-559ac70745db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:33.405425 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06ef0b-25d4-4e76-8b12-559ac70745db admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:33.405783 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06ef0b-25d4-4e76-8b12-559ac70745db admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:33.406177 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06ef0b-25d4-4e76-8b12-559ac70745db admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:33.408276 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06ef0b-25d4-4e76-8b12-559ac70745db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:33.410593 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06ef0b-25d4-4e76-8b12-559ac70745db admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:33.443414 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1261/2513] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:13:33 2022] POST /identity/v3/users => generated 309 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:13:33.448521 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d0ff0-d88b-4c40-b74b-c161fd410cd3 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:33.460233 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d0ff0-d88b-4c40-b74b-c161fd410cd3 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:33.468885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4c21e-9b30-492b-bd06-d86218fb5a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:33.470056 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4c21e-9b30-492b-bd06-d86218fb5a16 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:33.470369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4c21e-9b30-492b-bd06-d86218fb5a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:33.470644 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4c21e-9b30-492b-bd06-d86218fb5a16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:33.471390 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4c21e-9b30-492b-bd06-d86218fb5a16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:33.473058 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4c21e-9b30-492b-bd06-d86218fb5a16 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:33.490514 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1253/2514] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:13:33.495009 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06ef0b-25d4-4e76-8b12-559ac70745db admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:33.506498 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06ef0b-25d4-4e76-8b12-559ac70745db admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:33.511806 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd28127-497e-413c-b8dd-dada1ef5559e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:33.512542 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd28127-497e-413c-b8dd-dada1ef5559e admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:33.512853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd28127-497e-413c-b8dd-dada1ef5559e admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:33.513132 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd28127-497e-413c-b8dd-dada1ef5559e admin admin] PATH_INFO: `/v3/projects/1ea419ada9a243338a9d7e38413ac9ad/users/9b4cf032a85043889a57517eb32de561/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:33.536784 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd28127-497e-413c-b8dd-dada1ef5559e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ea419ada9a243338a9d7e38413ac9ad, user_id=9b4cf032a85043889a57517eb32de561, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:33.542472 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd28127-497e-413c-b8dd-dada1ef5559e admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:33.561681 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1262/2515] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:13:33 2022] PUT /identity/v3/projects/1ea419ada9a243338a9d7e38413ac9ad/users/9b4cf032a85043889a57517eb32de561/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:13:33.567005 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4c21e-9b30-492b-bd06-d86218fb5a16 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:33.581551 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4c21e-9b30-492b-bd06-d86218fb5a16 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:33.659109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14da3a-4775-422d-8365-c4ec8565bd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:33.659751 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14da3a-4775-422d-8365-c4ec8565bd2f admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:33.660028 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14da3a-4775-422d-8365-c4ec8565bd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:33.660487 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14da3a-4775-422d-8365-c4ec8565bd2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:33.661659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14da3a-4775-422d-8365-c4ec8565bd2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:33.665822 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14da3a-4775-422d-8365-c4ec8565bd2f admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:33.685556 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1254/2516] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:13:33.691111 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd28127-497e-413c-b8dd-dada1ef5559e admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:33.702116 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd28127-497e-413c-b8dd-dada1ef5559e admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:33.708237 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb85bf-8a20-4a2f-a73f-8447c1857655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:33.709136 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb85bf-8a20-4a2f-a73f-8447c1857655 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:33.709522 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb85bf-8a20-4a2f-a73f-8447c1857655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:33.709818 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb85bf-8a20-4a2f-a73f-8447c1857655 admin admin] PATH_INFO: `/v3/projects/1ea419ada9a243338a9d7e38413ac9ad/users/9b4cf032a85043889a57517eb32de561/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:33.712002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb85bf-8a20-4a2f-a73f-8447c1857655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ea419ada9a243338a9d7e38413ac9ad, user_id=9b4cf032a85043889a57517eb32de561, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:33.714899 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb85bf-8a20-4a2f-a73f-8447c1857655 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:33.728743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1263/2517] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:13:33 2022] PUT /identity/v3/projects/1ea419ada9a243338a9d7e38413ac9ad/users/9b4cf032a85043889a57517eb32de561/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:13:33.741273 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0534821-2d47-4454-b24e-9959d3a25413 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:33.741557 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0534821-2d47-4454-b24e-9959d3a25413 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:33.741816 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0534821-2d47-4454-b24e-9959d3a25413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:33.792029 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-f0534821-2d47-4454-b24e-9959d3a25413 None None] MFA Rules not processed for user `9b4cf032a85043889a57517eb32de561`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:13:33.794599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-f0534821-2d47-4454-b24e-9959d3a25413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:33.921360 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1255/2518] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:13:33 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:13:33.933419 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb85bf-8a20-4a2f-a73f-8447c1857655 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:33.934952 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-8cfb85bf-8a20-4a2f-a73f-8447c1857655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:33.960994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:34.008974 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb85bf-8a20-4a2f-a73f-8447c1857655 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:34.013231 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18de67e-7051-4a7a-93a1-dff0938e84b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:34.014598 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18de67e-7051-4a7a-93a1-dff0938e84b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:34.014991 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18de67e-7051-4a7a-93a1-dff0938e84b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:34.015435 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18de67e-7051-4a7a-93a1-dff0938e84b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:34.030563 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18de67e-7051-4a7a-93a1-dff0938e84b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:34.033157 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18de67e-7051-4a7a-93a1-dff0938e84b6 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:34.044753 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1264/2519] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:13:33 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:13:34.245384 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0534821-2d47-4454-b24e-9959d3a25413 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:34.260695 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:34.331881 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0534821-2d47-4454-b24e-9959d3a25413 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:34.339984 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa4990-180e-4711-ba05-22211cbe0a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:34.340786 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa4990-180e-4711-ba05-22211cbe0a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:34.341089 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa4990-180e-4711-ba05-22211cbe0a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:34.341542 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa4990-180e-4711-ba05-22211cbe0a47 admin admin] PATH_INFO: `/v3/users/69cf7064ccb84cb88653778e4b8a798a` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:34.343070 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa4990-180e-4711-ba05-22211cbe0a47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69cf7064ccb84cb88653778e4b8a798a)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:34.346182 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa4990-180e-4711-ba05-22211cbe0a47 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:34.411536 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-5cfa4990-180e-4711-ba05-22211cbe0a47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69cf7064ccb84cb88653778e4b8a798a'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:34.412240 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-5cfa4990-180e-4711-ba05-22211cbe0a47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69cf7064ccb84cb88653778e4b8a798a'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:34.412874 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-5cfa4990-180e-4711-ba05-22211cbe0a47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69cf7064ccb84cb88653778e4b8a798a'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:34.423187 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-5cfa4990-180e-4711-ba05-22211cbe0a47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69cf7064ccb84cb88653778e4b8a798a'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:34.440543 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-5cfa4990-180e-4711-ba05-22211cbe0a47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69cf7064ccb84cb88653778e4b8a798a'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:34.455781 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1256/2520] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:13:34 2022] DELETE /identity/v3/users/69cf7064ccb84cb88653778e4b8a798a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:13:34.461971 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d163f72-baec-45b9-8be8-44c120b91ce5 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:34.462635 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d163f72-baec-45b9-8be8-44c120b91ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:34.463186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d163f72-baec-45b9-8be8-44c120b91ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:34.486652 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-7d163f72-baec-45b9-8be8-44c120b91ce5 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:13:34.488338 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-7d163f72-baec-45b9-8be8-44c120b91ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:34.563830 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1265/2521] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:13:34.574653 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa4990-180e-4711-ba05-22211cbe0a47 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:34.576291 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-5cfa4990-180e-4711-ba05-22211cbe0a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:34.658189 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa4990-180e-4711-ba05-22211cbe0a47 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:34.664332 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6979eae-77f0-4589-a023-82c49d3398cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:34.665384 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6979eae-77f0-4589-a023-82c49d3398cc service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:34.665865 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6979eae-77f0-4589-a023-82c49d3398cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:34.666426 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6979eae-77f0-4589-a023-82c49d3398cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:34.680702 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6979eae-77f0-4589-a023-82c49d3398cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:34.682176 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6979eae-77f0-4589-a023-82c49d3398cc service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:34.693817 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1257/2522] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:13:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:13:35.133527 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d163f72-baec-45b9-8be8-44c120b91ce5 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:35.135400 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-7d163f72-baec-45b9-8be8-44c120b91ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:35.156789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d163f72-baec-45b9-8be8-44c120b91ce5 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:35.162516 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6559f8-77e0-4a40-a631-e9da72cf8eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:35.163220 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6559f8-77e0-4a40-a631-e9da72cf8eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:35.163503 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6559f8-77e0-4a40-a631-e9da72cf8eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:35.163782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6559f8-77e0-4a40-a631-e9da72cf8eac admin admin] PATH_INFO: `/v3/projects/cd89c1d8f1f24f8f8c07b57bb7c1fcd1` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:35.166967 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6559f8-77e0-4a40-a631-e9da72cf8eac admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd89c1d8f1f24f8f8c07b57bb7c1fcd1)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:35.174705 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6559f8-77e0-4a40-a631-e9da72cf8eac admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:35.259971 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-ff6559f8-77e0-4a40-a631-e9da72cf8eac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd89c1d8f1f24f8f8c07b57bb7c1fcd1', 'request_id': 'req-ff6559f8-77e0-4a40-a631-e9da72cf8eac'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:35.267559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-ff6559f8-77e0-4a40-a631-e9da72cf8eac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd89c1d8f1f24f8f8c07b57bb7c1fcd1', 'request_id': 'req-ff6559f8-77e0-4a40-a631-e9da72cf8eac'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:35.277007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-ff6559f8-77e0-4a40-a631-e9da72cf8eac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd89c1d8f1f24f8f8c07b57bb7c1fcd1', 'request_id': 'req-ff6559f8-77e0-4a40-a631-e9da72cf8eac'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:35.292990 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-ff6559f8-77e0-4a40-a631-e9da72cf8eac admin admin] The token cache is being invalidate because project cd89c1d8f1f24f8f8c07b57bb7c1fcd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:13:35.293398 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-ff6559f8-77e0-4a40-a631-e9da72cf8eac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:35.294414 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-ff6559f8-77e0-4a40-a631-e9da72cf8eac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:35.296654 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1266/2523] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:13:35 2022] DELETE /identity/v3/projects/cd89c1d8f1f24f8f8c07b57bb7c1fcd1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:13:35.305379 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6979eae-77f0-4589-a023-82c49d3398cc service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:35.318131 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6979eae-77f0-4589-a023-82c49d3398cc service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:35.353976 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:35.392320 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015acffc-2285-4903-95f8-1437c5fe006d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:35.393040 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015acffc-2285-4903-95f8-1437c5fe006d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:35.393395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015acffc-2285-4903-95f8-1437c5fe006d admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:35.393854 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015acffc-2285-4903-95f8-1437c5fe006d admin admin] PATH_INFO: `/v3/users/9b4cf032a85043889a57517eb32de561` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:35.395468 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015acffc-2285-4903-95f8-1437c5fe006d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b4cf032a85043889a57517eb32de561)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:35.397521 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015acffc-2285-4903-95f8-1437c5fe006d admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:35.460947 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-015acffc-2285-4903-95f8-1437c5fe006d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b4cf032a85043889a57517eb32de561'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:35.461635 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-015acffc-2285-4903-95f8-1437c5fe006d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b4cf032a85043889a57517eb32de561'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:35.462244 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-015acffc-2285-4903-95f8-1437c5fe006d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b4cf032a85043889a57517eb32de561'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:35.472333 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-015acffc-2285-4903-95f8-1437c5fe006d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b4cf032a85043889a57517eb32de561'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:35.488844 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-015acffc-2285-4903-95f8-1437c5fe006d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b4cf032a85043889a57517eb32de561'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:35.504637 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1258/2524] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:13:35 2022] DELETE /identity/v3/users/9b4cf032a85043889a57517eb32de561 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:13:35.936445 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6559f8-77e0-4a40-a631-e9da72cf8eac admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:35.941662 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ff6559f8-77e0-4a40-a631-e9da72cf8eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:35.957932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6559f8-77e0-4a40-a631-e9da72cf8eac admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:36.029859 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:36.055182 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00293f1c-c335-4621-b46a-0457a5880f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:36.056057 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00293f1c-c335-4621-b46a-0457a5880f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:36.056522 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00293f1c-c335-4621-b46a-0457a5880f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:36.056997 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00293f1c-c335-4621-b46a-0457a5880f79 admin admin] PATH_INFO: `/v3/projects/1ea419ada9a243338a9d7e38413ac9ad` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:36.059431 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00293f1c-c335-4621-b46a-0457a5880f79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ea419ada9a243338a9d7e38413ac9ad)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:36.063367 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00293f1c-c335-4621-b46a-0457a5880f79 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:36.143776 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-00293f1c-c335-4621-b46a-0457a5880f79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ea419ada9a243338a9d7e38413ac9ad', 'request_id': 'req-00293f1c-c335-4621-b46a-0457a5880f79'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:36.153182 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-00293f1c-c335-4621-b46a-0457a5880f79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ea419ada9a243338a9d7e38413ac9ad', 'request_id': 'req-00293f1c-c335-4621-b46a-0457a5880f79'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:36.164744 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-00293f1c-c335-4621-b46a-0457a5880f79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ea419ada9a243338a9d7e38413ac9ad', 'request_id': 'req-00293f1c-c335-4621-b46a-0457a5880f79'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:36.209379 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-00293f1c-c335-4621-b46a-0457a5880f79 admin admin] The token cache is being invalidate because project 1ea419ada9a243338a9d7e38413ac9ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:13:36.210031 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-00293f1c-c335-4621-b46a-0457a5880f79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:36.211163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-00293f1c-c335-4621-b46a-0457a5880f79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:36.213973 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1267/2525] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:13:35 2022] DELETE /identity/v3/projects/1ea419ada9a243338a9d7e38413ac9ad => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:13:36.220692 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c371b91-3b05-44d3-a8c3-43f87e890ab1 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:36.221213 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c371b91-3b05-44d3-a8c3-43f87e890ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:36.221640 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c371b91-3b05-44d3-a8c3-43f87e890ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:36.259387 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-7c371b91-3b05-44d3-a8c3-43f87e890ab1 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:13:36.262442 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-7c371b91-3b05-44d3-a8c3-43f87e890ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:36.369325 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1259/2526] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:13:36.383435 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218edf3-abd6-4811-ba1c-d18a873045c5 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:36.383951 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218edf3-abd6-4811-ba1c-d18a873045c5 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:36.384437 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218edf3-abd6-4811-ba1c-d18a873045c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:36.421675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-4218edf3-abd6-4811-ba1c-d18a873045c5 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:13:36.424207 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4218edf3-abd6-4811-ba1c-d18a873045c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:36.434278 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1268/2527] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:13:36.441927 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c371b91-3b05-44d3-a8c3-43f87e890ab1 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:36.460310 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c371b91-3b05-44d3-a8c3-43f87e890ab1 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:36.473292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2f651-f9d7-4dd5-b099-d35cc1b10c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:36.474492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2f651-f9d7-4dd5-b099-d35cc1b10c27 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:36.475022 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2f651-f9d7-4dd5-b099-d35cc1b10c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:36.475508 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2f651-f9d7-4dd5-b099-d35cc1b10c27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:36.476782 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2f651-f9d7-4dd5-b099-d35cc1b10c27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:13:36.477297 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2f651-f9d7-4dd5-b099-d35cc1b10c27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:36.480400 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2f651-f9d7-4dd5-b099-d35cc1b10c27 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:36.507533 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1260/2528] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:13:36.509067 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218edf3-abd6-4811-ba1c-d18a873045c5 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:36.520744 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218edf3-abd6-4811-ba1c-d18a873045c5 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:36.526776 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e30ae7-06ee-4628-86d4-604694126851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:36.527475 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e30ae7-06ee-4628-86d4-604694126851 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:36.527794 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e30ae7-06ee-4628-86d4-604694126851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:36.528108 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e30ae7-06ee-4628-86d4-604694126851 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:36.528843 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e30ae7-06ee-4628-86d4-604694126851 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:36.531120 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e30ae7-06ee-4628-86d4-604694126851 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:36.568974 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1269/2529] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:13:36 2022] POST /identity/v3/projects => generated 355 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:13:36.575926 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2f651-f9d7-4dd5-b099-d35cc1b10c27 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:36.595325 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2f651-f9d7-4dd5-b099-d35cc1b10c27 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:36.663913 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:36.696989 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c02a0-854e-4ed9-bec4-4e680c74e038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:36.697623 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c02a0-854e-4ed9-bec4-4e680c74e038 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:36.697915 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c02a0-854e-4ed9-bec4-4e680c74e038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:36.698182 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c02a0-854e-4ed9-bec4-4e680c74e038 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:36.698915 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c02a0-854e-4ed9-bec4-4e680c74e038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:36.701233 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c02a0-854e-4ed9-bec4-4e680c74e038 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:36.731559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1261/2530] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:13:36 2022] POST /identity/v3/users => generated 278 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:13:36.737064 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e30ae7-06ee-4628-86d4-604694126851 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:36.748611 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e30ae7-06ee-4628-86d4-604694126851 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:36.754578 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e842c-7581-4b4e-9767-b652eca74640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:36.755299 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e842c-7581-4b4e-9767-b652eca74640 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:36.755617 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e842c-7581-4b4e-9767-b652eca74640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:36.755927 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e842c-7581-4b4e-9767-b652eca74640 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:36.756698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e842c-7581-4b4e-9767-b652eca74640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:36.758734 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e842c-7581-4b4e-9767-b652eca74640 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:36.771766 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1270/2531] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:13:36.777240 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c02a0-854e-4ed9-bec4-4e680c74e038 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:36.791023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c02a0-854e-4ed9-bec4-4e680c74e038 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:36.797746 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efd7d7-8de5-40fd-ab0e-8587d4fa4f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:36.798430 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efd7d7-8de5-40fd-ab0e-8587d4fa4f6f admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:36.798714 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efd7d7-8de5-40fd-ab0e-8587d4fa4f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:36.798987 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efd7d7-8de5-40fd-ab0e-8587d4fa4f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:36.799714 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0efd7d7-8de5-40fd-ab0e-8587d4fa4f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:36.801350 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0efd7d7-8de5-40fd-ab0e-8587d4fa4f6f admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:36.814838 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1262/2532] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:13:36.821249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e842c-7581-4b4e-9767-b652eca74640 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:36.836682 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e842c-7581-4b4e-9767-b652eca74640 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:36.841786 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeff1e1-6d70-45b5-97ed-4667046936ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:36.842525 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeff1e1-6d70-45b5-97ed-4667046936ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:36.842807 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeff1e1-6d70-45b5-97ed-4667046936ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:36.843083 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeff1e1-6d70-45b5-97ed-4667046936ff admin admin] PATH_INFO: `/v3/projects/77afa3fb70fe46389d1cf2cfe1511ad2/users/d05fbe66669e472396c00a64b0e24fa3/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:36.861235 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeff1e1-6d70-45b5-97ed-4667046936ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=77afa3fb70fe46389d1cf2cfe1511ad2, user_id=d05fbe66669e472396c00a64b0e24fa3, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:36.864014 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeff1e1-6d70-45b5-97ed-4667046936ff admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:36.878893 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1271/2533] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:13:36 2022] PUT /identity/v3/projects/77afa3fb70fe46389d1cf2cfe1511ad2/users/d05fbe66669e472396c00a64b0e24fa3/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:13:36.891627 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6630f9-f734-4d04-b4b4-29b6b8a087b4 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:36.891905 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6630f9-f734-4d04-b4b4-29b6b8a087b4 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:36.892195 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6630f9-f734-4d04-b4b4-29b6b8a087b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:36.924827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-fa6630f9-f734-4d04-b4b4-29b6b8a087b4 None None] MFA Rules not processed for user `d05fbe66669e472396c00a64b0e24fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:13:36.926132 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-fa6630f9-f734-4d04-b4b4-29b6b8a087b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:37.010102 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1263/2534] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:13:36 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:13:37.015928 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeff1e1-6d70-45b5-97ed-4667046936ff admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:37.112522 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeff1e1-6d70-45b5-97ed-4667046936ff admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:37.120458 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a569b1-c08d-4467-9bf7-cc8d5e70ad44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:37.121531 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a569b1-c08d-4467-9bf7-cc8d5e70ad44 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:37.121999 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a569b1-c08d-4467-9bf7-cc8d5e70ad44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:37.122526 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a569b1-c08d-4467-9bf7-cc8d5e70ad44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:37.123767 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a569b1-c08d-4467-9bf7-cc8d5e70ad44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:37.127780 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a569b1-c08d-4467-9bf7-cc8d5e70ad44 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:37.162862 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:37.194868 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1272/2535] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:13:37 2022] POST /identity/v3/projects => generated 355 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:13:37.199993 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6630f9-f734-4d04-b4b4-29b6b8a087b4 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:37.220282 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6630f9-f734-4d04-b4b4-29b6b8a087b4 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:37.305609 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59701490-ce2c-421b-bf67-48a8a970014d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:37.306571 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59701490-ce2c-421b-bf67-48a8a970014d admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:37.306949 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59701490-ce2c-421b-bf67-48a8a970014d admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:37.307325 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59701490-ce2c-421b-bf67-48a8a970014d admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:37.308221 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59701490-ce2c-421b-bf67-48a8a970014d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:37.310303 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59701490-ce2c-421b-bf67-48a8a970014d admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:37.338064 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1264/2536] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:13:37 2022] POST /identity/v3/users => generated 284 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:13:37.345334 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a569b1-c08d-4467-9bf7-cc8d5e70ad44 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:37.366149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a569b1-c08d-4467-9bf7-cc8d5e70ad44 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:37.374200 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b190a1-175c-41e5-8ec6-005772afe1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:37.375742 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b190a1-175c-41e5-8ec6-005772afe1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:37.376209 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b190a1-175c-41e5-8ec6-005772afe1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:37.376669 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b190a1-175c-41e5-8ec6-005772afe1a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:37.377932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b190a1-175c-41e5-8ec6-005772afe1a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:37.381017 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b190a1-175c-41e5-8ec6-005772afe1a2 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:37.403715 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1273/2537] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:13:37.408879 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59701490-ce2c-421b-bf67-48a8a970014d admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:37.421055 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59701490-ce2c-421b-bf67-48a8a970014d admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:37.427976 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e8079-12b1-483b-8252-86e887c2ba36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:37.428796 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e8079-12b1-483b-8252-86e887c2ba36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:37.429220 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e8079-12b1-483b-8252-86e887c2ba36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:37.429611 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e8079-12b1-483b-8252-86e887c2ba36 admin admin] PATH_INFO: `/v3/projects/9342e57d743d4b19a6e5f2e8afbfcfbf/users/9ef09c17c74f4cacb546836f18bfd862/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:37.455700 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e8079-12b1-483b-8252-86e887c2ba36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9342e57d743d4b19a6e5f2e8afbfcfbf, user_id=9ef09c17c74f4cacb546836f18bfd862, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:37.458773 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e8079-12b1-483b-8252-86e887c2ba36 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:37.476286 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1265/2538] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:13:37 2022] PUT /identity/v3/projects/9342e57d743d4b19a6e5f2e8afbfcfbf/users/9ef09c17c74f4cacb546836f18bfd862/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:13:37.481118 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b190a1-175c-41e5-8ec6-005772afe1a2 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:37.501061 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b190a1-175c-41e5-8ec6-005772afe1a2 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:37.593013 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f413ca6-ae36-4f77-b3be-6132d7dc9f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:37.593960 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f413ca6-ae36-4f77-b3be-6132d7dc9f1a admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:37.594428 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f413ca6-ae36-4f77-b3be-6132d7dc9f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:37.594825 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f413ca6-ae36-4f77-b3be-6132d7dc9f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:37.595733 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f413ca6-ae36-4f77-b3be-6132d7dc9f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:37.597695 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f413ca6-ae36-4f77-b3be-6132d7dc9f1a admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:37.611678 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1274/2539] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:13:37.618127 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e8079-12b1-483b-8252-86e887c2ba36 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:37.630883 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e8079-12b1-483b-8252-86e887c2ba36 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:37.635870 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90bfa0-4f94-4e0b-8dee-b843395d5255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:37.636578 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90bfa0-4f94-4e0b-8dee-b843395d5255 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:37.636870 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90bfa0-4f94-4e0b-8dee-b843395d5255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:37.637167 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90bfa0-4f94-4e0b-8dee-b843395d5255 admin admin] PATH_INFO: `/v3/projects/9342e57d743d4b19a6e5f2e8afbfcfbf/users/9ef09c17c74f4cacb546836f18bfd862/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:37.639311 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90bfa0-4f94-4e0b-8dee-b843395d5255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9342e57d743d4b19a6e5f2e8afbfcfbf, user_id=9ef09c17c74f4cacb546836f18bfd862, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:37.642888 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90bfa0-4f94-4e0b-8dee-b843395d5255 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:37.649690 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:37.658116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1266/2540] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:13:37 2022] PUT /identity/v3/projects/9342e57d743d4b19a6e5f2e8afbfcfbf/users/9ef09c17c74f4cacb546836f18bfd862/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:13:37.670355 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe718d75-b262-4848-ac04-6fbaf07d66e3 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:37.670803 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe718d75-b262-4848-ac04-6fbaf07d66e3 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:37.671468 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe718d75-b262-4848-ac04-6fbaf07d66e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:37.705933 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-fe718d75-b262-4848-ac04-6fbaf07d66e3 None None] MFA Rules not processed for user `9ef09c17c74f4cacb546836f18bfd862`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:13:37.707268 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fe718d75-b262-4848-ac04-6fbaf07d66e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:37.802481 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1275/2541] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:13:37 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:13:37.816885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90bfa0-4f94-4e0b-8dee-b843395d5255 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:37.819162 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-7f90bfa0-4f94-4e0b-8dee-b843395d5255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:37.905075 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90bfa0-4f94-4e0b-8dee-b843395d5255 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:37.911693 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ded7d-9183-492d-91c1-2563ed4288fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:37.912568 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ded7d-9183-492d-91c1-2563ed4288fd service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:37.913063 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ded7d-9183-492d-91c1-2563ed4288fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:37.913559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ded7d-9183-492d-91c1-2563ed4288fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:37.931905 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ded7d-9183-492d-91c1-2563ed4288fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:37.935178 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ded7d-9183-492d-91c1-2563ed4288fd service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:37.954801 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1267/2542] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:13:37 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:13:38.057054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe718d75-b262-4848-ac04-6fbaf07d66e3 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:38.072664 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe718d75-b262-4848-ac04-6fbaf07d66e3 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:38.076625 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc58395-2977-4eea-b1ff-7d8201834738 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:38.077314 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc58395-2977-4eea-b1ff-7d8201834738 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:38.077647 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc58395-2977-4eea-b1ff-7d8201834738 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:38.077931 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc58395-2977-4eea-b1ff-7d8201834738 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:38.158179 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc58395-2977-4eea-b1ff-7d8201834738 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:38.159638 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc58395-2977-4eea-b1ff-7d8201834738 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:38.172047 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1276/2543] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:13:38 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:13:47.946094 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=27 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:48.166386 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:50.164000 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1c56a-12a1-4984-8601-8d5b39a15ddf None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:50.164560 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1c56a-12a1-4984-8601-8d5b39a15ddf None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:50.164560 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1c56a-12a1-4984-8601-8d5b39a15ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:50.187254 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-b8d1c56a-12a1-4984-8601-8d5b39a15ddf None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:13:50.188536 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-b8d1c56a-12a1-4984-8601-8d5b39a15ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:50.260377 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1268/2544] 10.222.0.69 () {58 vars in 1016 bytes} [Wed Jul 27 09:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:13:50.310969 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc58395-2977-4eea-b1ff-7d8201834738 service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:50.312425 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4cc58395-2977-4eea-b1ff-7d8201834738 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:50.404288 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc58395-2977-4eea-b1ff-7d8201834738 service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:50.410793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f91fb8-f348-40b1-b927-301d5da83a27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:50.411446 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f91fb8-f348-40b1-b927-301d5da83a27 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:50.411731 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f91fb8-f348-40b1-b927-301d5da83a27 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:50.412009 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f91fb8-f348-40b1-b927-301d5da83a27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:50.421723 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f91fb8-f348-40b1-b927-301d5da83a27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:50.423436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f91fb8-f348-40b1-b927-301d5da83a27 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:50.434598 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1277/2545] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:13:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:13:54.392870 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047d2e1-465b-4602-bd4d-4b2ddb33739b None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:54.393684 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047d2e1-465b-4602-bd4d-4b2ddb33739b None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:54.393684 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047d2e1-465b-4602-bd4d-4b2ddb33739b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:54.426457 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-1047d2e1-465b-4602-bd4d-4b2ddb33739b None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:13:54.428682 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-1047d2e1-465b-4602-bd4d-4b2ddb33739b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:54.440413 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1269/2546] 10.222.0.69 () {58 vars in 1016 bytes} [Wed Jul 27 09:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:13:54.465767 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f91fb8-f348-40b1-b927-301d5da83a27 service nova] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:54.467708 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-06f91fb8-f348-40b1-b927-301d5da83a27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:54.488489 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f91fb8-f348-40b1-b927-301d5da83a27 service nova] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:54.498083 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45d914-a430-4243-9b5a-021abdee0a3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:54.499156 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45d914-a430-4243-9b5a-021abdee0a3d service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:54.499632 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45d914-a430-4243-9b5a-021abdee0a3d service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:54.500086 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45d914-a430-4243-9b5a-021abdee0a3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:54.516509 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45d914-a430-4243-9b5a-021abdee0a3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:54.520457 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45d914-a430-4243-9b5a-021abdee0a3d service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:54.529897 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047d2e1-465b-4602-bd4d-4b2ddb33739b None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:54.546595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1278/2547] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:13:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:13:54.547775 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047d2e1-465b-4602-bd4d-4b2ddb33739b None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:54.557201 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed20c65-e10c-4998-8441-5f3d710f22ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:54.558245 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed20c65-e10c-4998-8441-5f3d710f22ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:54.558752 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed20c65-e10c-4998-8441-5f3d710f22ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:54.559211 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed20c65-e10c-4998-8441-5f3d710f22ce admin admin] PATH_INFO: `/v3/users/d05fbe66669e472396c00a64b0e24fa3` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:54.561139 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed20c65-e10c-4998-8441-5f3d710f22ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=d05fbe66669e472396c00a64b0e24fa3)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:54.563623 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed20c65-e10c-4998-8441-5f3d710f22ce admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:54.634062 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-4ed20c65-e10c-4998-8441-5f3d710f22ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd05fbe66669e472396c00a64b0e24fa3'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:54.635777 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-4ed20c65-e10c-4998-8441-5f3d710f22ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd05fbe66669e472396c00a64b0e24fa3'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:54.636631 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-4ed20c65-e10c-4998-8441-5f3d710f22ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd05fbe66669e472396c00a64b0e24fa3'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:54.647985 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-4ed20c65-e10c-4998-8441-5f3d710f22ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd05fbe66669e472396c00a64b0e24fa3'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:54.664113 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-4ed20c65-e10c-4998-8441-5f3d710f22ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd05fbe66669e472396c00a64b0e24fa3'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:54.677831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1270/2548] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:13:54 2022] DELETE /identity/v3/users/d05fbe66669e472396c00a64b0e24fa3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:13:54.683735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ea1c2-d20e-4520-b679-b8abf3f21699 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:54.684102 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ea1c2-d20e-4520-b679-b8abf3f21699 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:54.684424 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ea1c2-d20e-4520-b679-b8abf3f21699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:54.706677 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-520ea1c2-d20e-4520-b679-b8abf3f21699 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:13:54.707947 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-520ea1c2-d20e-4520-b679-b8abf3f21699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:54.781938 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1279/2549] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:13:54.793619 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed20c65-e10c-4998-8441-5f3d710f22ce admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:54.796510 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-4ed20c65-e10c-4998-8441-5f3d710f22ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:54.867893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed20c65-e10c-4998-8441-5f3d710f22ce admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:54.874542 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6aca2-2c4b-4e87-9d37-191e3b018897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:54.875696 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6aca2-2c4b-4e87-9d37-191e3b018897 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:54.876204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6aca2-2c4b-4e87-9d37-191e3b018897 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:54.876690 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6aca2-2c4b-4e87-9d37-191e3b018897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:54.893298 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6aca2-2c4b-4e87-9d37-191e3b018897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:54.895956 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6aca2-2c4b-4e87-9d37-191e3b018897 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:54.910857 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1271/2550] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:13:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:13:55.306688 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ea1c2-d20e-4520-b679-b8abf3f21699 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:55.309204 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-520ea1c2-d20e-4520-b679-b8abf3f21699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:55.333452 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ea1c2-d20e-4520-b679-b8abf3f21699 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:55.341313 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd8893-5213-450a-a1ee-038bd26a3a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:55.342768 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd8893-5213-450a-a1ee-038bd26a3a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:55.343332 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd8893-5213-450a-a1ee-038bd26a3a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:55.343926 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd8893-5213-450a-a1ee-038bd26a3a0b admin admin] PATH_INFO: `/v3/projects/77afa3fb70fe46389d1cf2cfe1511ad2` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:55.346057 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd8893-5213-450a-a1ee-038bd26a3a0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=77afa3fb70fe46389d1cf2cfe1511ad2)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:55.348678 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd8893-5213-450a-a1ee-038bd26a3a0b admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:55.417701 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-46cd8893-5213-450a-a1ee-038bd26a3a0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77afa3fb70fe46389d1cf2cfe1511ad2', 'request_id': 'req-46cd8893-5213-450a-a1ee-038bd26a3a0b'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:55.425054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-46cd8893-5213-450a-a1ee-038bd26a3a0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77afa3fb70fe46389d1cf2cfe1511ad2', 'request_id': 'req-46cd8893-5213-450a-a1ee-038bd26a3a0b'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:55.431478 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-46cd8893-5213-450a-a1ee-038bd26a3a0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77afa3fb70fe46389d1cf2cfe1511ad2', 'request_id': 'req-46cd8893-5213-450a-a1ee-038bd26a3a0b'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:55.437103 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:55.449923 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-46cd8893-5213-450a-a1ee-038bd26a3a0b admin admin] The token cache is being invalidate because project 77afa3fb70fe46389d1cf2cfe1511ad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:13:55.450772 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-46cd8893-5213-450a-a1ee-038bd26a3a0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:55.451746 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-46cd8893-5213-450a-a1ee-038bd26a3a0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:55.454012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1280/2551] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:13:55 2022] DELETE /identity/v3/projects/77afa3fb70fe46389d1cf2cfe1511ad2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:13:55.458374 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6aca2-2c4b-4e87-9d37-191e3b018897 service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:55.470225 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6aca2-2c4b-4e87-9d37-191e3b018897 service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:55.476106 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:55.557906 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0aff76-955d-47e7-8d0a-be6817674381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:55.558885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0aff76-955d-47e7-8d0a-be6817674381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:55.559234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0aff76-955d-47e7-8d0a-be6817674381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:55.559460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0aff76-955d-47e7-8d0a-be6817674381 admin admin] PATH_INFO: `/v3/users/9ef09c17c74f4cacb546836f18bfd862` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:55.560988 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0aff76-955d-47e7-8d0a-be6817674381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ef09c17c74f4cacb546836f18bfd862)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:55.563328 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0aff76-955d-47e7-8d0a-be6817674381 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:55.625636 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-6a0aff76-955d-47e7-8d0a-be6817674381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ef09c17c74f4cacb546836f18bfd862'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:55.626466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-6a0aff76-955d-47e7-8d0a-be6817674381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ef09c17c74f4cacb546836f18bfd862'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:55.627029 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-6a0aff76-955d-47e7-8d0a-be6817674381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ef09c17c74f4cacb546836f18bfd862'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:55.636345 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-6a0aff76-955d-47e7-8d0a-be6817674381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ef09c17c74f4cacb546836f18bfd862'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:55.654164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-6a0aff76-955d-47e7-8d0a-be6817674381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ef09c17c74f4cacb546836f18bfd862'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:55.670059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1272/2552] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:13:55 2022] DELETE /identity/v3/users/9ef09c17c74f4cacb546836f18bfd862 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:13:56.090509 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd8893-5213-450a-a1ee-038bd26a3a0b admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:56.092955 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-46cd8893-5213-450a-a1ee-038bd26a3a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:56.116843 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd8893-5213-450a-a1ee-038bd26a3a0b admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:56.201455 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bd4ba-bc81-4522-bb08-b13d41c5b133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:56.202450 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bd4ba-bc81-4522-bb08-b13d41c5b133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:56.202919 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bd4ba-bc81-4522-bb08-b13d41c5b133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:56.203270 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bd4ba-bc81-4522-bb08-b13d41c5b133 admin admin] PATH_INFO: `/v3/projects/9342e57d743d4b19a6e5f2e8afbfcfbf` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:56.205202 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bd4ba-bc81-4522-bb08-b13d41c5b133 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9342e57d743d4b19a6e5f2e8afbfcfbf)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:56.207734 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bd4ba-bc81-4522-bb08-b13d41c5b133 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:56.283633 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-ad0bd4ba-bc81-4522-bb08-b13d41c5b133 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9342e57d743d4b19a6e5f2e8afbfcfbf', 'request_id': 'req-ad0bd4ba-bc81-4522-bb08-b13d41c5b133'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:56.295087 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-ad0bd4ba-bc81-4522-bb08-b13d41c5b133 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9342e57d743d4b19a6e5f2e8afbfcfbf', 'request_id': 'req-ad0bd4ba-bc81-4522-bb08-b13d41c5b133'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:56.305855 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-ad0bd4ba-bc81-4522-bb08-b13d41c5b133 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9342e57d743d4b19a6e5f2e8afbfcfbf', 'request_id': 'req-ad0bd4ba-bc81-4522-bb08-b13d41c5b133'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:56.325402 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-ad0bd4ba-bc81-4522-bb08-b13d41c5b133 admin admin] The token cache is being invalidate because project 9342e57d743d4b19a6e5f2e8afbfcfbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:13:56.325402 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-ad0bd4ba-bc81-4522-bb08-b13d41c5b133 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:56.326111 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-ad0bd4ba-bc81-4522-bb08-b13d41c5b133 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:13:56.328172 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1281/2553] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:13:56 2022] DELETE /identity/v3/projects/9342e57d743d4b19a6e5f2e8afbfcfbf => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:13:56.333957 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21536b32-e7f4-4979-9094-e5a1bce09a50 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:56.334452 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21536b32-e7f4-4979-9094-e5a1bce09a50 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:56.334765 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21536b32-e7f4-4979-9094-e5a1bce09a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:56.359784 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-21536b32-e7f4-4979-9094-e5a1bce09a50 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:13:56.361033 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-21536b32-e7f4-4979-9094-e5a1bce09a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:56.437413 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1273/2554] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:13:56.448961 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fdfc8-4919-4751-8367-c6e599db903c None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:56.449282 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fdfc8-4919-4751-8367-c6e599db903c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:56.449613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fdfc8-4919-4751-8367-c6e599db903c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:56.472455 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-e22fdfc8-4919-4751-8367-c6e599db903c None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:13:56.473697 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e22fdfc8-4919-4751-8367-c6e599db903c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:56.483009 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1282/2555] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:13:56.487899 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21536b32-e7f4-4979-9094-e5a1bce09a50 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:56.499750 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21536b32-e7f4-4979-9094-e5a1bce09a50 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:56.505284 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949877a3-fa69-441b-8249-9c17a75e7c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:56.506021 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949877a3-fa69-441b-8249-9c17a75e7c01 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:56.506425 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949877a3-fa69-441b-8249-9c17a75e7c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:56.506714 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949877a3-fa69-441b-8249-9c17a75e7c01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:56.507569 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949877a3-fa69-441b-8249-9c17a75e7c01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:13:56.507909 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949877a3-fa69-441b-8249-9c17a75e7c01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:56.509663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949877a3-fa69-441b-8249-9c17a75e7c01 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:56.523406 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1274/2556] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:13:56.529079 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fdfc8-4919-4751-8367-c6e599db903c None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:56.541156 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fdfc8-4919-4751-8367-c6e599db903c None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:56.546217 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ad87a-cd3c-413f-a3c1-22bfe375b05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:56.547024 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ad87a-cd3c-413f-a3c1-22bfe375b05a admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:56.547333 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ad87a-cd3c-413f-a3c1-22bfe375b05a admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:56.547621 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ad87a-cd3c-413f-a3c1-22bfe375b05a admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:56.548341 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ad87a-cd3c-413f-a3c1-22bfe375b05a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:56.550350 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ad87a-cd3c-413f-a3c1-22bfe375b05a admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:56.583897 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1283/2557] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:13:56 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:13:56.591225 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949877a3-fa69-441b-8249-9c17a75e7c01 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:56.610466 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949877a3-fa69-441b-8249-9c17a75e7c01 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:56.633655 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:56.704997 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8db194-1f20-49c5-bba1-28ba9e3e8af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:56.705621 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8db194-1f20-49c5-bba1-28ba9e3e8af9 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:56.705903 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8db194-1f20-49c5-bba1-28ba9e3e8af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:56.706177 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8db194-1f20-49c5-bba1-28ba9e3e8af9 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:56.706939 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8db194-1f20-49c5-bba1-28ba9e3e8af9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:56.708950 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8db194-1f20-49c5-bba1-28ba9e3e8af9 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:56.746156 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1275/2558] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:13:56 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:13:56.751016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ad87a-cd3c-413f-a3c1-22bfe375b05a admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:56.763645 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ad87a-cd3c-413f-a3c1-22bfe375b05a admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:56.771491 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e7ca5-da53-42f2-98d5-7ff05dea7e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:56.772650 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e7ca5-da53-42f2-98d5-7ff05dea7e32 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:56.773139 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e7ca5-da53-42f2-98d5-7ff05dea7e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:56.773627 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e7ca5-da53-42f2-98d5-7ff05dea7e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:56.777220 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e7ca5-da53-42f2-98d5-7ff05dea7e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:56.780090 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e7ca5-da53-42f2-98d5-7ff05dea7e32 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:56.799717 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1284/2559] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:13:56.801833 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8db194-1f20-49c5-bba1-28ba9e3e8af9 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:56.822070 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8db194-1f20-49c5-bba1-28ba9e3e8af9 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:56.831074 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912065f-6664-4b10-afda-84a24118c853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:56.832196 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912065f-6664-4b10-afda-84a24118c853 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:56.832699 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912065f-6664-4b10-afda-84a24118c853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:56.833210 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912065f-6664-4b10-afda-84a24118c853 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:56.834673 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912065f-6664-4b10-afda-84a24118c853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:56.838596 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912065f-6664-4b10-afda-84a24118c853 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:56.861296 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1276/2560] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:13:56.865833 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e7ca5-da53-42f2-98d5-7ff05dea7e32 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:56.877852 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e7ca5-da53-42f2-98d5-7ff05dea7e32 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:56.883236 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260574d7-ee07-4113-902c-a57a2856a7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:56.884661 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260574d7-ee07-4113-902c-a57a2856a7f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:56.884956 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260574d7-ee07-4113-902c-a57a2856a7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:56.885282 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260574d7-ee07-4113-902c-a57a2856a7f5 admin admin] PATH_INFO: `/v3/projects/1343a46944f6485abc4d89bef91e9c93/users/60e76e14683346dcb99087eea6d8379c/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:56.903835 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260574d7-ee07-4113-902c-a57a2856a7f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1343a46944f6485abc4d89bef91e9c93, user_id=60e76e14683346dcb99087eea6d8379c, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:56.906591 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260574d7-ee07-4113-902c-a57a2856a7f5 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:56.927088 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1285/2561] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:13:56 2022] PUT /identity/v3/projects/1343a46944f6485abc4d89bef91e9c93/users/60e76e14683346dcb99087eea6d8379c/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:13:56.939348 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010614c0-e5cb-46ed-82c9-a4ac38b884b7 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:56.939685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010614c0-e5cb-46ed-82c9-a4ac38b884b7 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:56.939975 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010614c0-e5cb-46ed-82c9-a4ac38b884b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:56.972838 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-010614c0-e5cb-46ed-82c9-a4ac38b884b7 None None] MFA Rules not processed for user `60e76e14683346dcb99087eea6d8379c`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:13:56.974100 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-010614c0-e5cb-46ed-82c9-a4ac38b884b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:57.053665 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1277/2562] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:13:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:13:57.058983 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260574d7-ee07-4113-902c-a57a2856a7f5 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:57.090143 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:57.140849 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260574d7-ee07-4113-902c-a57a2856a7f5 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:57.146803 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839da95-5b3b-40fe-94a4-fd95c14ed771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:57.147639 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839da95-5b3b-40fe-94a4-fd95c14ed771 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:57.148080 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839da95-5b3b-40fe-94a4-fd95c14ed771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:57.148435 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839da95-5b3b-40fe-94a4-fd95c14ed771 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:57.149216 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839da95-5b3b-40fe-94a4-fd95c14ed771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:57.152563 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839da95-5b3b-40fe-94a4-fd95c14ed771 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:57.185483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1286/2563] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:13:57 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:13:57.189882 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010614c0-e5cb-46ed-82c9-a4ac38b884b7 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:57.203797 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010614c0-e5cb-46ed-82c9-a4ac38b884b7 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:57.314135 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f50e1-8e39-4e13-9dbf-369d9eca8b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:57.314923 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f50e1-8e39-4e13-9dbf-369d9eca8b0b admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:57.315267 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f50e1-8e39-4e13-9dbf-369d9eca8b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:57.315637 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f50e1-8e39-4e13-9dbf-369d9eca8b0b admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:57.316442 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f50e1-8e39-4e13-9dbf-369d9eca8b0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:57.318912 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f50e1-8e39-4e13-9dbf-369d9eca8b0b admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:57.355344 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1278/2564] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:13:57 2022] POST /identity/v3/users => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:13:57.361122 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839da95-5b3b-40fe-94a4-fd95c14ed771 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:57.374857 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839da95-5b3b-40fe-94a4-fd95c14ed771 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:57.382624 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43c50b-bc6b-4c57-9842-0b770b0d24ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:57.383615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43c50b-bc6b-4c57-9842-0b770b0d24ce admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:57.384743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43c50b-bc6b-4c57-9842-0b770b0d24ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:57.385269 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43c50b-bc6b-4c57-9842-0b770b0d24ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:57.386603 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce43c50b-bc6b-4c57-9842-0b770b0d24ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:57.389933 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce43c50b-bc6b-4c57-9842-0b770b0d24ce admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:57.422372 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1287/2565] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:13:57.427884 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f50e1-8e39-4e13-9dbf-369d9eca8b0b admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:57.448438 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f50e1-8e39-4e13-9dbf-369d9eca8b0b admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:57.455865 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650819f-a8ea-4e9a-a349-2fba0853764d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:57.456972 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650819f-a8ea-4e9a-a349-2fba0853764d admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:57.457425 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650819f-a8ea-4e9a-a349-2fba0853764d admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:57.457872 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650819f-a8ea-4e9a-a349-2fba0853764d admin admin] PATH_INFO: `/v3/projects/20b61ff13463419497e11539c3ddd739/users/62b5d5581b58485695ac2cd67eab46af/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:57.476852 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:57.491214 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650819f-a8ea-4e9a-a349-2fba0853764d admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b61ff13463419497e11539c3ddd739, user_id=62b5d5581b58485695ac2cd67eab46af, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:57.494866 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650819f-a8ea-4e9a-a349-2fba0853764d admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:57.518192 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1279/2566] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:13:57 2022] PUT /identity/v3/projects/20b61ff13463419497e11539c3ddd739/users/62b5d5581b58485695ac2cd67eab46af/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:13:57.526646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43c50b-bc6b-4c57-9842-0b770b0d24ce admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:57.545962 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43c50b-bc6b-4c57-9842-0b770b0d24ce admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:57.624048 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2614c4-ae36-41bc-9a71-18a27a9622bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:57.624705 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2614c4-ae36-41bc-9a71-18a27a9622bb admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:57.625060 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2614c4-ae36-41bc-9a71-18a27a9622bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:57.625264 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2614c4-ae36-41bc-9a71-18a27a9622bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:57.625969 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2614c4-ae36-41bc-9a71-18a27a9622bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:57.627690 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2614c4-ae36-41bc-9a71-18a27a9622bb admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:57.641173 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1288/2567] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:13:57.645987 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650819f-a8ea-4e9a-a349-2fba0853764d admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:57.659062 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650819f-a8ea-4e9a-a349-2fba0853764d admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:57.664371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a196fd4-26fd-45c0-b5bb-5bb8d0827af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:57.665643 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a196fd4-26fd-45c0-b5bb-5bb8d0827af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:57.665927 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a196fd4-26fd-45c0-b5bb-5bb8d0827af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:57.666230 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a196fd4-26fd-45c0-b5bb-5bb8d0827af8 admin admin] PATH_INFO: `/v3/projects/20b61ff13463419497e11539c3ddd739/users/62b5d5581b58485695ac2cd67eab46af/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:57.668447 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a196fd4-26fd-45c0-b5bb-5bb8d0827af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b61ff13463419497e11539c3ddd739, user_id=62b5d5581b58485695ac2cd67eab46af, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:57.671240 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a196fd4-26fd-45c0-b5bb-5bb8d0827af8 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:57.689216 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1280/2568] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:13:57 2022] PUT /identity/v3/projects/20b61ff13463419497e11539c3ddd739/users/62b5d5581b58485695ac2cd67eab46af/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:13:57.701939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c6a92-f407-4031-8387-ba6e9edf11c5 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:57.702262 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c6a92-f407-4031-8387-ba6e9edf11c5 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:57.702526 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c6a92-f407-4031-8387-ba6e9edf11c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:57.753510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-544c6a92-f407-4031-8387-ba6e9edf11c5 None None] MFA Rules not processed for user `62b5d5581b58485695ac2cd67eab46af`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:13:57.755175 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-544c6a92-f407-4031-8387-ba6e9edf11c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:57.859391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1289/2569] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:13:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:13:57.872302 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a196fd4-26fd-45c0-b5bb-5bb8d0827af8 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:57.874953 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-5a196fd4-26fd-45c0-b5bb-5bb8d0827af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:58.006012 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a196fd4-26fd-45c0-b5bb-5bb8d0827af8 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:58.012322 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1152e-d179-408e-bd90-300f99a181a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:58.013475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1152e-d179-408e-bd90-300f99a181a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:58.013992 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1152e-d179-408e-bd90-300f99a181a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:58.014667 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1152e-d179-408e-bd90-300f99a181a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:58.037253 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1152e-d179-408e-bd90-300f99a181a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:58.039308 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1152e-d179-408e-bd90-300f99a181a2 service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:58.051642 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1281/2570] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:13:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:13:58.181816 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c6a92-f407-4031-8387-ba6e9edf11c5 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:58.183603 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-544c6a92-f407-4031-8387-ba6e9edf11c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:58.198829 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c6a92-f407-4031-8387-ba6e9edf11c5 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:58.202759 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ada8ed-c7aa-4109-94db-f71144aea467 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:58.203410 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ada8ed-c7aa-4109-94db-f71144aea467 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:58.203691 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ada8ed-c7aa-4109-94db-f71144aea467 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:58.203976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ada8ed-c7aa-4109-94db-f71144aea467 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:58.219785 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:13:58.276572 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ada8ed-c7aa-4109-94db-f71144aea467 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:58.278103 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ada8ed-c7aa-4109-94db-f71144aea467 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:58.288609 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1290/2571] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:13:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:13:59.056432 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909e83a-e17b-4ae1-a3ec-a8dd766bf93a None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:59.057323 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909e83a-e17b-4ae1-a3ec-a8dd766bf93a None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:59.057323 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909e83a-e17b-4ae1-a3ec-a8dd766bf93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:59.080395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-7909e83a-e17b-4ae1-a3ec-a8dd766bf93a None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:13:59.081962 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-7909e83a-e17b-4ae1-a3ec-a8dd766bf93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:59.183814 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1282/2572] 10.222.0.69 () {58 vars in 1016 bytes} [Wed Jul 27 09:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:13:59.202008 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ada8ed-c7aa-4109-94db-f71144aea467 service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:13:59.204665 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f7ada8ed-c7aa-4109-94db-f71144aea467 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:13:59.335787 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ada8ed-c7aa-4109-94db-f71144aea467 service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:13:59.346578 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f66dd-5777-46e9-b5e6-cde11be817bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:13:59.347309 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f66dd-5777-46e9-b5e6-cde11be817bf service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:13:59.347739 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f66dd-5777-46e9-b5e6-cde11be817bf service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:13:59.348474 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f66dd-5777-46e9-b5e6-cde11be817bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:13:59.364539 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f66dd-5777-46e9-b5e6-cde11be817bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:13:59.366809 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f66dd-5777-46e9-b5e6-cde11be817bf service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:13:59.380712 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1291/2573] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:13:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:14:01.098284 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909e83a-e17b-4ae1-a3ec-a8dd766bf93a None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:01.109386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909e83a-e17b-4ae1-a3ec-a8dd766bf93a None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:01.114357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cf49b-1516-4c37-af23-65bd62f7a5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:01.115037 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cf49b-1516-4c37-af23-65bd62f7a5f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:01.115310 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cf49b-1516-4c37-af23-65bd62f7a5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:01.115581 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cf49b-1516-4c37-af23-65bd62f7a5f0 admin admin] PATH_INFO: `/v3/users/60e76e14683346dcb99087eea6d8379c` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:01.117052 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766cf49b-1516-4c37-af23-65bd62f7a5f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60e76e14683346dcb99087eea6d8379c)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:01.119501 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766cf49b-1516-4c37-af23-65bd62f7a5f0 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:01.178732 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-766cf49b-1516-4c37-af23-65bd62f7a5f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60e76e14683346dcb99087eea6d8379c'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:01.179557 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-766cf49b-1516-4c37-af23-65bd62f7a5f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60e76e14683346dcb99087eea6d8379c'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:01.181449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-766cf49b-1516-4c37-af23-65bd62f7a5f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60e76e14683346dcb99087eea6d8379c'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:01.193154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-766cf49b-1516-4c37-af23-65bd62f7a5f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60e76e14683346dcb99087eea6d8379c'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:01.209851 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-766cf49b-1516-4c37-af23-65bd62f7a5f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60e76e14683346dcb99087eea6d8379c'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:01.214796 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:01.232730 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1283/2574] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:14:01 2022] DELETE /identity/v3/users/60e76e14683346dcb99087eea6d8379c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:14:01.237757 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ad2d9-bafe-445a-8129-890cff61f18b None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:01.238432 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ad2d9-bafe-445a-8129-890cff61f18b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:01.238600 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ad2d9-bafe-445a-8129-890cff61f18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:01.262491 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f28ad2d9-bafe-445a-8129-890cff61f18b None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:01.263766 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f28ad2d9-bafe-445a-8129-890cff61f18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:01.336887 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1292/2575] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:14:01.346906 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cf49b-1516-4c37-af23-65bd62f7a5f0 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:01.348465 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-766cf49b-1516-4c37-af23-65bd62f7a5f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:01.417954 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cf49b-1516-4c37-af23-65bd62f7a5f0 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:01.422099 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbc1e8-a946-407e-8ae0-23fef3b6e422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:01.422777 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbc1e8-a946-407e-8ae0-23fef3b6e422 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:01.423057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbc1e8-a946-407e-8ae0-23fef3b6e422 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:01.423327 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbc1e8-a946-407e-8ae0-23fef3b6e422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:01.435374 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbc1e8-a946-407e-8ae0-23fef3b6e422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:01.437371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbc1e8-a946-407e-8ae0-23fef3b6e422 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:01.449959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1284/2576] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:14:01.826187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ad2d9-bafe-445a-8129-890cff61f18b None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:01.827960 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f28ad2d9-bafe-445a-8129-890cff61f18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:01.847370 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ad2d9-bafe-445a-8129-890cff61f18b None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:01.857577 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc6bf1-0f5c-4d03-a1f2-59a6c432bc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:01.858784 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc6bf1-0f5c-4d03-a1f2-59a6c432bc95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:01.859272 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc6bf1-0f5c-4d03-a1f2-59a6c432bc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:01.859928 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc6bf1-0f5c-4d03-a1f2-59a6c432bc95 admin admin] PATH_INFO: `/v3/projects/1343a46944f6485abc4d89bef91e9c93` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:01.863585 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc6bf1-0f5c-4d03-a1f2-59a6c432bc95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1343a46944f6485abc4d89bef91e9c93)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:01.868596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc6bf1-0f5c-4d03-a1f2-59a6c432bc95 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:01.939712 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:01.954297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-13fc6bf1-0f5c-4d03-a1f2-59a6c432bc95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1343a46944f6485abc4d89bef91e9c93', 'request_id': 'req-13fc6bf1-0f5c-4d03-a1f2-59a6c432bc95'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:01.963392 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-13fc6bf1-0f5c-4d03-a1f2-59a6c432bc95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1343a46944f6485abc4d89bef91e9c93', 'request_id': 'req-13fc6bf1-0f5c-4d03-a1f2-59a6c432bc95'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:01.970669 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-13fc6bf1-0f5c-4d03-a1f2-59a6c432bc95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1343a46944f6485abc4d89bef91e9c93', 'request_id': 'req-13fc6bf1-0f5c-4d03-a1f2-59a6c432bc95'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:01.993575 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-13fc6bf1-0f5c-4d03-a1f2-59a6c432bc95 admin admin] The token cache is being invalidate because project 1343a46944f6485abc4d89bef91e9c93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:14:01.994062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-13fc6bf1-0f5c-4d03-a1f2-59a6c432bc95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:01.995275 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-13fc6bf1-0f5c-4d03-a1f2-59a6c432bc95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:01.997747 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1293/2577] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:14:01 2022] DELETE /identity/v3/projects/1343a46944f6485abc4d89bef91e9c93 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:14:02.004816 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbc1e8-a946-407e-8ae0-23fef3b6e422 service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:02.023677 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbc1e8-a946-407e-8ae0-23fef3b6e422 service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:02.116179 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd247d-24e3-40b4-9061-ef08b127b352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:02.117839 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd247d-24e3-40b4-9061-ef08b127b352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:02.117972 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd247d-24e3-40b4-9061-ef08b127b352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:02.118442 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd247d-24e3-40b4-9061-ef08b127b352 admin admin] PATH_INFO: `/v3/users/62b5d5581b58485695ac2cd67eab46af` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:02.119919 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd247d-24e3-40b4-9061-ef08b127b352 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62b5d5581b58485695ac2cd67eab46af)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:02.122066 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd247d-24e3-40b4-9061-ef08b127b352 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:02.205308 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-66bd247d-24e3-40b4-9061-ef08b127b352 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62b5d5581b58485695ac2cd67eab46af'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:02.206294 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-66bd247d-24e3-40b4-9061-ef08b127b352 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62b5d5581b58485695ac2cd67eab46af'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:02.207062 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-66bd247d-24e3-40b4-9061-ef08b127b352 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62b5d5581b58485695ac2cd67eab46af'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:02.217568 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-66bd247d-24e3-40b4-9061-ef08b127b352 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62b5d5581b58485695ac2cd67eab46af'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:02.235503 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-66bd247d-24e3-40b4-9061-ef08b127b352 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62b5d5581b58485695ac2cd67eab46af'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:02.255647 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1285/2578] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:14:02 2022] DELETE /identity/v3/users/62b5d5581b58485695ac2cd67eab46af => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:02.705663 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc6bf1-0f5c-4d03-a1f2-59a6c432bc95 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:02.707612 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-13fc6bf1-0f5c-4d03-a1f2-59a6c432bc95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:02.724325 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc6bf1-0f5c-4d03-a1f2-59a6c432bc95 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:02.817093 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d8783-b82c-4f30-9c07-9cef0afbb06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:02.817769 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d8783-b82c-4f30-9c07-9cef0afbb06c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:02.818054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d8783-b82c-4f30-9c07-9cef0afbb06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:02.818348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d8783-b82c-4f30-9c07-9cef0afbb06c admin admin] PATH_INFO: `/v3/projects/20b61ff13463419497e11539c3ddd739` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:02.819663 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d8783-b82c-4f30-9c07-9cef0afbb06c admin admin] RBAC: Authorizing `identity:delete_project(project_id=20b61ff13463419497e11539c3ddd739)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:02.822122 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d8783-b82c-4f30-9c07-9cef0afbb06c admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:02.897575 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b07d8783-b82c-4f30-9c07-9cef0afbb06c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20b61ff13463419497e11539c3ddd739', 'request_id': 'req-b07d8783-b82c-4f30-9c07-9cef0afbb06c'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:02.907027 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b07d8783-b82c-4f30-9c07-9cef0afbb06c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20b61ff13463419497e11539c3ddd739', 'request_id': 'req-b07d8783-b82c-4f30-9c07-9cef0afbb06c'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:02.916515 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b07d8783-b82c-4f30-9c07-9cef0afbb06c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20b61ff13463419497e11539c3ddd739', 'request_id': 'req-b07d8783-b82c-4f30-9c07-9cef0afbb06c'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:02.935985 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b07d8783-b82c-4f30-9c07-9cef0afbb06c admin admin] The token cache is being invalidate because project 20b61ff13463419497e11539c3ddd739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:14:02.936289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b07d8783-b82c-4f30-9c07-9cef0afbb06c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:02.937033 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b07d8783-b82c-4f30-9c07-9cef0afbb06c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:02.939445 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1294/2579] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:14:02 2022] DELETE /identity/v3/projects/20b61ff13463419497e11539c3ddd739 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:14:02.946962 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b712d9f-b1f7-49ac-93d0-2bee58881a8f None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:02.947397 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b712d9f-b1f7-49ac-93d0-2bee58881a8f None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:02.947689 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b712d9f-b1f7-49ac-93d0-2bee58881a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:02.986007 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-3b712d9f-b1f7-49ac-93d0-2bee58881a8f None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:02.988387 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-3b712d9f-b1f7-49ac-93d0-2bee58881a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:03.006017 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:03.108410 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1286/2580] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:14:03.122440 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f8140-1e6c-4119-91aa-5fa11c1d1cef None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:03.123332 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f8140-1e6c-4119-91aa-5fa11c1d1cef None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:03.124052 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f8140-1e6c-4119-91aa-5fa11c1d1cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:03.189797 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-972f8140-1e6c-4119-91aa-5fa11c1d1cef None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:03.193283 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-972f8140-1e6c-4119-91aa-5fa11c1d1cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:03.223271 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1295/2581] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:03.223690 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b712d9f-b1f7-49ac-93d0-2bee58881a8f None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:03.239483 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b712d9f-b1f7-49ac-93d0-2bee58881a8f None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:03.248239 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eccf10-b6e9-455e-ba0d-38299622c88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:03.248239 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eccf10-b6e9-455e-ba0d-38299622c88a admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:03.248711 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eccf10-b6e9-455e-ba0d-38299622c88a admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:03.248894 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eccf10-b6e9-455e-ba0d-38299622c88a admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:03.250041 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eccf10-b6e9-455e-ba0d-38299622c88a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:14:03.250840 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eccf10-b6e9-455e-ba0d-38299622c88a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:03.253422 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eccf10-b6e9-455e-ba0d-38299622c88a admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:03.277886 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1287/2582] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 09:14:03.280740 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f8140-1e6c-4119-91aa-5fa11c1d1cef None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:03.296105 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f8140-1e6c-4119-91aa-5fa11c1d1cef None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:03.302455 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64398d94-98e6-442a-b19f-81071afa8443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:03.303483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64398d94-98e6-442a-b19f-81071afa8443 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:03.304074 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64398d94-98e6-442a-b19f-81071afa8443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:03.304574 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64398d94-98e6-442a-b19f-81071afa8443 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:03.306069 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64398d94-98e6-442a-b19f-81071afa8443 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:03.309760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64398d94-98e6-442a-b19f-81071afa8443 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:03.353546 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1296/2583] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:14:03 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:14:03.358623 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eccf10-b6e9-455e-ba0d-38299622c88a admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:03.376174 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eccf10-b6e9-455e-ba0d-38299622c88a admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:03.479972 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fbe1f-5f10-49c0-b12c-8557da0f333c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:03.480810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fbe1f-5f10-49c0-b12c-8557da0f333c admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:03.481289 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fbe1f-5f10-49c0-b12c-8557da0f333c admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:03.481773 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fbe1f-5f10-49c0-b12c-8557da0f333c admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:03.483189 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fbe1f-5f10-49c0-b12c-8557da0f333c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:03.485494 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fbe1f-5f10-49c0-b12c-8557da0f333c admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:03.518961 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1288/2584] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:14:03 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:14:03.528651 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64398d94-98e6-442a-b19f-81071afa8443 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:03.550812 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64398d94-98e6-442a-b19f-81071afa8443 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:03.563087 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5299cf-e11c-4785-a3bc-bb6d9b576502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:03.564280 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5299cf-e11c-4785-a3bc-bb6d9b576502 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:03.564855 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5299cf-e11c-4785-a3bc-bb6d9b576502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:03.565550 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5299cf-e11c-4785-a3bc-bb6d9b576502 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:03.567463 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5299cf-e11c-4785-a3bc-bb6d9b576502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:03.574296 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5299cf-e11c-4785-a3bc-bb6d9b576502 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:03.603175 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1297/2585] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:14:03.610441 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fbe1f-5f10-49c0-b12c-8557da0f333c admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:03.636816 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fbe1f-5f10-49c0-b12c-8557da0f333c admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:03.648740 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c14d3-d17b-41e6-b6f6-5e2db4a9a03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:03.649913 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c14d3-d17b-41e6-b6f6-5e2db4a9a03f admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:03.659093 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c14d3-d17b-41e6-b6f6-5e2db4a9a03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:03.660119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c14d3-d17b-41e6-b6f6-5e2db4a9a03f admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:03.663010 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c14d3-d17b-41e6-b6f6-5e2db4a9a03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:03.667037 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c14d3-d17b-41e6-b6f6-5e2db4a9a03f admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:03.735726 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1289/2586] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:14:03.742565 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5299cf-e11c-4785-a3bc-bb6d9b576502 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:03.771539 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5299cf-e11c-4785-a3bc-bb6d9b576502 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:03.784842 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603e1a3-296f-4476-8df4-41956e52b80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:03.787503 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603e1a3-296f-4476-8df4-41956e52b80a admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:03.788683 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603e1a3-296f-4476-8df4-41956e52b80a admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:03.789503 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603e1a3-296f-4476-8df4-41956e52b80a admin admin] PATH_INFO: `/v3/projects/3159243450134be18d69912fbc4cbcf7/users/189b7d79d0d44b3780f28ca2edf87028/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:03.814217 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:03.830538 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603e1a3-296f-4476-8df4-41956e52b80a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3159243450134be18d69912fbc4cbcf7, user_id=189b7d79d0d44b3780f28ca2edf87028, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:03.834134 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603e1a3-296f-4476-8df4-41956e52b80a admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:03.855069 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1298/2587] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:14:03 2022] PUT /identity/v3/projects/3159243450134be18d69912fbc4cbcf7/users/189b7d79d0d44b3780f28ca2edf87028/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:03.865846 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3ad39-e1de-4ce0-a6b3-544b0e279efc None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:03.866168 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3ad39-e1de-4ce0-a6b3-544b0e279efc None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:03.866482 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3ad39-e1de-4ce0-a6b3-544b0e279efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:03.906383 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-2dc3ad39-e1de-4ce0-a6b3-544b0e279efc None None] MFA Rules not processed for user `189b7d79d0d44b3780f28ca2edf87028`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:03.908556 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-2dc3ad39-e1de-4ce0-a6b3-544b0e279efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:04.045992 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1290/2588] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:14:04.051268 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603e1a3-296f-4476-8df4-41956e52b80a admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:04.131457 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280e082-cfb4-47ff-b1d6-1ec54ff10302 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:04.132311 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280e082-cfb4-47ff-b1d6-1ec54ff10302 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:04.132660 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280e082-cfb4-47ff-b1d6-1ec54ff10302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:04.175167 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-0280e082-cfb4-47ff-b1d6-1ec54ff10302 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:04.176424 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-0280e082-cfb4-47ff-b1d6-1ec54ff10302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:04.186295 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1291/2589] 10.222.0.69 () {58 vars in 1016 bytes} [Wed Jul 27 09:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:14:04.187950 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603e1a3-296f-4476-8df4-41956e52b80a admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:04.204189 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280e082-cfb4-47ff-b1d6-1ec54ff10302 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:04.205409 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed0db0-2ccb-45e5-b9cc-857fc79f33b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:04.205720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-0280e082-cfb4-47ff-b1d6-1ec54ff10302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:04.206073 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed0db0-2ccb-45e5-b9cc-857fc79f33b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:04.206390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed0db0-2ccb-45e5-b9cc-857fc79f33b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:04.206685 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed0db0-2ccb-45e5-b9cc-857fc79f33b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:04.207394 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed0db0-2ccb-45e5-b9cc-857fc79f33b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:04.209530 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed0db0-2ccb-45e5-b9cc-857fc79f33b8 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:04.212979 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:04.250812 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1299/2590] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:14:04 2022] POST /identity/v3/projects => generated 385 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:14:04.255760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed0db0-2ccb-45e5-b9cc-857fc79f33b8 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:04.356130 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280e082-cfb4-47ff-b1d6-1ec54ff10302 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:04.362250 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed0db0-2ccb-45e5-b9cc-857fc79f33b8 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:04.369055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5ed5b-ef89-439c-89d4-c4ec370daf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:04.369804 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5ed5b-ef89-439c-89d4-c4ec370daf5d admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:04.370280 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5ed5b-ef89-439c-89d4-c4ec370daf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:04.370702 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5ed5b-ef89-439c-89d4-c4ec370daf5d admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:04.371473 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5ed5b-ef89-439c-89d4-c4ec370daf5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:04.373494 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5ed5b-ef89-439c-89d4-c4ec370daf5d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:04.406193 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1300/2591] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:14:04 2022] POST /identity/v3/users => generated 299 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:14:04.411536 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5ed5b-ef89-439c-89d4-c4ec370daf5d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:04.426129 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5ed5b-ef89-439c-89d4-c4ec370daf5d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:04.433873 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e9d7b-b243-4f2e-bab4-85b91fd9065f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:04.434554 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e9d7b-b243-4f2e-bab4-85b91fd9065f admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:04.434979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e9d7b-b243-4f2e-bab4-85b91fd9065f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:04.435272 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e9d7b-b243-4f2e-bab4-85b91fd9065f admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:04.436236 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e9d7b-b243-4f2e-bab4-85b91fd9065f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:04.439666 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e9d7b-b243-4f2e-bab4-85b91fd9065f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:04.461723 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1301/2592] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:14:04.466776 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e9d7b-b243-4f2e-bab4-85b91fd9065f admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:04.493132 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e9d7b-b243-4f2e-bab4-85b91fd9065f admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:04.497369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bd530-1fb5-4f5d-a840-48d5b5225e17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:04.498161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bd530-1fb5-4f5d-a840-48d5b5225e17 service nova] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:04.498552 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bd530-1fb5-4f5d-a840-48d5b5225e17 service nova] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:04.498954 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bd530-1fb5-4f5d-a840-48d5b5225e17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:04.505248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b5411-d95d-4618-8461-e5a1233806c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:04.508003 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b5411-d95d-4618-8461-e5a1233806c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:04.508803 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b5411-d95d-4618-8461-e5a1233806c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:04.509906 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b5411-d95d-4618-8461-e5a1233806c2 admin admin] PATH_INFO: `/v3/projects/b0492ed6bae8435d836849930e728a0a/users/c226357267b740cdbf151937bf51d707/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:04.510354 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8bd530-1fb5-4f5d-a840-48d5b5225e17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:04.512168 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8bd530-1fb5-4f5d-a840-48d5b5225e17 service nova] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:04.534864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1292/2593] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:14:04.551104 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b5411-d95d-4618-8461-e5a1233806c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0492ed6bae8435d836849930e728a0a, user_id=c226357267b740cdbf151937bf51d707, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:04.560438 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b5411-d95d-4618-8461-e5a1233806c2 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:04.588299 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1302/2594] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:14:04 2022] PUT /identity/v3/projects/b0492ed6bae8435d836849930e728a0a/users/c226357267b740cdbf151937bf51d707/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:14:04.593441 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bd530-1fb5-4f5d-a840-48d5b5225e17 service nova] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:04.611100 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bd530-1fb5-4f5d-a840-48d5b5225e17 service nova] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:04.744998 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89dd0cd-746f-43f5-b730-d2b0eda77d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:04.745759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89dd0cd-746f-43f5-b730-d2b0eda77d8f admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:04.746780 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89dd0cd-746f-43f5-b730-d2b0eda77d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:04.747100 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89dd0cd-746f-43f5-b730-d2b0eda77d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:04.747839 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89dd0cd-746f-43f5-b730-d2b0eda77d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:04.749498 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89dd0cd-746f-43f5-b730-d2b0eda77d8f admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:04.761959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1293/2595] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:14:04.767071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b5411-d95d-4618-8461-e5a1233806c2 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:04.783921 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b5411-d95d-4618-8461-e5a1233806c2 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:04.791736 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2104bf6-0fd1-446a-b160-58e02fa4d454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:04.792946 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2104bf6-0fd1-446a-b160-58e02fa4d454 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:04.793447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2104bf6-0fd1-446a-b160-58e02fa4d454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:04.793949 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2104bf6-0fd1-446a-b160-58e02fa4d454 admin admin] PATH_INFO: `/v3/projects/b0492ed6bae8435d836849930e728a0a/users/c226357267b740cdbf151937bf51d707/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:04.799063 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2104bf6-0fd1-446a-b160-58e02fa4d454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0492ed6bae8435d836849930e728a0a, user_id=c226357267b740cdbf151937bf51d707, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:04.805590 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2104bf6-0fd1-446a-b160-58e02fa4d454 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:04.826850 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1303/2596] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:14:04 2022] PUT /identity/v3/projects/b0492ed6bae8435d836849930e728a0a/users/c226357267b740cdbf151937bf51d707/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:04.839253 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325fa31-2834-45d5-8969-33c4f35d4ac0 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:04.839603 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325fa31-2834-45d5-8969-33c4f35d4ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:04.839805 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325fa31-2834-45d5-8969-33c4f35d4ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:04.875118 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-d325fa31-2834-45d5-8969-33c4f35d4ac0 None None] MFA Rules not processed for user `c226357267b740cdbf151937bf51d707`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:04.876542 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-d325fa31-2834-45d5-8969-33c4f35d4ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:04.888875 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:05.012920 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1294/2597] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:14:05.028675 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2104bf6-0fd1-446a-b160-58e02fa4d454 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:05.030508 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f2104bf6-0fd1-446a-b160-58e02fa4d454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:05.065532 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:05.143706 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2104bf6-0fd1-446a-b160-58e02fa4d454 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:05.147803 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2939b-02c1-4369-b634-14df1ba5f73b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:05.148979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2939b-02c1-4369-b634-14df1ba5f73b service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:05.149288 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2939b-02c1-4369-b634-14df1ba5f73b service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:05.149573 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2939b-02c1-4369-b634-14df1ba5f73b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:05.243065 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2939b-02c1-4369-b634-14df1ba5f73b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:05.245416 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2939b-02c1-4369-b634-14df1ba5f73b service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:05.257891 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1304/2598] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:14:08.467784 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14debd74-7511-4576-8e5e-28e634181f1a None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:08.469674 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14debd74-7511-4576-8e5e-28e634181f1a None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:08.470672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14debd74-7511-4576-8e5e-28e634181f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:08.507520 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-14debd74-7511-4576-8e5e-28e634181f1a None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:08.509679 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-14debd74-7511-4576-8e5e-28e634181f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:08.603672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1295/2599] 10.222.0.69 () {58 vars in 1016 bytes} [Wed Jul 27 09:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:08.624947 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2939b-02c1-4369-b634-14df1ba5f73b service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:08.627009 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-3cb2939b-02c1-4369-b634-14df1ba5f73b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:08.748604 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2939b-02c1-4369-b634-14df1ba5f73b service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:08.757185 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa13be-e668-402a-b594-3ab88f4b8872 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:08.757843 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa13be-e668-402a-b594-3ab88f4b8872 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:08.758134 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa13be-e668-402a-b594-3ab88f4b8872 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:08.758463 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa13be-e668-402a-b594-3ab88f4b8872 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:08.768471 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa13be-e668-402a-b594-3ab88f4b8872 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:08.770105 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa13be-e668-402a-b594-3ab88f4b8872 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:08.782372 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1305/2600] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:14:09.627179 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14debd74-7511-4576-8e5e-28e634181f1a None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:09.629409 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-14debd74-7511-4576-8e5e-28e634181f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:09.720495 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14debd74-7511-4576-8e5e-28e634181f1a None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:09.724801 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2dadc7-8e92-420b-948f-310481b11144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:09.725377 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dadc7-8e92-420b-948f-310481b11144 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:09.725645 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dadc7-8e92-420b-948f-310481b11144 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:09.725923 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dadc7-8e92-420b-948f-310481b11144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:09.728110 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-2e2dadc7-8e92-420b-948f-310481b11144 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:09.741866 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2dadc7-8e92-420b-948f-310481b11144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:09.743370 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2dadc7-8e92-420b-948f-310481b11144 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:09.754804 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1296/2601] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:14:10.204873 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa13be-e668-402a-b594-3ab88f4b8872 service nova] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:10.206483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-96fa13be-e668-402a-b594-3ab88f4b8872 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:10.220973 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa13be-e668-402a-b594-3ab88f4b8872 service nova] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:10.225609 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33988e0-83d1-4683-978c-01580bb67e42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:10.226273 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33988e0-83d1-4683-978c-01580bb67e42 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:10.226597 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33988e0-83d1-4683-978c-01580bb67e42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:10.226872 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33988e0-83d1-4683-978c-01580bb67e42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:10.239021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33988e0-83d1-4683-978c-01580bb67e42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:10.240763 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33988e0-83d1-4683-978c-01580bb67e42 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:10.252704 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1306/2602] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:14:11.764226 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae3bee-571b-4b2d-81db-a2bb0513e206 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:11.765072 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae3bee-571b-4b2d-81db-a2bb0513e206 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:11.765351 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae3bee-571b-4b2d-81db-a2bb0513e206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:11.824160 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-d5ae3bee-571b-4b2d-81db-a2bb0513e206 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:11.825701 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-d5ae3bee-571b-4b2d-81db-a2bb0513e206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:11.840051 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1297/2603] 10.222.0.69 () {58 vars in 1016 bytes} [Wed Jul 27 09:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:11.856466 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33988e0-83d1-4683-978c-01580bb67e42 service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:11.883891 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33988e0-83d1-4683-978c-01580bb67e42 service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:11.891771 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07878c-221a-4348-bf39-ef18a933f5a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:11.892688 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07878c-221a-4348-bf39-ef18a933f5a7 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:11.893131 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07878c-221a-4348-bf39-ef18a933f5a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:11.893595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07878c-221a-4348-bf39-ef18a933f5a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:11.904935 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07878c-221a-4348-bf39-ef18a933f5a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:11.908081 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07878c-221a-4348-bf39-ef18a933f5a7 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:11.922183 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1307/2604] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:14:14.061490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae3bee-571b-4b2d-81db-a2bb0513e206 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:14.062864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-d5ae3bee-571b-4b2d-81db-a2bb0513e206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:14.083777 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae3bee-571b-4b2d-81db-a2bb0513e206 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:14.092713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d78976-c075-4a2d-8bf9-abce1a4d5a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:14.093873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d78976-c075-4a2d-8bf9-abce1a4d5a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:14.094244 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d78976-c075-4a2d-8bf9-abce1a4d5a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:14.094756 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d78976-c075-4a2d-8bf9-abce1a4d5a0c admin admin] PATH_INFO: `/v3/users/ae3fe5b4d9344c3bb7ae21b030377313` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:14.097318 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d78976-c075-4a2d-8bf9-abce1a4d5a0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae3fe5b4d9344c3bb7ae21b030377313)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:14.104176 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d78976-c075-4a2d-8bf9-abce1a4d5a0c admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:14.175426 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:14.185026 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-26d78976-c075-4a2d-8bf9-abce1a4d5a0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae3fe5b4d9344c3bb7ae21b030377313'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:14.185863 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-26d78976-c075-4a2d-8bf9-abce1a4d5a0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae3fe5b4d9344c3bb7ae21b030377313'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:14.186517 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-26d78976-c075-4a2d-8bf9-abce1a4d5a0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae3fe5b4d9344c3bb7ae21b030377313'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:14.197333 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-26d78976-c075-4a2d-8bf9-abce1a4d5a0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae3fe5b4d9344c3bb7ae21b030377313'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:14.213645 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-26d78976-c075-4a2d-8bf9-abce1a4d5a0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae3fe5b4d9344c3bb7ae21b030377313'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:14.228307 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1298/2605] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:14:14 2022] DELETE /identity/v3/users/ae3fe5b4d9344c3bb7ae21b030377313 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:14.470206 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07878c-221a-4348-bf39-ef18a933f5a7 service nova] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:14.481825 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07878c-221a-4348-bf39-ef18a933f5a7 service nova] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:14.524553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:14.557899 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccec74-0d68-4d22-b97d-0c436b0907a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:14.558534 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccec74-0d68-4d22-b97d-0c436b0907a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:14.558822 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccec74-0d68-4d22-b97d-0c436b0907a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:14.559102 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccec74-0d68-4d22-b97d-0c436b0907a5 admin admin] PATH_INFO: `/v3/projects/4b722d8bdc984cec993b6eea60da7ac1` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:14.560378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ccec74-0d68-4d22-b97d-0c436b0907a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b722d8bdc984cec993b6eea60da7ac1)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:14.562376 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ccec74-0d68-4d22-b97d-0c436b0907a5 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:14.634002 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-18ccec74-0d68-4d22-b97d-0c436b0907a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b722d8bdc984cec993b6eea60da7ac1', 'request_id': 'req-18ccec74-0d68-4d22-b97d-0c436b0907a5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:14.645828 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-18ccec74-0d68-4d22-b97d-0c436b0907a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b722d8bdc984cec993b6eea60da7ac1', 'request_id': 'req-18ccec74-0d68-4d22-b97d-0c436b0907a5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:14.655505 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-18ccec74-0d68-4d22-b97d-0c436b0907a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b722d8bdc984cec993b6eea60da7ac1', 'request_id': 'req-18ccec74-0d68-4d22-b97d-0c436b0907a5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:14.672732 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-18ccec74-0d68-4d22-b97d-0c436b0907a5 admin admin] The token cache is being invalidate because project 4b722d8bdc984cec993b6eea60da7ac1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:14:14.673017 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-18ccec74-0d68-4d22-b97d-0c436b0907a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:14.673815 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-18ccec74-0d68-4d22-b97d-0c436b0907a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:14.675419 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1308/2606] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:14:14 2022] DELETE /identity/v3/projects/4b722d8bdc984cec993b6eea60da7ac1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:14.683465 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3d63a-b858-4f88-a33d-6ca8c711fd25 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:14.683758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3d63a-b858-4f88-a33d-6ca8c711fd25 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:14.684037 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3d63a-b858-4f88-a33d-6ca8c711fd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:14.718562 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-b8f3d63a-b858-4f88-a33d-6ca8c711fd25 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:14.721386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-b8f3d63a-b858-4f88-a33d-6ca8c711fd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:14.808399 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1299/2607] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:14.820057 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a83909-1f71-4574-b467-9a26e22c00d5 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:14.820846 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a83909-1f71-4574-b467-9a26e22c00d5 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:14.821541 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a83909-1f71-4574-b467-9a26e22c00d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:14.855570 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-32a83909-1f71-4574-b467-9a26e22c00d5 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:14.857553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-32a83909-1f71-4574-b467-9a26e22c00d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:14.872907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1309/2608] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:14:14.877342 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3d63a-b858-4f88-a33d-6ca8c711fd25 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:14.894388 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3d63a-b858-4f88-a33d-6ca8c711fd25 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:14.900563 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b3943-5140-47b8-a102-0b149f6f6905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:14.901361 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b3943-5140-47b8-a102-0b149f6f6905 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:14.901491 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b3943-5140-47b8-a102-0b149f6f6905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:14.901811 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b3943-5140-47b8-a102-0b149f6f6905 admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:14.902789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b3943-5140-47b8-a102-0b149f6f6905 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:14:14.903177 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b3943-5140-47b8-a102-0b149f6f6905 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:14.904761 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b3943-5140-47b8-a102-0b149f6f6905 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:14.923140 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1300/2609] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 09:14:14.928582 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a83909-1f71-4574-b467-9a26e22c00d5 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:14.938922 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a83909-1f71-4574-b467-9a26e22c00d5 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:14.944342 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7debf49e-9680-401d-a95f-ebddb628b620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:14.944979 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debf49e-9680-401d-a95f-ebddb628b620 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:14.945256 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debf49e-9680-401d-a95f-ebddb628b620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:14.945528 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debf49e-9680-401d-a95f-ebddb628b620 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:14.946223 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7debf49e-9680-401d-a95f-ebddb628b620 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:14.948197 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7debf49e-9680-401d-a95f-ebddb628b620 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:14.980447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1310/2610] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:14:14 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:14:14.985759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b3943-5140-47b8-a102-0b149f6f6905 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:15.005724 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b3943-5140-47b8-a102-0b149f6f6905 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:15.090885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b49736-1f63-43d3-ad88-14766293de84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:15.091832 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b49736-1f63-43d3-ad88-14766293de84 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:15.092366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b49736-1f63-43d3-ad88-14766293de84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:15.092836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b49736-1f63-43d3-ad88-14766293de84 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:15.094106 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b49736-1f63-43d3-ad88-14766293de84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:15.098402 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b49736-1f63-43d3-ad88-14766293de84 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:15.136421 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1301/2611] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:14:14 2022] POST /identity/v3/users => generated 283 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:14:15.141532 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7debf49e-9680-401d-a95f-ebddb628b620 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:15.155542 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7debf49e-9680-401d-a95f-ebddb628b620 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:15.162364 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccad925-2658-4287-9d55-133fed32587e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:15.163186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccad925-2658-4287-9d55-133fed32587e admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:15.163574 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccad925-2658-4287-9d55-133fed32587e admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:15.163930 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccad925-2658-4287-9d55-133fed32587e admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:15.164854 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccad925-2658-4287-9d55-133fed32587e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:15.166935 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccad925-2658-4287-9d55-133fed32587e admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:15.184263 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1311/2612] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:14:15.189385 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b49736-1f63-43d3-ad88-14766293de84 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:15.201285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b49736-1f63-43d3-ad88-14766293de84 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:15.206201 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec29e85-1cb1-47e7-a3b5-3d46660537ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:15.207085 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec29e85-1cb1-47e7-a3b5-3d46660537ab admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:15.207085 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec29e85-1cb1-47e7-a3b5-3d46660537ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:15.207085 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec29e85-1cb1-47e7-a3b5-3d46660537ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:15.208121 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec29e85-1cb1-47e7-a3b5-3d46660537ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:15.209867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec29e85-1cb1-47e7-a3b5-3d46660537ab admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:15.222076 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1302/2613] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:14:15.227472 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccad925-2658-4287-9d55-133fed32587e admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:15.238828 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccad925-2658-4287-9d55-133fed32587e admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:15.244409 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c115a-38c6-45c0-ab22-ddf7d842da0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:15.245424 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c115a-38c6-45c0-ab22-ddf7d842da0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:15.245708 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c115a-38c6-45c0-ab22-ddf7d842da0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:15.245991 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c115a-38c6-45c0-ab22-ddf7d842da0e admin admin] PATH_INFO: `/v3/projects/437de69be8644b9293418286adf09737/users/c21bb4627dc749268193f04ce9fdef73/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:15.263324 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c115a-38c6-45c0-ab22-ddf7d842da0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=437de69be8644b9293418286adf09737, user_id=c21bb4627dc749268193f04ce9fdef73, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:15.266187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c115a-38c6-45c0-ab22-ddf7d842da0e admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:15.281057 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1312/2614] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:14:15 2022] PUT /identity/v3/projects/437de69be8644b9293418286adf09737/users/c21bb4627dc749268193f04ce9fdef73/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:14:15.293112 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77849022-4ce5-4184-a542-899e8c07d13b None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:15.293441 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77849022-4ce5-4184-a542-899e8c07d13b None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:15.293758 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77849022-4ce5-4184-a542-899e8c07d13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:15.326531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-77849022-4ce5-4184-a542-899e8c07d13b None None] MFA Rules not processed for user `c21bb4627dc749268193f04ce9fdef73`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:15.327857 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-77849022-4ce5-4184-a542-899e8c07d13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:15.339283 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:15.420183 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1303/2615] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:15 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:15.432817 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c115a-38c6-45c0-ab22-ddf7d842da0e admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:15.434883 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-371c115a-38c6-45c0-ab22-ddf7d842da0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:15.512427 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c115a-38c6-45c0-ab22-ddf7d842da0e admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:15.516465 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698af8b-b24c-45c2-a54c-6e27c53a6b5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:15.517111 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698af8b-b24c-45c2-a54c-6e27c53a6b5a service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:15.517389 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698af8b-b24c-45c2-a54c-6e27c53a6b5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:15.517662 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698af8b-b24c-45c2-a54c-6e27c53a6b5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:15.529209 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698af8b-b24c-45c2-a54c-6e27c53a6b5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:15.530871 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698af8b-b24c-45c2-a54c-6e27c53a6b5a service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:15.537161 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:15.546019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1313/2616] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:15 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:14:15.794570 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77849022-4ce5-4184-a542-899e8c07d13b None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:15.796704 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-77849022-4ce5-4184-a542-899e8c07d13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:15.913509 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77849022-4ce5-4184-a542-899e8c07d13b None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:15.919685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4accfe43-e619-4794-8a06-78dfeed444f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:15.920416 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4accfe43-e619-4794-8a06-78dfeed444f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:15.920701 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4accfe43-e619-4794-8a06-78dfeed444f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:15.921087 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4accfe43-e619-4794-8a06-78dfeed444f6 admin admin] PATH_INFO: `/v3/users/189b7d79d0d44b3780f28ca2edf87028` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:15.922306 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4accfe43-e619-4794-8a06-78dfeed444f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=189b7d79d0d44b3780f28ca2edf87028)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:15.924529 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4accfe43-e619-4794-8a06-78dfeed444f6 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:16.011935 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-4accfe43-e619-4794-8a06-78dfeed444f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '189b7d79d0d44b3780f28ca2edf87028'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:16.013004 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-4accfe43-e619-4794-8a06-78dfeed444f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '189b7d79d0d44b3780f28ca2edf87028'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:16.014020 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-4accfe43-e619-4794-8a06-78dfeed444f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '189b7d79d0d44b3780f28ca2edf87028'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:16.031366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-4accfe43-e619-4794-8a06-78dfeed444f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '189b7d79d0d44b3780f28ca2edf87028'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:16.062168 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-4accfe43-e619-4794-8a06-78dfeed444f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '189b7d79d0d44b3780f28ca2edf87028'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:16.098139 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1304/2617] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:14:15 2022] DELETE /identity/v3/users/189b7d79d0d44b3780f28ca2edf87028 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:16.101957 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da95e7-513f-47ac-9edb-3be51b7fcdd0 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:16.102643 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da95e7-513f-47ac-9edb-3be51b7fcdd0 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:16.108796 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da95e7-513f-47ac-9edb-3be51b7fcdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:16.149512 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-16da95e7-513f-47ac-9edb-3be51b7fcdd0 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:16.152942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-16da95e7-513f-47ac-9edb-3be51b7fcdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:16.263463 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1314/2618] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:16.281090 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4accfe43-e619-4794-8a06-78dfeed444f6 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:16.285356 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-4accfe43-e619-4794-8a06-78dfeed444f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:16.339969 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:16.385319 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4accfe43-e619-4794-8a06-78dfeed444f6 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:16.391311 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b33965-a7a1-4538-ba95-8f836001c895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:16.392385 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b33965-a7a1-4538-ba95-8f836001c895 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:16.392893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b33965-a7a1-4538-ba95-8f836001c895 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:16.393357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b33965-a7a1-4538-ba95-8f836001c895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:16.406748 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b33965-a7a1-4538-ba95-8f836001c895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:16.408269 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b33965-a7a1-4538-ba95-8f836001c895 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:16.420300 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1305/2619] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:14:16.824217 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da95e7-513f-47ac-9edb-3be51b7fcdd0 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:16.826716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-16da95e7-513f-47ac-9edb-3be51b7fcdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:16.851450 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da95e7-513f-47ac-9edb-3be51b7fcdd0 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:16.863573 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70195afa-2e24-4c0d-b5b1-a6293e525529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:16.865076 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70195afa-2e24-4c0d-b5b1-a6293e525529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:16.865611 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70195afa-2e24-4c0d-b5b1-a6293e525529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:16.866151 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70195afa-2e24-4c0d-b5b1-a6293e525529 admin admin] PATH_INFO: `/v3/projects/3159243450134be18d69912fbc4cbcf7` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:16.868866 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70195afa-2e24-4c0d-b5b1-a6293e525529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3159243450134be18d69912fbc4cbcf7)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:16.871424 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70195afa-2e24-4c0d-b5b1-a6293e525529 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:16.934894 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-70195afa-2e24-4c0d-b5b1-a6293e525529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3159243450134be18d69912fbc4cbcf7', 'request_id': 'req-70195afa-2e24-4c0d-b5b1-a6293e525529'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:16.943859 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-70195afa-2e24-4c0d-b5b1-a6293e525529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3159243450134be18d69912fbc4cbcf7', 'request_id': 'req-70195afa-2e24-4c0d-b5b1-a6293e525529'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:16.951511 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-70195afa-2e24-4c0d-b5b1-a6293e525529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3159243450134be18d69912fbc4cbcf7', 'request_id': 'req-70195afa-2e24-4c0d-b5b1-a6293e525529'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:16.973220 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-70195afa-2e24-4c0d-b5b1-a6293e525529 admin admin] The token cache is being invalidate because project 3159243450134be18d69912fbc4cbcf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:14:16.973845 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-70195afa-2e24-4c0d-b5b1-a6293e525529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:16.976865 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-70195afa-2e24-4c0d-b5b1-a6293e525529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:16.979385 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1315/2620] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:14:16 2022] DELETE /identity/v3/projects/3159243450134be18d69912fbc4cbcf7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:14:16.984026 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b33965-a7a1-4538-ba95-8f836001c895 service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:16.995886 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b33965-a7a1-4538-ba95-8f836001c895 service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:17.106484 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca6ccf-c423-474a-a7a2-e9ceff34c9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:17.107655 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca6ccf-c423-474a-a7a2-e9ceff34c9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:17.107655 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca6ccf-c423-474a-a7a2-e9ceff34c9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:17.108225 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca6ccf-c423-474a-a7a2-e9ceff34c9ce admin admin] PATH_INFO: `/v3/users/c226357267b740cdbf151937bf51d707` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:17.109661 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca6ccf-c423-474a-a7a2-e9ceff34c9ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=c226357267b740cdbf151937bf51d707)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:17.112081 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca6ccf-c423-474a-a7a2-e9ceff34c9ce admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:17.193168 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-64ca6ccf-c423-474a-a7a2-e9ceff34c9ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c226357267b740cdbf151937bf51d707'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:17.194082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-64ca6ccf-c423-474a-a7a2-e9ceff34c9ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c226357267b740cdbf151937bf51d707'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:17.195014 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-64ca6ccf-c423-474a-a7a2-e9ceff34c9ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c226357267b740cdbf151937bf51d707'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:17.206311 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-64ca6ccf-c423-474a-a7a2-e9ceff34c9ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c226357267b740cdbf151937bf51d707'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:17.226289 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-64ca6ccf-c423-474a-a7a2-e9ceff34c9ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c226357267b740cdbf151937bf51d707'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:17.245714 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1306/2621] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:14:16 2022] DELETE /identity/v3/users/c226357267b740cdbf151937bf51d707 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:14:17.736924 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70195afa-2e24-4c0d-b5b1-a6293e525529 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:17.743860 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-70195afa-2e24-4c0d-b5b1-a6293e525529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:17.770035 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70195afa-2e24-4c0d-b5b1-a6293e525529 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:17.905184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c65ddf-f343-461d-a0f4-c36c188e129a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:17.906035 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c65ddf-f343-461d-a0f4-c36c188e129a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:17.906174 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c65ddf-f343-461d-a0f4-c36c188e129a admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:17.906423 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c65ddf-f343-461d-a0f4-c36c188e129a admin admin] PATH_INFO: `/v3/projects/b0492ed6bae8435d836849930e728a0a` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:17.907723 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c65ddf-f343-461d-a0f4-c36c188e129a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0492ed6bae8435d836849930e728a0a)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:17.909782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c65ddf-f343-461d-a0f4-c36c188e129a admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:17.945925 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:17.969483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-63c65ddf-f343-461d-a0f4-c36c188e129a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0492ed6bae8435d836849930e728a0a', 'request_id': 'req-63c65ddf-f343-461d-a0f4-c36c188e129a'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:17.977105 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-63c65ddf-f343-461d-a0f4-c36c188e129a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0492ed6bae8435d836849930e728a0a', 'request_id': 'req-63c65ddf-f343-461d-a0f4-c36c188e129a'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:17.983218 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-63c65ddf-f343-461d-a0f4-c36c188e129a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0492ed6bae8435d836849930e728a0a', 'request_id': 'req-63c65ddf-f343-461d-a0f4-c36c188e129a'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:17.999480 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-63c65ddf-f343-461d-a0f4-c36c188e129a admin admin] The token cache is being invalidate because project b0492ed6bae8435d836849930e728a0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:14:17.999935 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-63c65ddf-f343-461d-a0f4-c36c188e129a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:18.000744 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-63c65ddf-f343-461d-a0f4-c36c188e129a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:18.002654 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1316/2622] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:14:17 2022] DELETE /identity/v3/projects/b0492ed6bae8435d836849930e728a0a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:18.011198 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d5caf-aa83-4db6-b33a-4ce9a6e90f89 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:18.011705 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d5caf-aa83-4db6-b33a-4ce9a6e90f89 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:18.012393 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d5caf-aa83-4db6-b33a-4ce9a6e90f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:18.056352 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-200d5caf-aa83-4db6-b33a-4ce9a6e90f89 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:18.058279 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-200d5caf-aa83-4db6-b33a-4ce9a6e90f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:18.155963 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:18.176763 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1307/2623] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:18.186760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c86fb-320b-475d-bda4-f19be3e65e59 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:18.187099 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c86fb-320b-475d-bda4-f19be3e65e59 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:18.187454 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c86fb-320b-475d-bda4-f19be3e65e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:18.214562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-cb7c86fb-320b-475d-bda4-f19be3e65e59 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:18.216174 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-cb7c86fb-320b-475d-bda4-f19be3e65e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:18.227545 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1317/2624] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:14:18.232762 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d5caf-aa83-4db6-b33a-4ce9a6e90f89 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:18.244664 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d5caf-aa83-4db6-b33a-4ce9a6e90f89 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:18.249843 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f711c3e-6d0d-4362-acf6-1b5896bab26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:18.250521 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f711c3e-6d0d-4362-acf6-1b5896bab26f admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:18.250803 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f711c3e-6d0d-4362-acf6-1b5896bab26f admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:18.251075 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f711c3e-6d0d-4362-acf6-1b5896bab26f admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:18.251792 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f711c3e-6d0d-4362-acf6-1b5896bab26f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:14:18.252096 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f711c3e-6d0d-4362-acf6-1b5896bab26f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:18.254582 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f711c3e-6d0d-4362-acf6-1b5896bab26f admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:18.267817 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1308/2625] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:14:18.273653 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c86fb-320b-475d-bda4-f19be3e65e59 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:18.290632 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c86fb-320b-475d-bda4-f19be3e65e59 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:18.298517 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca154fda-ed6c-481c-9e34-4f7564b32ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:18.300497 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca154fda-ed6c-481c-9e34-4f7564b32ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:18.300983 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca154fda-ed6c-481c-9e34-4f7564b32ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:18.301464 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca154fda-ed6c-481c-9e34-4f7564b32ca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:18.302693 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca154fda-ed6c-481c-9e34-4f7564b32ca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:18.306432 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca154fda-ed6c-481c-9e34-4f7564b32ca5 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:18.350937 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1318/2626] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:14:18 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:14:18.356924 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f711c3e-6d0d-4362-acf6-1b5896bab26f admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:18.368609 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f711c3e-6d0d-4362-acf6-1b5896bab26f admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:18.577307 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084f647-52a4-405f-89cd-09e2aa56912e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:18.578531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084f647-52a4-405f-89cd-09e2aa56912e admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:18.579290 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084f647-52a4-405f-89cd-09e2aa56912e admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:18.579763 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084f647-52a4-405f-89cd-09e2aa56912e admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:18.582812 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084f647-52a4-405f-89cd-09e2aa56912e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:18.587174 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084f647-52a4-405f-89cd-09e2aa56912e admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:18.625804 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1309/2627] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:14:18 2022] POST /identity/v3/users => generated 288 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:14:18.630736 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca154fda-ed6c-481c-9e34-4f7564b32ca5 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:18.642702 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca154fda-ed6c-481c-9e34-4f7564b32ca5 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:18.649060 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22629ddd-3bdf-43a2-b2d9-0a65d91335be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:18.649833 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22629ddd-3bdf-43a2-b2d9-0a65d91335be admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:18.650205 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22629ddd-3bdf-43a2-b2d9-0a65d91335be admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:18.650615 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22629ddd-3bdf-43a2-b2d9-0a65d91335be admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:18.651462 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22629ddd-3bdf-43a2-b2d9-0a65d91335be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:18.653230 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22629ddd-3bdf-43a2-b2d9-0a65d91335be admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:18.665465 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1319/2628] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:14:18.669936 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084f647-52a4-405f-89cd-09e2aa56912e admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:18.682484 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084f647-52a4-405f-89cd-09e2aa56912e admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:18.687903 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fbbf0-7d12-43ea-a6a9-10a329c864b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:18.688587 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fbbf0-7d12-43ea-a6a9-10a329c864b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:18.688902 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fbbf0-7d12-43ea-a6a9-10a329c864b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:18.689198 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fbbf0-7d12-43ea-a6a9-10a329c864b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:18.690029 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832fbbf0-7d12-43ea-a6a9-10a329c864b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:18.692290 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832fbbf0-7d12-43ea-a6a9-10a329c864b1 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:18.704284 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1310/2629] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:14:18.709523 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22629ddd-3bdf-43a2-b2d9-0a65d91335be admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:18.720873 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22629ddd-3bdf-43a2-b2d9-0a65d91335be admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:18.726136 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91862be2-d1f0-4501-b45b-a3daddf98382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:18.726888 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91862be2-d1f0-4501-b45b-a3daddf98382 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:18.727159 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91862be2-d1f0-4501-b45b-a3daddf98382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:18.727441 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91862be2-d1f0-4501-b45b-a3daddf98382 admin admin] PATH_INFO: `/v3/projects/53b5e41f555c44d4b600cb2e23480da7/users/b4621b93b8b14749a51463d11f473633/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:18.745862 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91862be2-d1f0-4501-b45b-a3daddf98382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b5e41f555c44d4b600cb2e23480da7, user_id=b4621b93b8b14749a51463d11f473633, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:18.748689 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91862be2-d1f0-4501-b45b-a3daddf98382 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:18.768475 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1320/2630] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:14:18 2022] PUT /identity/v3/projects/53b5e41f555c44d4b600cb2e23480da7/users/b4621b93b8b14749a51463d11f473633/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:18.781880 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9aa701-6abe-4e08-95ca-ba1a9e97906f None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:18.782403 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9aa701-6abe-4e08-95ca-ba1a9e97906f None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:18.782864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9aa701-6abe-4e08-95ca-ba1a9e97906f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:18.830450 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-ea9aa701-6abe-4e08-95ca-ba1a9e97906f None None] MFA Rules not processed for user `b4621b93b8b14749a51463d11f473633`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:18.831996 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-ea9aa701-6abe-4e08-95ca-ba1a9e97906f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:18.927811 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1311/2631] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:14:18.947290 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91862be2-d1f0-4501-b45b-a3daddf98382 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:18.950557 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-91862be2-d1f0-4501-b45b-a3daddf98382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:19.085342 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91862be2-d1f0-4501-b45b-a3daddf98382 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:19.091759 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ab013-49f2-403c-8ac5-78d752cc4243 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:19.092823 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ab013-49f2-403c-8ac5-78d752cc4243 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:19.093299 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ab013-49f2-403c-8ac5-78d752cc4243 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:19.094755 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ab013-49f2-403c-8ac5-78d752cc4243 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:19.111209 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ab013-49f2-403c-8ac5-78d752cc4243 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:19.121661 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ab013-49f2-403c-8ac5-78d752cc4243 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:19.138422 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1321/2632] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:14:25.300799 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9aa701-6abe-4e08-95ca-ba1a9e97906f None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:25.303654 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-ea9aa701-6abe-4e08-95ca-ba1a9e97906f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:25.410621 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:25.434668 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9aa701-6abe-4e08-95ca-ba1a9e97906f None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:25.441554 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5b7e2-60f2-48c0-a0eb-7d786f0bca33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:25.442586 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5b7e2-60f2-48c0-a0eb-7d786f0bca33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:25.443058 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5b7e2-60f2-48c0-a0eb-7d786f0bca33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:25.443524 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5b7e2-60f2-48c0-a0eb-7d786f0bca33 admin admin] PATH_INFO: `/v3/users/c21bb4627dc749268193f04ce9fdef73` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:25.445723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5b7e2-60f2-48c0-a0eb-7d786f0bca33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c21bb4627dc749268193f04ce9fdef73)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:25.448491 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5b7e2-60f2-48c0-a0eb-7d786f0bca33 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:25.564187 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-6ff5b7e2-60f2-48c0-a0eb-7d786f0bca33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c21bb4627dc749268193f04ce9fdef73'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:25.565092 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-6ff5b7e2-60f2-48c0-a0eb-7d786f0bca33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c21bb4627dc749268193f04ce9fdef73'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:25.565887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-6ff5b7e2-60f2-48c0-a0eb-7d786f0bca33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c21bb4627dc749268193f04ce9fdef73'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:25.581957 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-6ff5b7e2-60f2-48c0-a0eb-7d786f0bca33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c21bb4627dc749268193f04ce9fdef73'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:25.600104 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-6ff5b7e2-60f2-48c0-a0eb-7d786f0bca33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c21bb4627dc749268193f04ce9fdef73'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:25.638877 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1312/2633] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:14:25 2022] DELETE /identity/v3/users/c21bb4627dc749268193f04ce9fdef73 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:25.649555 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8670c91-6431-40c1-b786-3a8796bd8619 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:25.650115 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8670c91-6431-40c1-b786-3a8796bd8619 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:25.650679 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8670c91-6431-40c1-b786-3a8796bd8619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:25.690467 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-d8670c91-6431-40c1-b786-3a8796bd8619 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:25.695564 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d8670c91-6431-40c1-b786-3a8796bd8619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:25.784745 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:25.821367 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1322/2634] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:25.828357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5b7e2-60f2-48c0-a0eb-7d786f0bca33 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:25.832815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-6ff5b7e2-60f2-48c0-a0eb-7d786f0bca33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:25.968469 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5b7e2-60f2-48c0-a0eb-7d786f0bca33 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:25.973836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b9232-2709-4bde-82e4-abecdbae4faa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:25.974788 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b9232-2709-4bde-82e4-abecdbae4faa service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:25.975273 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b9232-2709-4bde-82e4-abecdbae4faa service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:25.975746 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b9232-2709-4bde-82e4-abecdbae4faa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:25.988364 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b9232-2709-4bde-82e4-abecdbae4faa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:25.990144 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b9232-2709-4bde-82e4-abecdbae4faa service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:26.002678 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1313/2635] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:14:26.582018 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8670c91-6431-40c1-b786-3a8796bd8619 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:26.607888 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d8670c91-6431-40c1-b786-3a8796bd8619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:26.635077 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8670c91-6431-40c1-b786-3a8796bd8619 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:26.647211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52987d57-eb87-45d0-a11f-dd1efe80f2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:26.648340 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52987d57-eb87-45d0-a11f-dd1efe80f2d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:26.648804 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52987d57-eb87-45d0-a11f-dd1efe80f2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:26.649844 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52987d57-eb87-45d0-a11f-dd1efe80f2d8 admin admin] PATH_INFO: `/v3/projects/437de69be8644b9293418286adf09737` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:26.652403 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52987d57-eb87-45d0-a11f-dd1efe80f2d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=437de69be8644b9293418286adf09737)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:26.656632 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52987d57-eb87-45d0-a11f-dd1efe80f2d8 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:26.759813 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-52987d57-eb87-45d0-a11f-dd1efe80f2d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '437de69be8644b9293418286adf09737', 'request_id': 'req-52987d57-eb87-45d0-a11f-dd1efe80f2d8'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:26.771845 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-52987d57-eb87-45d0-a11f-dd1efe80f2d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '437de69be8644b9293418286adf09737', 'request_id': 'req-52987d57-eb87-45d0-a11f-dd1efe80f2d8'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:26.781907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-52987d57-eb87-45d0-a11f-dd1efe80f2d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '437de69be8644b9293418286adf09737', 'request_id': 'req-52987d57-eb87-45d0-a11f-dd1efe80f2d8'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:26.805843 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-52987d57-eb87-45d0-a11f-dd1efe80f2d8 admin admin] The token cache is being invalidate because project 437de69be8644b9293418286adf09737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:14:26.806597 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-52987d57-eb87-45d0-a11f-dd1efe80f2d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:26.808539 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-52987d57-eb87-45d0-a11f-dd1efe80f2d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:26.811110 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1323/2636] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:14:26 2022] DELETE /identity/v3/projects/437de69be8644b9293418286adf09737 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:26.816944 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16237b-a49d-45c6-b3e8-e5309ec2401a None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:26.817797 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16237b-a49d-45c6-b3e8-e5309ec2401a None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:26.817984 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16237b-a49d-45c6-b3e8-e5309ec2401a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:26.841956 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-4d16237b-a49d-45c6-b3e8-e5309ec2401a None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:26.843820 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-4d16237b-a49d-45c6-b3e8-e5309ec2401a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:26.955954 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1314/2637] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:26.965658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383caa87-fb3f-49fc-b9ba-b5837f160d15 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:26.966399 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383caa87-fb3f-49fc-b9ba-b5837f160d15 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:26.966709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383caa87-fb3f-49fc-b9ba-b5837f160d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:26.997363 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-383caa87-fb3f-49fc-b9ba-b5837f160d15 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:26.998696 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-383caa87-fb3f-49fc-b9ba-b5837f160d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:27.007354 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1324/2638] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:27.011865 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16237b-a49d-45c6-b3e8-e5309ec2401a None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:27.024517 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16237b-a49d-45c6-b3e8-e5309ec2401a None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:27.029293 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59999e3-54ed-4314-8c8c-1768a50a0b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:27.029932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59999e3-54ed-4314-8c8c-1768a50a0b30 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:27.030209 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59999e3-54ed-4314-8c8c-1768a50a0b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:27.030517 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59999e3-54ed-4314-8c8c-1768a50a0b30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:27.031348 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59999e3-54ed-4314-8c8c-1768a50a0b30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:14:27.031622 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59999e3-54ed-4314-8c8c-1768a50a0b30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:27.034018 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59999e3-54ed-4314-8c8c-1768a50a0b30 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:27.042148 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:27.054386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1315/2639] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:14:27.056313 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383caa87-fb3f-49fc-b9ba-b5837f160d15 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:27.067810 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383caa87-fb3f-49fc-b9ba-b5837f160d15 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:27.073677 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b4e29-061e-4914-9ae9-e8abce47aed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:27.074619 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b4e29-061e-4914-9ae9-e8abce47aed6 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:27.075073 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b4e29-061e-4914-9ae9-e8abce47aed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:27.075765 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b4e29-061e-4914-9ae9-e8abce47aed6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:27.076961 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b4e29-061e-4914-9ae9-e8abce47aed6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:27.080147 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b4e29-061e-4914-9ae9-e8abce47aed6 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:27.130690 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1325/2640] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:14:27 2022] POST /identity/v3/projects => generated 377 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:14:27.137679 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59999e3-54ed-4314-8c8c-1768a50a0b30 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:27.149770 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59999e3-54ed-4314-8c8c-1768a50a0b30 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:27.230788 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897c84f-6871-4fc7-a15a-563b595e575e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:27.231765 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897c84f-6871-4fc7-a15a-563b595e575e admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:27.232431 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897c84f-6871-4fc7-a15a-563b595e575e admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:27.232887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897c84f-6871-4fc7-a15a-563b595e575e admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:27.233786 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897c84f-6871-4fc7-a15a-563b595e575e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:27.236549 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897c84f-6871-4fc7-a15a-563b595e575e admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:27.272146 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1316/2641] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:14:27 2022] POST /identity/v3/users => generated 289 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:14:27.275465 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b4e29-061e-4914-9ae9-e8abce47aed6 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:27.298637 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b4e29-061e-4914-9ae9-e8abce47aed6 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:27.308200 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf038b-b4fa-42b2-ae3e-9c951bd4b49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:27.308839 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf038b-b4fa-42b2-ae3e-9c951bd4b49a admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:27.309281 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf038b-b4fa-42b2-ae3e-9c951bd4b49a admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:27.309556 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf038b-b4fa-42b2-ae3e-9c951bd4b49a admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:27.310366 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf038b-b4fa-42b2-ae3e-9c951bd4b49a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:27.312575 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf038b-b4fa-42b2-ae3e-9c951bd4b49a admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:27.326858 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1326/2642] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:14:27.333141 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897c84f-6871-4fc7-a15a-563b595e575e admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:27.350479 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897c84f-6871-4fc7-a15a-563b595e575e admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:27.358370 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0240f4f-c7de-486c-b58b-7e6ea11ec15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:27.359390 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0240f4f-c7de-486c-b58b-7e6ea11ec15f admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:27.360843 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0240f4f-c7de-486c-b58b-7e6ea11ec15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:27.361316 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0240f4f-c7de-486c-b58b-7e6ea11ec15f admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:27.362312 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0240f4f-c7de-486c-b58b-7e6ea11ec15f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:27.365196 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0240f4f-c7de-486c-b58b-7e6ea11ec15f admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:27.386723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1317/2643] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:14:27.392711 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf038b-b4fa-42b2-ae3e-9c951bd4b49a admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:27.405172 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf038b-b4fa-42b2-ae3e-9c951bd4b49a admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:27.412235 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e2ad1-b289-4c97-a1db-0a88a1cbcf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:27.413098 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e2ad1-b289-4c97-a1db-0a88a1cbcf0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:27.413383 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e2ad1-b289-4c97-a1db-0a88a1cbcf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:27.413651 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e2ad1-b289-4c97-a1db-0a88a1cbcf0d admin admin] PATH_INFO: `/v3/projects/789723ba000447ed8d668538ef255f40/users/970a36f7c78a43d29318e91670672166/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:27.432515 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e2ad1-b289-4c97-a1db-0a88a1cbcf0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=789723ba000447ed8d668538ef255f40, user_id=970a36f7c78a43d29318e91670672166, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:27.435372 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e2ad1-b289-4c97-a1db-0a88a1cbcf0d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:27.454704 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1327/2644] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:14:27 2022] PUT /identity/v3/projects/789723ba000447ed8d668538ef255f40/users/970a36f7c78a43d29318e91670672166/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:27.466599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23992e89-70e4-4eb5-83fb-3e122c3aca77 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:27.466893 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23992e89-70e4-4eb5-83fb-3e122c3aca77 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:27.467384 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23992e89-70e4-4eb5-83fb-3e122c3aca77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:27.519351 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-23992e89-70e4-4eb5-83fb-3e122c3aca77 None None] MFA Rules not processed for user `970a36f7c78a43d29318e91670672166`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:27.520806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-23992e89-70e4-4eb5-83fb-3e122c3aca77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:27.610677 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1318/2645] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:14:27.623232 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e2ad1-b289-4c97-a1db-0a88a1cbcf0d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:27.624541 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ad7e2ad1-b289-4c97-a1db-0a88a1cbcf0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:27.691349 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e2ad1-b289-4c97-a1db-0a88a1cbcf0d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:27.695299 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e64c23-6635-4d5f-982a-0ab9d5e0a896 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713805e0f1174a01987014319075ec03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:27.695940 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e64c23-6635-4d5f-982a-0ab9d5e0a896 service glance] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:27.696230 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e64c23-6635-4d5f-982a-0ab9d5e0a896 service glance] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:27.696505 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e64c23-6635-4d5f-982a-0ab9d5e0a896 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:27.706807 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e64c23-6635-4d5f-982a-0ab9d5e0a896 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:27.708313 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e64c23-6635-4d5f-982a-0ab9d5e0a896 service glance] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:27.718417 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1328/2646] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:14:30.748332 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd2c6c-a9fe-4dc3-b353-08a5287ee91c None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:30.748959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd2c6c-a9fe-4dc3-b353-08a5287ee91c None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:30.748959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd2c6c-a9fe-4dc3-b353-08a5287ee91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:30.769897 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-13fd2c6c-a9fe-4dc3-b353-08a5287ee91c None None] MFA Rules not processed for user `df249aada9644365b79f24283d8e3407`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:30.771205 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-13fd2c6c-a9fe-4dc3-b353-08a5287ee91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:30.853135 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1319/2647] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:14:32.477350 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e64c23-6635-4d5f-982a-0ab9d5e0a896 service glance] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:32.480488 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-61e64c23-6635-4d5f-982a-0ab9d5e0a896 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:32.500858 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:32.579260 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e64c23-6635-4d5f-982a-0ab9d5e0a896 service glance] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:32.585191 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd5bc2-3d31-4c05-bf4f-13787c1948c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:32.585846 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd5bc2-3d31-4c05-bf4f-13787c1948c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:32.586130 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd5bc2-3d31-4c05-bf4f-13787c1948c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:32.586441 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd5bc2-3d31-4c05-bf4f-13787c1948c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:32.588487 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d8bd5bc2-3d31-4c05-bf4f-13787c1948c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:32.692041 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd5bc2-3d31-4c05-bf4f-13787c1948c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:32.693770 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd5bc2-3d31-4c05-bf4f-13787c1948c5 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:32.718991 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1329/2648] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:14:34.274864 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd2c6c-a9fe-4dc3-b353-08a5287ee91c None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:34.277682 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-13fd2c6c-a9fe-4dc3-b353-08a5287ee91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:34.297045 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd2c6c-a9fe-4dc3-b353-08a5287ee91c None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:34.302355 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937afc9d-6cc0-4455-8624-f77b119dcad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:34.303215 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937afc9d-6cc0-4455-8624-f77b119dcad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:34.303561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937afc9d-6cc0-4455-8624-f77b119dcad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:34.303900 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937afc9d-6cc0-4455-8624-f77b119dcad9 admin admin] PATH_INFO: `/v3/users/b4621b93b8b14749a51463d11f473633` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:34.305308 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937afc9d-6cc0-4455-8624-f77b119dcad9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4621b93b8b14749a51463d11f473633)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:34.307574 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937afc9d-6cc0-4455-8624-f77b119dcad9 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:34.323395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:34.430583 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-937afc9d-6cc0-4455-8624-f77b119dcad9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4621b93b8b14749a51463d11f473633'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:34.432432 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-937afc9d-6cc0-4455-8624-f77b119dcad9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4621b93b8b14749a51463d11f473633'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:34.433877 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-937afc9d-6cc0-4455-8624-f77b119dcad9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4621b93b8b14749a51463d11f473633'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:34.452496 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-937afc9d-6cc0-4455-8624-f77b119dcad9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4621b93b8b14749a51463d11f473633'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:34.479505 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-937afc9d-6cc0-4455-8624-f77b119dcad9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4621b93b8b14749a51463d11f473633'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:34.507540 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1320/2649] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:14:34 2022] DELETE /identity/v3/users/b4621b93b8b14749a51463d11f473633 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:14:34.513502 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd6f89-c34c-4f25-bb11-3069134927a3 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:34.514969 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd6f89-c34c-4f25-bb11-3069134927a3 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:34.514969 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd6f89-c34c-4f25-bb11-3069134927a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:34.557565 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-75cd6f89-c34c-4f25-bb11-3069134927a3 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:34.560091 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-75cd6f89-c34c-4f25-bb11-3069134927a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:34.676862 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1330/2650] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:14:34.726141 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937afc9d-6cc0-4455-8624-f77b119dcad9 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:34.728819 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-937afc9d-6cc0-4455-8624-f77b119dcad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:34.895525 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937afc9d-6cc0-4455-8624-f77b119dcad9 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:34.903962 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af56a2a-efab-4500-a6c1-436e3be1f684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:34.908587 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af56a2a-efab-4500-a6c1-436e3be1f684 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:34.909251 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af56a2a-efab-4500-a6c1-436e3be1f684 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:34.909769 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af56a2a-efab-4500-a6c1-436e3be1f684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:34.932518 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af56a2a-efab-4500-a6c1-436e3be1f684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:34.934339 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af56a2a-efab-4500-a6c1-436e3be1f684 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:34.956409 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1321/2651] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:14:35.921395 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd6f89-c34c-4f25-bb11-3069134927a3 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:35.923970 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-75cd6f89-c34c-4f25-bb11-3069134927a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:35.956428 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd6f89-c34c-4f25-bb11-3069134927a3 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:35.973653 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a6368-a8d1-4d11-b6e3-dee45c0f720c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:35.977466 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a6368-a8d1-4d11-b6e3-dee45c0f720c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:35.977751 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a6368-a8d1-4d11-b6e3-dee45c0f720c admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:35.978228 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a6368-a8d1-4d11-b6e3-dee45c0f720c admin admin] PATH_INFO: `/v3/projects/53b5e41f555c44d4b600cb2e23480da7` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:35.981692 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a6368-a8d1-4d11-b6e3-dee45c0f720c admin admin] RBAC: Authorizing `identity:delete_project(project_id=53b5e41f555c44d4b600cb2e23480da7)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:35.991909 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a6368-a8d1-4d11-b6e3-dee45c0f720c admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:36.130092 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-560a6368-a8d1-4d11-b6e3-dee45c0f720c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53b5e41f555c44d4b600cb2e23480da7', 'request_id': 'req-560a6368-a8d1-4d11-b6e3-dee45c0f720c'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:36.135453 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:36.158666 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-560a6368-a8d1-4d11-b6e3-dee45c0f720c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53b5e41f555c44d4b600cb2e23480da7', 'request_id': 'req-560a6368-a8d1-4d11-b6e3-dee45c0f720c'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:36.172802 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-560a6368-a8d1-4d11-b6e3-dee45c0f720c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53b5e41f555c44d4b600cb2e23480da7', 'request_id': 'req-560a6368-a8d1-4d11-b6e3-dee45c0f720c'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:36.206552 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-560a6368-a8d1-4d11-b6e3-dee45c0f720c admin admin] The token cache is being invalidate because project 53b5e41f555c44d4b600cb2e23480da7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:14:36.206998 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-560a6368-a8d1-4d11-b6e3-dee45c0f720c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:36.208217 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-560a6368-a8d1-4d11-b6e3-dee45c0f720c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:36.217655 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22291be-db7b-4845-80b3-2e52e601db85 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:36.218872 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22291be-db7b-4845-80b3-2e52e601db85 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:36.218872 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22291be-db7b-4845-80b3-2e52e601db85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:36.221206 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1331/2652] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:14:35 2022] DELETE /identity/v3/projects/53b5e41f555c44d4b600cb2e23480da7 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:36.250201 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-a22291be-db7b-4845-80b3-2e52e601db85 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:36.252003 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-a22291be-db7b-4845-80b3-2e52e601db85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:36.394216 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1322/2653] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:14:36.506277 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622bf86-5f24-43ed-aeb2-37a53cfde5c6 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:36.507225 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622bf86-5f24-43ed-aeb2-37a53cfde5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:36.508016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622bf86-5f24-43ed-aeb2-37a53cfde5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:36.570592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-8622bf86-5f24-43ed-aeb2-37a53cfde5c6 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:36.575569 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-8622bf86-5f24-43ed-aeb2-37a53cfde5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:36.605181 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1332/2654] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:36.607940 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22291be-db7b-4845-80b3-2e52e601db85 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:36.628995 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22291be-db7b-4845-80b3-2e52e601db85 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:36.640760 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c722059-849b-491c-8139-14d7ce1fdd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:36.642276 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c722059-849b-491c-8139-14d7ce1fdd4e admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:36.643037 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c722059-849b-491c-8139-14d7ce1fdd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:36.643923 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c722059-849b-491c-8139-14d7ce1fdd4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:36.645565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c722059-849b-491c-8139-14d7ce1fdd4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:14:36.646435 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c722059-849b-491c-8139-14d7ce1fdd4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:36.650857 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c722059-849b-491c-8139-14d7ce1fdd4e admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:36.680280 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622bf86-5f24-43ed-aeb2-37a53cfde5c6 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:36.682769 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1323/2655] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:14:36.692450 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622bf86-5f24-43ed-aeb2-37a53cfde5c6 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:36.701018 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acc118-0bc3-4af4-9d6a-b3aebee6960e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:36.702056 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acc118-0bc3-4af4-9d6a-b3aebee6960e admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:36.702371 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acc118-0bc3-4af4-9d6a-b3aebee6960e admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:36.702658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acc118-0bc3-4af4-9d6a-b3aebee6960e admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:36.704031 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acc118-0bc3-4af4-9d6a-b3aebee6960e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:36.709930 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acc118-0bc3-4af4-9d6a-b3aebee6960e admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:36.786565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c722059-849b-491c-8139-14d7ce1fdd4e admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:36.798441 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1333/2656] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:14:36 2022] POST /identity/v3/projects => generated 389 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:14:36.812073 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c722059-849b-491c-8139-14d7ce1fdd4e admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:36.834310 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:36.978541 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a4a5c-ce6e-4c56-9c2d-4b77f8ce28d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:36.979429 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a4a5c-ce6e-4c56-9c2d-4b77f8ce28d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:36.980019 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a4a5c-ce6e-4c56-9c2d-4b77f8ce28d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:36.980473 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a4a5c-ce6e-4c56-9c2d-4b77f8ce28d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:36.981547 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a4a5c-ce6e-4c56-9c2d-4b77f8ce28d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:36.985869 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a4a5c-ce6e-4c56-9c2d-4b77f8ce28d1 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:37.067609 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1324/2657] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:14:36 2022] POST /identity/v3/users => generated 295 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:14:37.073521 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acc118-0bc3-4af4-9d6a-b3aebee6960e admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:37.099684 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acc118-0bc3-4af4-9d6a-b3aebee6960e admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:37.111367 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73785f0c-8cd6-4879-a134-7c58e811e883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:37.112441 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73785f0c-8cd6-4879-a134-7c58e811e883 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:37.113125 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73785f0c-8cd6-4879-a134-7c58e811e883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:37.113625 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73785f0c-8cd6-4879-a134-7c58e811e883 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:37.114919 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73785f0c-8cd6-4879-a134-7c58e811e883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:37.117928 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73785f0c-8cd6-4879-a134-7c58e811e883 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:37.134932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1334/2658] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:14:37.140540 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a4a5c-ce6e-4c56-9c2d-4b77f8ce28d1 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:37.168593 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a4a5c-ce6e-4c56-9c2d-4b77f8ce28d1 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:37.179332 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038850a-700a-48f5-baa0-19714f773ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:37.182058 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038850a-700a-48f5-baa0-19714f773ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:37.182058 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038850a-700a-48f5-baa0-19714f773ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:37.182058 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038850a-700a-48f5-baa0-19714f773ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:37.184232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038850a-700a-48f5-baa0-19714f773ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:37.187560 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038850a-700a-48f5-baa0-19714f773ee4 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:37.216953 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1325/2659] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:14:37.219356 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73785f0c-8cd6-4879-a134-7c58e811e883 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:37.233889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73785f0c-8cd6-4879-a134-7c58e811e883 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:37.241796 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae55e0b-00b3-49fe-80d4-62caf48996c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:37.242726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae55e0b-00b3-49fe-80d4-62caf48996c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:37.243111 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae55e0b-00b3-49fe-80d4-62caf48996c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:37.243637 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae55e0b-00b3-49fe-80d4-62caf48996c3 admin admin] PATH_INFO: `/v3/projects/37fb402b03a44a4e8e8bd0110be4c389/users/68401d36218d4e2899e515a77a58d40f/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:37.287384 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae55e0b-00b3-49fe-80d4-62caf48996c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37fb402b03a44a4e8e8bd0110be4c389, user_id=68401d36218d4e2899e515a77a58d40f, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:37.291272 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae55e0b-00b3-49fe-80d4-62caf48996c3 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:37.316133 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1335/2660] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:14:37 2022] PUT /identity/v3/projects/37fb402b03a44a4e8e8bd0110be4c389/users/68401d36218d4e2899e515a77a58d40f/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:37.328720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b139d8-374f-4e55-b893-87baee4409e5 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:37.329642 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b139d8-374f-4e55-b893-87baee4409e5 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:37.329642 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b139d8-374f-4e55-b893-87baee4409e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:37.382449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-54b139d8-374f-4e55-b893-87baee4409e5 None None] MFA Rules not processed for user `68401d36218d4e2899e515a77a58d40f`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:37.385419 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-54b139d8-374f-4e55-b893-87baee4409e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:37.486561 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1326/2661] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:37.499756 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae55e0b-00b3-49fe-80d4-62caf48996c3 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:37.502652 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-cae55e0b-00b3-49fe-80d4-62caf48996c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:37.647887 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae55e0b-00b3-49fe-80d4-62caf48996c3 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:37.653047 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35887bb9-5f1e-490c-bcd9-e8aa6ac6b8c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:37.654762 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35887bb9-5f1e-490c-bcd9-e8aa6ac6b8c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:37.655150 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35887bb9-5f1e-490c-bcd9-e8aa6ac6b8c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:37.656060 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35887bb9-5f1e-490c-bcd9-e8aa6ac6b8c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:37.672283 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35887bb9-5f1e-490c-bcd9-e8aa6ac6b8c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:37.673946 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35887bb9-5f1e-490c-bcd9-e8aa6ac6b8c2 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:37.686152 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1336/2662] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:14:38.519815 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b139d8-374f-4e55-b893-87baee4409e5 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:38.522912 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-54b139d8-374f-4e55-b893-87baee4409e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:38.634651 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b139d8-374f-4e55-b893-87baee4409e5 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:38.640420 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a26da-c76f-4a1c-95f1-83843a47d76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:38.641232 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a26da-c76f-4a1c-95f1-83843a47d76f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:38.641555 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a26da-c76f-4a1c-95f1-83843a47d76f admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:38.641898 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a26da-c76f-4a1c-95f1-83843a47d76f admin admin] PATH_INFO: `/v3/users/f67b7dc78caf4da490739ff96f436764` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:38.659382 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a26da-c76f-4a1c-95f1-83843a47d76f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f67b7dc78caf4da490739ff96f436764)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:38.661709 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a26da-c76f-4a1c-95f1-83843a47d76f admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:38.676518 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:38.737460 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-008a26da-c76f-4a1c-95f1-83843a47d76f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f67b7dc78caf4da490739ff96f436764'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:38.738288 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-008a26da-c76f-4a1c-95f1-83843a47d76f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f67b7dc78caf4da490739ff96f436764'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:38.739121 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-008a26da-c76f-4a1c-95f1-83843a47d76f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f67b7dc78caf4da490739ff96f436764'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:38.750475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-008a26da-c76f-4a1c-95f1-83843a47d76f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f67b7dc78caf4da490739ff96f436764'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:38.767772 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-008a26da-c76f-4a1c-95f1-83843a47d76f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f67b7dc78caf4da490739ff96f436764'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:38.781825 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1327/2663] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:14:38 2022] DELETE /identity/v3/users/f67b7dc78caf4da490739ff96f436764 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:14:39.068900 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35887bb9-5f1e-490c-bcd9-e8aa6ac6b8c2 service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:39.083046 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35887bb9-5f1e-490c-bcd9-e8aa6ac6b8c2 service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:39.163578 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37527f88-961f-4f80-8c2e-dc2d0511b625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:39.164254 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37527f88-961f-4f80-8c2e-dc2d0511b625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:39.164538 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37527f88-961f-4f80-8c2e-dc2d0511b625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:39.164817 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37527f88-961f-4f80-8c2e-dc2d0511b625 admin admin] PATH_INFO: `/v3/projects/fe158cc8c3114b8dac893a9d408414d2` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:39.178245 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37527f88-961f-4f80-8c2e-dc2d0511b625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe158cc8c3114b8dac893a9d408414d2)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:39.180281 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37527f88-961f-4f80-8c2e-dc2d0511b625 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:39.196457 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:39.242853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-37527f88-961f-4f80-8c2e-dc2d0511b625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe158cc8c3114b8dac893a9d408414d2', 'request_id': 'req-37527f88-961f-4f80-8c2e-dc2d0511b625'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:39.250637 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-37527f88-961f-4f80-8c2e-dc2d0511b625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe158cc8c3114b8dac893a9d408414d2', 'request_id': 'req-37527f88-961f-4f80-8c2e-dc2d0511b625'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:39.257046 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-37527f88-961f-4f80-8c2e-dc2d0511b625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe158cc8c3114b8dac893a9d408414d2', 'request_id': 'req-37527f88-961f-4f80-8c2e-dc2d0511b625'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:39.272479 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-37527f88-961f-4f80-8c2e-dc2d0511b625 admin admin] The token cache is being invalidate because project fe158cc8c3114b8dac893a9d408414d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:14:39.272925 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-37527f88-961f-4f80-8c2e-dc2d0511b625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:39.273925 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-37527f88-961f-4f80-8c2e-dc2d0511b625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:39.275883 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1337/2664] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:14:39 2022] DELETE /identity/v3/projects/fe158cc8c3114b8dac893a9d408414d2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:14:39.288434 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76a707-313a-4fc1-a507-0fc6d13fd6e4 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:39.288810 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76a707-313a-4fc1-a507-0fc6d13fd6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:39.289178 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76a707-313a-4fc1-a507-0fc6d13fd6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:39.321778 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-9e76a707-313a-4fc1-a507-0fc6d13fd6e4 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:39.323464 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-9e76a707-313a-4fc1-a507-0fc6d13fd6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:39.476770 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1328/2665] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:39.490258 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d71cf2-12f7-4cb1-a65a-b9707fa304b6 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:39.490953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d71cf2-12f7-4cb1-a65a-b9707fa304b6 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:39.491402 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d71cf2-12f7-4cb1-a65a-b9707fa304b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:39.526859 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-12d71cf2-12f7-4cb1-a65a-b9707fa304b6 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:39.530276 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-12d71cf2-12f7-4cb1-a65a-b9707fa304b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:39.545952 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1338/2666] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:39.553154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76a707-313a-4fc1-a507-0fc6d13fd6e4 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:39.576757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76a707-313a-4fc1-a507-0fc6d13fd6e4 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:39.586712 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84baed92-db6f-4377-951a-2e1d3c5932eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:39.588691 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84baed92-db6f-4377-951a-2e1d3c5932eb admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:39.589226 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84baed92-db6f-4377-951a-2e1d3c5932eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:39.589813 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84baed92-db6f-4377-951a-2e1d3c5932eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:39.593221 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84baed92-db6f-4377-951a-2e1d3c5932eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:14:39.594111 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84baed92-db6f-4377-951a-2e1d3c5932eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:39.598491 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84baed92-db6f-4377-951a-2e1d3c5932eb admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:39.626648 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1329/2667] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 09:14:39.634248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d71cf2-12f7-4cb1-a65a-b9707fa304b6 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:39.654608 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d71cf2-12f7-4cb1-a65a-b9707fa304b6 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:39.665300 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a64c7-589e-4288-8829-9b2abfe93606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:39.665300 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a64c7-589e-4288-8829-9b2abfe93606 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:39.682902 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a64c7-589e-4288-8829-9b2abfe93606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:39.683507 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a64c7-589e-4288-8829-9b2abfe93606 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:39.685021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a64c7-589e-4288-8829-9b2abfe93606 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:39.688951 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a64c7-589e-4288-8829-9b2abfe93606 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:39.785407 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1339/2668] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:14:39 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:14:39.787291 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84baed92-db6f-4377-951a-2e1d3c5932eb admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:39.811443 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84baed92-db6f-4377-951a-2e1d3c5932eb admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:39.947374 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76260c61-68c6-4bce-a298-73ae8da1fb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:39.948198 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76260c61-68c6-4bce-a298-73ae8da1fb79 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:39.948575 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76260c61-68c6-4bce-a298-73ae8da1fb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:39.948981 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76260c61-68c6-4bce-a298-73ae8da1fb79 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:39.949756 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76260c61-68c6-4bce-a298-73ae8da1fb79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:39.953148 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76260c61-68c6-4bce-a298-73ae8da1fb79 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:39.988671 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1330/2669] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:14:39 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:14:39.990606 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a64c7-589e-4288-8829-9b2abfe93606 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:40.003853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a64c7-589e-4288-8829-9b2abfe93606 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:40.008982 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80fc21-42a1-42ed-9ed7-20337635ff0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:40.009623 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80fc21-42a1-42ed-9ed7-20337635ff0c admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:40.009903 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80fc21-42a1-42ed-9ed7-20337635ff0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:40.010362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80fc21-42a1-42ed-9ed7-20337635ff0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:40.011102 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80fc21-42a1-42ed-9ed7-20337635ff0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:40.013497 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80fc21-42a1-42ed-9ed7-20337635ff0c admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:40.030380 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1340/2670] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:14:40.034177 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76260c61-68c6-4bce-a298-73ae8da1fb79 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:40.055669 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76260c61-68c6-4bce-a298-73ae8da1fb79 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:40.064218 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5ab12-7820-4ed0-89b1-1c698ea22bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:40.065327 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5ab12-7820-4ed0-89b1-1c698ea22bab admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:40.065822 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5ab12-7820-4ed0-89b1-1c698ea22bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:40.066359 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5ab12-7820-4ed0-89b1-1c698ea22bab admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:40.067725 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5ab12-7820-4ed0-89b1-1c698ea22bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:40.071104 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5ab12-7820-4ed0-89b1-1c698ea22bab admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:40.073792 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:40.102376 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1331/2671] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:14:40.105549 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80fc21-42a1-42ed-9ed7-20337635ff0c admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:40.124019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80fc21-42a1-42ed-9ed7-20337635ff0c admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:40.132484 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250189fa-c565-4dbd-9bd4-16cd47979faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:40.133249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250189fa-c565-4dbd-9bd4-16cd47979faa admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:40.133557 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250189fa-c565-4dbd-9bd4-16cd47979faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:40.133959 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250189fa-c565-4dbd-9bd4-16cd47979faa admin admin] PATH_INFO: `/v3/projects/5da4bcf3fb2e4ceda2b435d391989bdb/users/7422174947c348cbb5276e68f51fe5a2/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:40.162931 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250189fa-c565-4dbd-9bd4-16cd47979faa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5da4bcf3fb2e4ceda2b435d391989bdb, user_id=7422174947c348cbb5276e68f51fe5a2, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:40.167389 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250189fa-c565-4dbd-9bd4-16cd47979faa admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:40.186101 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1341/2672] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:14:40 2022] PUT /identity/v3/projects/5da4bcf3fb2e4ceda2b435d391989bdb/users/7422174947c348cbb5276e68f51fe5a2/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:40.198729 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509c52e-3717-48b5-acc4-1ab75b85c952 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:40.199087 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509c52e-3717-48b5-acc4-1ab75b85c952 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:40.199407 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509c52e-3717-48b5-acc4-1ab75b85c952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:40.238487 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-e509c52e-3717-48b5-acc4-1ab75b85c952 None None] MFA Rules not processed for user `7422174947c348cbb5276e68f51fe5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:40.239761 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-e509c52e-3717-48b5-acc4-1ab75b85c952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:40.327052 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1332/2673] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:14:40.332947 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250189fa-c565-4dbd-9bd4-16cd47979faa admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:40.430865 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250189fa-c565-4dbd-9bd4-16cd47979faa admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:40.436260 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122cf96-1afc-4ebb-b806-e42fa4ff0516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:40.437024 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122cf96-1afc-4ebb-b806-e42fa4ff0516 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:40.437274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122cf96-1afc-4ebb-b806-e42fa4ff0516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:40.437556 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122cf96-1afc-4ebb-b806-e42fa4ff0516 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:40.438281 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122cf96-1afc-4ebb-b806-e42fa4ff0516 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:40.440427 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122cf96-1afc-4ebb-b806-e42fa4ff0516 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:40.474569 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1342/2674] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:14:40 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:14:40.480204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509c52e-3717-48b5-acc4-1ab75b85c952 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:40.503060 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509c52e-3717-48b5-acc4-1ab75b85c952 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:40.594633 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d33f6-a1a8-4625-a098-9b54b554e4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:40.595551 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d33f6-a1a8-4625-a098-9b54b554e4d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:40.595945 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d33f6-a1a8-4625-a098-9b54b554e4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:40.596351 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d33f6-a1a8-4625-a098-9b54b554e4d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:40.597419 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d33f6-a1a8-4625-a098-9b54b554e4d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:40.601045 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d33f6-a1a8-4625-a098-9b54b554e4d9 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:40.629628 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1333/2675] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:14:40 2022] POST /identity/v3/users => generated 300 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:14:40.634244 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122cf96-1afc-4ebb-b806-e42fa4ff0516 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:40.646192 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122cf96-1afc-4ebb-b806-e42fa4ff0516 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:40.651049 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019729e-8dc1-49ad-9e1f-f8e753e750ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:40.651689 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019729e-8dc1-49ad-9e1f-f8e753e750ae admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:40.651966 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019729e-8dc1-49ad-9e1f-f8e753e750ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:40.652235 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019729e-8dc1-49ad-9e1f-f8e753e750ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:40.653062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019729e-8dc1-49ad-9e1f-f8e753e750ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:40.655565 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019729e-8dc1-49ad-9e1f-f8e753e750ae admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:40.668261 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1343/2676] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:14:40.673475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d33f6-a1a8-4625-a098-9b54b554e4d9 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:40.689205 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d33f6-a1a8-4625-a098-9b54b554e4d9 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:40.696969 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091338d-431f-41eb-8b25-d11836a2511d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:40.698154 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091338d-431f-41eb-8b25-d11836a2511d admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:40.698655 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091338d-431f-41eb-8b25-d11836a2511d admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:40.699144 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091338d-431f-41eb-8b25-d11836a2511d admin admin] PATH_INFO: `/v3/projects/82bc959114184d6c85eb5d65db8d4832/users/419e3c09f2bd496ab9f6cec54928599d/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:40.733275 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091338d-431f-41eb-8b25-d11836a2511d admin admin] RBAC: Authorizing `identity:create_grant(project_id=82bc959114184d6c85eb5d65db8d4832, user_id=419e3c09f2bd496ab9f6cec54928599d, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:40.736191 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091338d-431f-41eb-8b25-d11836a2511d admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:40.757421 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1334/2677] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:14:40 2022] PUT /identity/v3/projects/82bc959114184d6c85eb5d65db8d4832/users/419e3c09f2bd496ab9f6cec54928599d/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:14:40.764909 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019729e-8dc1-49ad-9e1f-f8e753e750ae admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:40.786514 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019729e-8dc1-49ad-9e1f-f8e753e750ae admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:40.801023 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:40.885226 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4663faa-8308-4842-bde5-a2f821a2ccfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:40.886617 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4663faa-8308-4842-bde5-a2f821a2ccfb admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:40.887354 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4663faa-8308-4842-bde5-a2f821a2ccfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:40.887701 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4663faa-8308-4842-bde5-a2f821a2ccfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:40.889961 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4663faa-8308-4842-bde5-a2f821a2ccfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:40.894258 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4663faa-8308-4842-bde5-a2f821a2ccfb admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:40.927104 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1344/2678] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:14:40.927569 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091338d-431f-41eb-8b25-d11836a2511d admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:40.940321 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091338d-431f-41eb-8b25-d11836a2511d admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:40.949158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82308e28-7d1b-47ca-a854-d0b4389bb37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:40.950475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82308e28-7d1b-47ca-a854-d0b4389bb37f admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:40.951449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82308e28-7d1b-47ca-a854-d0b4389bb37f admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:40.951967 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82308e28-7d1b-47ca-a854-d0b4389bb37f admin admin] PATH_INFO: `/v3/projects/82bc959114184d6c85eb5d65db8d4832/users/419e3c09f2bd496ab9f6cec54928599d/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:40.955378 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82308e28-7d1b-47ca-a854-d0b4389bb37f admin admin] RBAC: Authorizing `identity:create_grant(project_id=82bc959114184d6c85eb5d65db8d4832, user_id=419e3c09f2bd496ab9f6cec54928599d, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:40.958352 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82308e28-7d1b-47ca-a854-d0b4389bb37f admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:40.974590 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1335/2679] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:14:40 2022] PUT /identity/v3/projects/82bc959114184d6c85eb5d65db8d4832/users/419e3c09f2bd496ab9f6cec54928599d/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:14:40.989158 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9fc2f-2bd6-4cee-8d59-0cd7ac6aa09c None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:40.989443 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9fc2f-2bd6-4cee-8d59-0cd7ac6aa09c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:40.989727 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9fc2f-2bd6-4cee-8d59-0cd7ac6aa09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:41.021814 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-27d9fc2f-2bd6-4cee-8d59-0cd7ac6aa09c None None] MFA Rules not processed for user `419e3c09f2bd496ab9f6cec54928599d`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:41.023093 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-27d9fc2f-2bd6-4cee-8d59-0cd7ac6aa09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:41.108961 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1345/2680] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:14:41.120569 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82308e28-7d1b-47ca-a854-d0b4389bb37f admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:41.122562 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-82308e28-7d1b-47ca-a854-d0b4389bb37f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:41.171686 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:41.189581 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82308e28-7d1b-47ca-a854-d0b4389bb37f admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:41.193323 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab085bd-6d89-4ee6-8868-8b49e9362ecb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:41.193946 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab085bd-6d89-4ee6-8868-8b49e9362ecb service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:41.194221 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab085bd-6d89-4ee6-8868-8b49e9362ecb service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:41.194516 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab085bd-6d89-4ee6-8868-8b49e9362ecb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:41.206096 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab085bd-6d89-4ee6-8868-8b49e9362ecb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:41.207618 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab085bd-6d89-4ee6-8868-8b49e9362ecb service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:41.219403 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1336/2681] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:14:41.977655 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9fc2f-2bd6-4cee-8d59-0cd7ac6aa09c None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:42.100490 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9fc2f-2bd6-4cee-8d59-0cd7ac6aa09c None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:42.109301 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b815aec-a94f-4615-bdde-d4b474d60af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:42.110407 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b815aec-a94f-4615-bdde-d4b474d60af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:42.110812 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b815aec-a94f-4615-bdde-d4b474d60af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:42.111319 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b815aec-a94f-4615-bdde-d4b474d60af0 admin admin] PATH_INFO: `/v3/users/7422174947c348cbb5276e68f51fe5a2` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:42.113184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b815aec-a94f-4615-bdde-d4b474d60af0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7422174947c348cbb5276e68f51fe5a2)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:42.116652 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b815aec-a94f-4615-bdde-d4b474d60af0 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:42.187772 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:42.206461 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4b815aec-a94f-4615-bdde-d4b474d60af0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7422174947c348cbb5276e68f51fe5a2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:42.219201 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4b815aec-a94f-4615-bdde-d4b474d60af0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7422174947c348cbb5276e68f51fe5a2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:42.220441 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4b815aec-a94f-4615-bdde-d4b474d60af0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7422174947c348cbb5276e68f51fe5a2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:42.242067 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4b815aec-a94f-4615-bdde-d4b474d60af0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7422174947c348cbb5276e68f51fe5a2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:42.243022 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4b815aec-a94f-4615-bdde-d4b474d60af0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7422174947c348cbb5276e68f51fe5a2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:42.272934 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1346/2682] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:14:41 2022] DELETE /identity/v3/users/7422174947c348cbb5276e68f51fe5a2 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:42.276227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d210d-d022-41f9-857e-02c839fafbe0 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:42.276876 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d210d-d022-41f9-857e-02c839fafbe0 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:42.277227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d210d-d022-41f9-857e-02c839fafbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:42.309272 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-205d210d-d022-41f9-857e-02c839fafbe0 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:42.310583 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-205d210d-d022-41f9-857e-02c839fafbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:42.380518 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1337/2683] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:42.392069 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b815aec-a94f-4615-bdde-d4b474d60af0 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:42.393676 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4b815aec-a94f-4615-bdde-d4b474d60af0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:42.464109 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b815aec-a94f-4615-bdde-d4b474d60af0 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:42.468568 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20199e62-6e52-43d5-81f8-aabe836f1b43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:42.469203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20199e62-6e52-43d5-81f8-aabe836f1b43 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:42.469488 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20199e62-6e52-43d5-81f8-aabe836f1b43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:42.469899 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20199e62-6e52-43d5-81f8-aabe836f1b43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:42.481625 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20199e62-6e52-43d5-81f8-aabe836f1b43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:42.483203 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20199e62-6e52-43d5-81f8-aabe836f1b43 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:42.495107 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1347/2684] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:14:42.889805 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d210d-d022-41f9-857e-02c839fafbe0 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:42.891626 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-205d210d-d022-41f9-857e-02c839fafbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:42.906366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d210d-d022-41f9-857e-02c839fafbe0 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:42.912499 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c61e5-f8d7-4c51-ab5c-2f47fc3d235c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:42.913168 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c61e5-f8d7-4c51-ab5c-2f47fc3d235c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:42.913452 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c61e5-f8d7-4c51-ab5c-2f47fc3d235c admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:42.913724 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c61e5-f8d7-4c51-ab5c-2f47fc3d235c admin admin] PATH_INFO: `/v3/projects/5da4bcf3fb2e4ceda2b435d391989bdb` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:42.915044 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c61e5-f8d7-4c51-ab5c-2f47fc3d235c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5da4bcf3fb2e4ceda2b435d391989bdb)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:42.917021 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c61e5-f8d7-4c51-ab5c-2f47fc3d235c admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:42.990238 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-915c61e5-f8d7-4c51-ab5c-2f47fc3d235c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5da4bcf3fb2e4ceda2b435d391989bdb', 'request_id': 'req-915c61e5-f8d7-4c51-ab5c-2f47fc3d235c'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:43.000958 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-915c61e5-f8d7-4c51-ab5c-2f47fc3d235c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5da4bcf3fb2e4ceda2b435d391989bdb', 'request_id': 'req-915c61e5-f8d7-4c51-ab5c-2f47fc3d235c'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:43.012475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-915c61e5-f8d7-4c51-ab5c-2f47fc3d235c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5da4bcf3fb2e4ceda2b435d391989bdb', 'request_id': 'req-915c61e5-f8d7-4c51-ab5c-2f47fc3d235c'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:43.032234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-915c61e5-f8d7-4c51-ab5c-2f47fc3d235c admin admin] The token cache is being invalidate because project 5da4bcf3fb2e4ceda2b435d391989bdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:14:43.032720 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-915c61e5-f8d7-4c51-ab5c-2f47fc3d235c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:43.033866 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-915c61e5-f8d7-4c51-ab5c-2f47fc3d235c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:43.036776 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1338/2685] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:14:42 2022] DELETE /identity/v3/projects/5da4bcf3fb2e4ceda2b435d391989bdb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:14:43.042183 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20199e62-6e52-43d5-81f8-aabe836f1b43 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:43.054360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20199e62-6e52-43d5-81f8-aabe836f1b43 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:43.143498 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e048555-fc99-4fb2-8793-4e546aa20ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:43.145726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e048555-fc99-4fb2-8793-4e546aa20ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:43.146055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e048555-fc99-4fb2-8793-4e546aa20ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:43.146510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e048555-fc99-4fb2-8793-4e546aa20ced admin admin] PATH_INFO: `/v3/users/419e3c09f2bd496ab9f6cec54928599d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:43.148092 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e048555-fc99-4fb2-8793-4e546aa20ced admin admin] RBAC: Authorizing `identity:delete_user(user_id=419e3c09f2bd496ab9f6cec54928599d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:43.150628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e048555-fc99-4fb2-8793-4e546aa20ced admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:43.222732 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-2e048555-fc99-4fb2-8793-4e546aa20ced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '419e3c09f2bd496ab9f6cec54928599d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:43.237230 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-2e048555-fc99-4fb2-8793-4e546aa20ced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '419e3c09f2bd496ab9f6cec54928599d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:43.238428 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-2e048555-fc99-4fb2-8793-4e546aa20ced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '419e3c09f2bd496ab9f6cec54928599d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:43.240892 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:43.260613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-2e048555-fc99-4fb2-8793-4e546aa20ced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '419e3c09f2bd496ab9f6cec54928599d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:43.261415 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-2e048555-fc99-4fb2-8793-4e546aa20ced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '419e3c09f2bd496ab9f6cec54928599d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:43.277667 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1348/2686] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:14:43 2022] DELETE /identity/v3/users/419e3c09f2bd496ab9f6cec54928599d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:14:43.789411 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c61e5-f8d7-4c51-ab5c-2f47fc3d235c admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:43.791982 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-915c61e5-f8d7-4c51-ab5c-2f47fc3d235c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:43.818901 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c61e5-f8d7-4c51-ab5c-2f47fc3d235c admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:43.944330 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f41cd-c749-493e-9361-da33b80feb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:43.945494 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f41cd-c749-493e-9361-da33b80feb52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:43.945994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f41cd-c749-493e-9361-da33b80feb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:43.946577 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f41cd-c749-493e-9361-da33b80feb52 admin admin] PATH_INFO: `/v3/projects/82bc959114184d6c85eb5d65db8d4832` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:43.948883 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f41cd-c749-493e-9361-da33b80feb52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82bc959114184d6c85eb5d65db8d4832)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:43.953119 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f41cd-c749-493e-9361-da33b80feb52 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:43.968172 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:44.059897 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-249f41cd-c749-493e-9361-da33b80feb52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82bc959114184d6c85eb5d65db8d4832', 'request_id': 'req-249f41cd-c749-493e-9361-da33b80feb52'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:44.072343 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-249f41cd-c749-493e-9361-da33b80feb52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82bc959114184d6c85eb5d65db8d4832', 'request_id': 'req-249f41cd-c749-493e-9361-da33b80feb52'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:44.088146 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-249f41cd-c749-493e-9361-da33b80feb52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82bc959114184d6c85eb5d65db8d4832', 'request_id': 'req-249f41cd-c749-493e-9361-da33b80feb52'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:44.126357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-249f41cd-c749-493e-9361-da33b80feb52 admin admin] The token cache is being invalidate because project 82bc959114184d6c85eb5d65db8d4832 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:14:44.126357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-249f41cd-c749-493e-9361-da33b80feb52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:44.127068 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-249f41cd-c749-493e-9361-da33b80feb52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:44.129755 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1339/2687] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:14:43 2022] DELETE /identity/v3/projects/82bc959114184d6c85eb5d65db8d4832 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:14:44.138750 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600dfd1-5b46-419f-b05c-989526b40d14 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:44.139168 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600dfd1-5b46-419f-b05c-989526b40d14 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:44.139572 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600dfd1-5b46-419f-b05c-989526b40d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:44.164770 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-1600dfd1-5b46-419f-b05c-989526b40d14 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:44.167040 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1600dfd1-5b46-419f-b05c-989526b40d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:44.286511 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1349/2688] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:14:44.295330 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25625c3-3798-4082-8293-23365e56c646 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:44.295752 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25625c3-3798-4082-8293-23365e56c646 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:44.296088 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25625c3-3798-4082-8293-23365e56c646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:44.320558 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-f25625c3-3798-4082-8293-23365e56c646 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:44.322821 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-f25625c3-3798-4082-8293-23365e56c646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:44.336798 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1340/2689] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:44.339023 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600dfd1-5b46-419f-b05c-989526b40d14 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:44.356193 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600dfd1-5b46-419f-b05c-989526b40d14 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:44.361791 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481d8cb-a054-4f5c-8acb-79f318341d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:44.362552 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481d8cb-a054-4f5c-8acb-79f318341d87 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:44.362895 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481d8cb-a054-4f5c-8acb-79f318341d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:44.363295 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481d8cb-a054-4f5c-8acb-79f318341d87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:44.364266 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481d8cb-a054-4f5c-8acb-79f318341d87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:14:44.364751 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481d8cb-a054-4f5c-8acb-79f318341d87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:44.366975 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481d8cb-a054-4f5c-8acb-79f318341d87 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:44.384573 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1350/2690] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:14:44.390201 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25625c3-3798-4082-8293-23365e56c646 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:44.402766 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25625c3-3798-4082-8293-23365e56c646 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:44.408546 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ea56c-2126-4639-9e9e-ff1c343c5bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:44.409284 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ea56c-2126-4639-9e9e-ff1c343c5bcd admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:44.409712 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ea56c-2126-4639-9e9e-ff1c343c5bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:44.410105 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ea56c-2126-4639-9e9e-ff1c343c5bcd admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:44.410906 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ea56c-2126-4639-9e9e-ff1c343c5bcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:44.414279 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ea56c-2126-4639-9e9e-ff1c343c5bcd admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:44.458528 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1341/2691] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:14:44 2022] POST /identity/v3/projects => generated 381 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:14:44.463042 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481d8cb-a054-4f5c-8acb-79f318341d87 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:44.475351 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481d8cb-a054-4f5c-8acb-79f318341d87 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:44.565627 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb20d1-2dfd-42a5-a003-5616d5e1a11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:44.566268 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb20d1-2dfd-42a5-a003-5616d5e1a11c admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:44.566584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb20d1-2dfd-42a5-a003-5616d5e1a11c admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:44.566865 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb20d1-2dfd-42a5-a003-5616d5e1a11c admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:44.567559 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb20d1-2dfd-42a5-a003-5616d5e1a11c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:44.569525 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb20d1-2dfd-42a5-a003-5616d5e1a11c admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:44.596027 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1351/2692] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:14:44 2022] POST /identity/v3/users => generated 291 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:14:44.600783 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ea56c-2126-4639-9e9e-ff1c343c5bcd admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:44.611938 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ea56c-2126-4639-9e9e-ff1c343c5bcd admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:44.616955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211aa14-4dff-409a-9c38-72ac01ab6545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:44.617584 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211aa14-4dff-409a-9c38-72ac01ab6545 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:44.617865 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211aa14-4dff-409a-9c38-72ac01ab6545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:44.618138 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211aa14-4dff-409a-9c38-72ac01ab6545 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:44.618888 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211aa14-4dff-409a-9c38-72ac01ab6545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:44.620524 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211aa14-4dff-409a-9c38-72ac01ab6545 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:44.632527 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1342/2693] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:14:44.637707 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb20d1-2dfd-42a5-a003-5616d5e1a11c admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:44.648744 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb20d1-2dfd-42a5-a003-5616d5e1a11c admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:44.654513 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945a202-7747-4531-869a-17318127fe83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:44.655145 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945a202-7747-4531-869a-17318127fe83 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:44.655422 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945a202-7747-4531-869a-17318127fe83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:44.655690 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945a202-7747-4531-869a-17318127fe83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:44.656456 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945a202-7747-4531-869a-17318127fe83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:44.658099 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945a202-7747-4531-869a-17318127fe83 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:44.670396 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1352/2694] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:14:44.674924 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211aa14-4dff-409a-9c38-72ac01ab6545 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:44.686922 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211aa14-4dff-409a-9c38-72ac01ab6545 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:44.691759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff98a2-7e49-4a56-aad7-caae4e462d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:44.692451 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff98a2-7e49-4a56-aad7-caae4e462d62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:44.692727 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff98a2-7e49-4a56-aad7-caae4e462d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:44.693003 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff98a2-7e49-4a56-aad7-caae4e462d62 admin admin] PATH_INFO: `/v3/projects/19400ef83c03470b8056b1912561c093/users/22d31fe16cb5445480cc284bdbeef485/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:44.710363 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff98a2-7e49-4a56-aad7-caae4e462d62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19400ef83c03470b8056b1912561c093, user_id=22d31fe16cb5445480cc284bdbeef485, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:44.713061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff98a2-7e49-4a56-aad7-caae4e462d62 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:44.727801 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1343/2695] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:14:44 2022] PUT /identity/v3/projects/19400ef83c03470b8056b1912561c093/users/22d31fe16cb5445480cc284bdbeef485/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:14:44.739024 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289230d-eeef-4242-9755-8002d1e47f72 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:44.739361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289230d-eeef-4242-9755-8002d1e47f72 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:44.739673 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289230d-eeef-4242-9755-8002d1e47f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:44.773930 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-a289230d-eeef-4242-9755-8002d1e47f72 None None] MFA Rules not processed for user `22d31fe16cb5445480cc284bdbeef485`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:44.775547 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a289230d-eeef-4242-9755-8002d1e47f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:44.821159 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:44.888983 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1353/2696] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:44.894136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff98a2-7e49-4a56-aad7-caae4e462d62 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:44.975383 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff98a2-7e49-4a56-aad7-caae4e462d62 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:44.982865 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff15c4d-87dd-4f80-88f7-7ad07205151e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:44.984196 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff15c4d-87dd-4f80-88f7-7ad07205151e admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:44.984650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff15c4d-87dd-4f80-88f7-7ad07205151e admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:44.985107 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff15c4d-87dd-4f80-88f7-7ad07205151e admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:44.986092 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff15c4d-87dd-4f80-88f7-7ad07205151e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:44.988470 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff15c4d-87dd-4f80-88f7-7ad07205151e admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:45.034638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1344/2697] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:14:44 2022] POST /identity/v3/projects => generated 381 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:14:45.040913 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289230d-eeef-4242-9755-8002d1e47f72 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:45.060369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289230d-eeef-4242-9755-8002d1e47f72 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:45.150938 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7c332-a768-4783-b51b-0f385c31979b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:45.152067 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7c332-a768-4783-b51b-0f385c31979b admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:45.152566 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7c332-a768-4783-b51b-0f385c31979b admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:45.153055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7c332-a768-4783-b51b-0f385c31979b admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:45.154375 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7c332-a768-4783-b51b-0f385c31979b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:45.157023 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7c332-a768-4783-b51b-0f385c31979b admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:45.191800 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1354/2698] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:14:45 2022] POST /identity/v3/users => generated 297 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:14:45.196442 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff15c4d-87dd-4f80-88f7-7ad07205151e admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:45.209503 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff15c4d-87dd-4f80-88f7-7ad07205151e admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:45.215051 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160751fa-2d5e-40e5-9a1e-19033e0e476d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:45.216175 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160751fa-2d5e-40e5-9a1e-19033e0e476d admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:45.216627 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160751fa-2d5e-40e5-9a1e-19033e0e476d admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:45.216962 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160751fa-2d5e-40e5-9a1e-19033e0e476d admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:45.217845 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160751fa-2d5e-40e5-9a1e-19033e0e476d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:45.220150 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160751fa-2d5e-40e5-9a1e-19033e0e476d admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:45.236318 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1345/2699] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:14:45.241541 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7c332-a768-4783-b51b-0f385c31979b admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:45.253651 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7c332-a768-4783-b51b-0f385c31979b admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:45.260293 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27771c5-6b92-4c52-8f45-21ec6cb2ad7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:45.261311 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27771c5-6b92-4c52-8f45-21ec6cb2ad7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:45.262365 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27771c5-6b92-4c52-8f45-21ec6cb2ad7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:45.262697 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27771c5-6b92-4c52-8f45-21ec6cb2ad7d admin admin] PATH_INFO: `/v3/projects/e1551e120ff2406b997c6dea9ac1d981/users/00041baa21544fccb9fc74d2386478ba/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:45.287763 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27771c5-6b92-4c52-8f45-21ec6cb2ad7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1551e120ff2406b997c6dea9ac1d981, user_id=00041baa21544fccb9fc74d2386478ba, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:45.294683 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27771c5-6b92-4c52-8f45-21ec6cb2ad7d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:45.320319 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1355/2700] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:14:45 2022] PUT /identity/v3/projects/e1551e120ff2406b997c6dea9ac1d981/users/00041baa21544fccb9fc74d2386478ba/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:14:45.326912 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160751fa-2d5e-40e5-9a1e-19033e0e476d admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:45.337054 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:45.346981 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160751fa-2d5e-40e5-9a1e-19033e0e476d admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:45.429727 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c3425-600e-454c-a55e-d4cf60cb365a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:45.430309 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c3425-600e-454c-a55e-d4cf60cb365a admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:45.430934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c3425-600e-454c-a55e-d4cf60cb365a admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:45.430934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c3425-600e-454c-a55e-d4cf60cb365a admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:45.431580 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c3425-600e-454c-a55e-d4cf60cb365a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:45.434061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c3425-600e-454c-a55e-d4cf60cb365a admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:45.451480 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1346/2701] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:14:45.453478 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27771c5-6b92-4c52-8f45-21ec6cb2ad7d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:45.469503 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27771c5-6b92-4c52-8f45-21ec6cb2ad7d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:45.475760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f91fb1-3590-495d-90ba-ba2208fb57c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:45.476751 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f91fb1-3590-495d-90ba-ba2208fb57c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:45.477057 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f91fb1-3590-495d-90ba-ba2208fb57c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:45.477597 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f91fb1-3590-495d-90ba-ba2208fb57c3 admin admin] PATH_INFO: `/v3/projects/e1551e120ff2406b997c6dea9ac1d981/users/00041baa21544fccb9fc74d2386478ba/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:45.481663 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f91fb1-3590-495d-90ba-ba2208fb57c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1551e120ff2406b997c6dea9ac1d981, user_id=00041baa21544fccb9fc74d2386478ba, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:45.487735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f91fb1-3590-495d-90ba-ba2208fb57c3 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:45.506959 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1356/2702] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:14:45 2022] PUT /identity/v3/projects/e1551e120ff2406b997c6dea9ac1d981/users/00041baa21544fccb9fc74d2386478ba/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:45.527010 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90bb80-f477-4426-899b-5200e6994644 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:45.527448 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90bb80-f477-4426-899b-5200e6994644 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:45.527841 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90bb80-f477-4426-899b-5200e6994644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:45.582656 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-6f90bb80-f477-4426-899b-5200e6994644 None None] MFA Rules not processed for user `00041baa21544fccb9fc74d2386478ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:45.585925 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-6f90bb80-f477-4426-899b-5200e6994644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:45.682604 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1347/2703] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:45.695326 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f91fb1-3590-495d-90ba-ba2208fb57c3 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:45.697848 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-08f91fb1-3590-495d-90ba-ba2208fb57c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:45.775975 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f91fb1-3590-495d-90ba-ba2208fb57c3 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:45.780586 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0471c7-bcda-4e1b-9ab1-d9c83ac0ad25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:45.781218 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0471c7-bcda-4e1b-9ab1-d9c83ac0ad25 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:45.781494 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0471c7-bcda-4e1b-9ab1-d9c83ac0ad25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:45.781765 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0471c7-bcda-4e1b-9ab1-d9c83ac0ad25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:45.792673 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0471c7-bcda-4e1b-9ab1-d9c83ac0ad25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:45.794084 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0471c7-bcda-4e1b-9ab1-d9c83ac0ad25 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:45.808109 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1357/2704] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:14:46.341903 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90bb80-f477-4426-899b-5200e6994644 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:46.448073 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90bb80-f477-4426-899b-5200e6994644 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:46.453198 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da94931-ab3b-463d-a355-ec5f76672f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:46.453902 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da94931-ab3b-463d-a355-ec5f76672f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:46.454183 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da94931-ab3b-463d-a355-ec5f76672f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:46.454482 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da94931-ab3b-463d-a355-ec5f76672f07 admin admin] PATH_INFO: `/v3/users/22d31fe16cb5445480cc284bdbeef485` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:46.455665 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da94931-ab3b-463d-a355-ec5f76672f07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22d31fe16cb5445480cc284bdbeef485)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:46.457604 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da94931-ab3b-463d-a355-ec5f76672f07 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:46.489876 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:46.513105 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-0da94931-ab3b-463d-a355-ec5f76672f07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22d31fe16cb5445480cc284bdbeef485'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:46.513788 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-0da94931-ab3b-463d-a355-ec5f76672f07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22d31fe16cb5445480cc284bdbeef485'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:46.514430 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-0da94931-ab3b-463d-a355-ec5f76672f07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22d31fe16cb5445480cc284bdbeef485'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:46.522547 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-0da94931-ab3b-463d-a355-ec5f76672f07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22d31fe16cb5445480cc284bdbeef485'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:46.536459 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-0da94931-ab3b-463d-a355-ec5f76672f07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22d31fe16cb5445480cc284bdbeef485'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:46.551279 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1348/2705] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:14:46 2022] DELETE /identity/v3/users/22d31fe16cb5445480cc284bdbeef485 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:14:46.555808 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6516abf-3e31-4684-983b-7c6c2126cba4 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:46.556277 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6516abf-3e31-4684-983b-7c6c2126cba4 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:46.556379 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6516abf-3e31-4684-983b-7c6c2126cba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:46.578426 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f6516abf-3e31-4684-983b-7c6c2126cba4 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:46.579657 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f6516abf-3e31-4684-983b-7c6c2126cba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:46.605763 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:46.679946 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1358/2706] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:46.693281 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da94931-ab3b-463d-a355-ec5f76672f07 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:46.695472 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-0da94931-ab3b-463d-a355-ec5f76672f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:46.779124 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da94931-ab3b-463d-a355-ec5f76672f07 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:46.783280 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff51dd-cb01-4bda-ae11-7cb900f20531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:46.783934 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff51dd-cb01-4bda-ae11-7cb900f20531 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:46.784217 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff51dd-cb01-4bda-ae11-7cb900f20531 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:46.784731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff51dd-cb01-4bda-ae11-7cb900f20531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:46.797108 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff51dd-cb01-4bda-ae11-7cb900f20531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:46.798650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff51dd-cb01-4bda-ae11-7cb900f20531 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:46.811693 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1349/2707] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:14:47.157415 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6516abf-3e31-4684-983b-7c6c2126cba4 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:47.159695 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f6516abf-3e31-4684-983b-7c6c2126cba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:47.188152 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6516abf-3e31-4684-983b-7c6c2126cba4 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:47.197115 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca985f0-8070-46c3-848c-13e4a181c13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:47.199216 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca985f0-8070-46c3-848c-13e4a181c13f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:47.199216 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca985f0-8070-46c3-848c-13e4a181c13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:47.199877 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca985f0-8070-46c3-848c-13e4a181c13f admin admin] PATH_INFO: `/v3/projects/19400ef83c03470b8056b1912561c093` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:47.201363 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca985f0-8070-46c3-848c-13e4a181c13f admin admin] RBAC: Authorizing `identity:delete_project(project_id=19400ef83c03470b8056b1912561c093)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:47.204607 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca985f0-8070-46c3-848c-13e4a181c13f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:47.272627 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-eca985f0-8070-46c3-848c-13e4a181c13f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19400ef83c03470b8056b1912561c093', 'request_id': 'req-eca985f0-8070-46c3-848c-13e4a181c13f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:47.280887 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-eca985f0-8070-46c3-848c-13e4a181c13f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19400ef83c03470b8056b1912561c093', 'request_id': 'req-eca985f0-8070-46c3-848c-13e4a181c13f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:47.288755 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-eca985f0-8070-46c3-848c-13e4a181c13f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19400ef83c03470b8056b1912561c093', 'request_id': 'req-eca985f0-8070-46c3-848c-13e4a181c13f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:47.310436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-eca985f0-8070-46c3-848c-13e4a181c13f admin admin] The token cache is being invalidate because project 19400ef83c03470b8056b1912561c093 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:14:47.310890 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-eca985f0-8070-46c3-848c-13e4a181c13f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:47.311706 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-eca985f0-8070-46c3-848c-13e4a181c13f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:47.313670 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1359/2708] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:14:47 2022] DELETE /identity/v3/projects/19400ef83c03470b8056b1912561c093 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:47.318089 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff51dd-cb01-4bda-ae11-7cb900f20531 service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:47.329250 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff51dd-cb01-4bda-ae11-7cb900f20531 service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:47.394290 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d0abe-1e74-4b53-a319-a5979228928b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:47.395395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d0abe-1e74-4b53-a319-a5979228928b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:47.395395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d0abe-1e74-4b53-a319-a5979228928b admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:47.395395 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d0abe-1e74-4b53-a319-a5979228928b admin admin] PATH_INFO: `/v3/users/00041baa21544fccb9fc74d2386478ba` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:47.396631 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d0abe-1e74-4b53-a319-a5979228928b admin admin] RBAC: Authorizing `identity:delete_user(user_id=00041baa21544fccb9fc74d2386478ba)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:47.398627 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d0abe-1e74-4b53-a319-a5979228928b admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:47.454218 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-c18d0abe-1e74-4b53-a319-a5979228928b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00041baa21544fccb9fc74d2386478ba'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:47.454923 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-c18d0abe-1e74-4b53-a319-a5979228928b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00041baa21544fccb9fc74d2386478ba'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:47.455576 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-c18d0abe-1e74-4b53-a319-a5979228928b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00041baa21544fccb9fc74d2386478ba'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:47.458552 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:47.464687 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-c18d0abe-1e74-4b53-a319-a5979228928b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00041baa21544fccb9fc74d2386478ba'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:47.481630 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-c18d0abe-1e74-4b53-a319-a5979228928b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00041baa21544fccb9fc74d2386478ba'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:47.496577 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1350/2709] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:14:47 2022] DELETE /identity/v3/users/00041baa21544fccb9fc74d2386478ba => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:47.877592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca985f0-8070-46c3-848c-13e4a181c13f admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:47.879822 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-eca985f0-8070-46c3-848c-13e4a181c13f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:47.911193 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca985f0-8070-46c3-848c-13e4a181c13f admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:48.023934 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb8e01-7873-4141-a4d7-b1c4cfc30b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:48.024402 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb8e01-7873-4141-a4d7-b1c4cfc30b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:48.024706 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb8e01-7873-4141-a4d7-b1c4cfc30b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:48.024969 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb8e01-7873-4141-a4d7-b1c4cfc30b3e admin admin] PATH_INFO: `/v3/projects/e1551e120ff2406b997c6dea9ac1d981` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:48.027603 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb8e01-7873-4141-a4d7-b1c4cfc30b3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1551e120ff2406b997c6dea9ac1d981)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:48.029656 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb8e01-7873-4141-a4d7-b1c4cfc30b3e admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:48.090514 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb550a-0ceb-4865-8fd9-bc02b2a8a9dc None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:48.092161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb550a-0ceb-4865-8fd9-bc02b2a8a9dc None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:48.092872 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb550a-0ceb-4865-8fd9-bc02b2a8a9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:48.130105 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-31cb550a-0ceb-4865-8fd9-bc02b2a8a9dc None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:48.132448 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-31cb550a-0ceb-4865-8fd9-bc02b2a8a9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:48.140110 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-2ecb8e01-7873-4141-a4d7-b1c4cfc30b3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1551e120ff2406b997c6dea9ac1d981', 'request_id': 'req-2ecb8e01-7873-4141-a4d7-b1c4cfc30b3e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:48.142121 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:48.154978 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-2ecb8e01-7873-4141-a4d7-b1c4cfc30b3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1551e120ff2406b997c6dea9ac1d981', 'request_id': 'req-2ecb8e01-7873-4141-a4d7-b1c4cfc30b3e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:48.171426 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-2ecb8e01-7873-4141-a4d7-b1c4cfc30b3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1551e120ff2406b997c6dea9ac1d981', 'request_id': 'req-2ecb8e01-7873-4141-a4d7-b1c4cfc30b3e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:48.202967 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-2ecb8e01-7873-4141-a4d7-b1c4cfc30b3e admin admin] The token cache is being invalidate because project e1551e120ff2406b997c6dea9ac1d981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:14:48.203466 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-2ecb8e01-7873-4141-a4d7-b1c4cfc30b3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:48.204779 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-2ecb8e01-7873-4141-a4d7-b1c4cfc30b3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:48.207788 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1360/2710] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:14:47 2022] DELETE /identity/v3/projects/e1551e120ff2406b997c6dea9ac1d981 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:48.214432 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d659c15-8fa8-46a3-8499-03686e04cb0f None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:48.214947 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d659c15-8fa8-46a3-8499-03686e04cb0f None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:48.215510 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d659c15-8fa8-46a3-8499-03686e04cb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:48.242709 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1351/2711] 10.222.0.69 () {58 vars in 1016 bytes} [Wed Jul 27 09:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:48.250526 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-7d659c15-8fa8-46a3-8499-03686e04cb0f None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:48.252782 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-7d659c15-8fa8-46a3-8499-03686e04cb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:48.279158 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb550a-0ceb-4865-8fd9-bc02b2a8a9dc None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:48.281566 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1361/2712] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:48.282895 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-31cb550a-0ceb-4865-8fd9-bc02b2a8a9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:48.290562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ac88f-def2-4c93-a3d1-e61543615039 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:48.290850 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ac88f-def2-4c93-a3d1-e61543615039 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:48.291125 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ac88f-def2-4c93-a3d1-e61543615039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:48.318154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-312ac88f-def2-4c93-a3d1-e61543615039 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:48.319464 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-312ac88f-def2-4c93-a3d1-e61543615039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:48.329751 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1362/2713] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:48.336407 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ac88f-def2-4c93-a3d1-e61543615039 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:48.348576 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ac88f-def2-4c93-a3d1-e61543615039 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:48.356291 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956e907-3bdb-4fc0-8178-7f9b1afdd406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:48.357088 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956e907-3bdb-4fc0-8178-7f9b1afdd406 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:48.357486 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956e907-3bdb-4fc0-8178-7f9b1afdd406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:48.358301 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956e907-3bdb-4fc0-8178-7f9b1afdd406 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:48.359216 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956e907-3bdb-4fc0-8178-7f9b1afdd406 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:14:48.359726 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956e907-3bdb-4fc0-8178-7f9b1afdd406 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:48.361435 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956e907-3bdb-4fc0-8178-7f9b1afdd406 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:48.380369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1363/2714] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 09:14:48.387626 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956e907-3bdb-4fc0-8178-7f9b1afdd406 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:48.403586 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956e907-3bdb-4fc0-8178-7f9b1afdd406 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:48.410157 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de9522-bb30-4ce1-be00-0f17384cae31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:48.410442 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de9522-bb30-4ce1-be00-0f17384cae31 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:48.411411 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de9522-bb30-4ce1-be00-0f17384cae31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:48.411411 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de9522-bb30-4ce1-be00-0f17384cae31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:48.411816 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de9522-bb30-4ce1-be00-0f17384cae31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:48.413959 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de9522-bb30-4ce1-be00-0f17384cae31 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:48.461695 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1364/2715] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:14:48 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:14:48.465325 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb550a-0ceb-4865-8fd9-bc02b2a8a9dc None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:48.465778 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de9522-bb30-4ce1-be00-0f17384cae31 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:48.584027 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:48.589542 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de9522-bb30-4ce1-be00-0f17384cae31 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:48.596134 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc61d1a-e0a0-408b-9d76-c00a6fbc1e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:48.596931 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc61d1a-e0a0-408b-9d76-c00a6fbc1e02 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:48.597288 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc61d1a-e0a0-408b-9d76-c00a6fbc1e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:48.597577 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc61d1a-e0a0-408b-9d76-c00a6fbc1e02 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:48.598421 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc61d1a-e0a0-408b-9d76-c00a6fbc1e02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:48.599579 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988834f-bc82-4736-8d0c-e29f4ea18eaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:48.600761 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc61d1a-e0a0-408b-9d76-c00a6fbc1e02 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:48.601287 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988834f-bc82-4736-8d0c-e29f4ea18eaa service nova] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:48.601896 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988834f-bc82-4736-8d0c-e29f4ea18eaa service nova] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:48.602253 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988834f-bc82-4736-8d0c-e29f4ea18eaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:48.624999 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988834f-bc82-4736-8d0c-e29f4ea18eaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:48.628061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988834f-bc82-4736-8d0c-e29f4ea18eaa service nova] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:48.631970 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1365/2716] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:14:48 2022] POST /identity/v3/users => generated 287 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:14:48.637818 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc61d1a-e0a0-408b-9d76-c00a6fbc1e02 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:48.649320 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc61d1a-e0a0-408b-9d76-c00a6fbc1e02 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:48.654517 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1352/2717] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:14:48.655797 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af14db-db3b-4380-95b7-ff03a0c7a1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:48.656434 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af14db-db3b-4380-95b7-ff03a0c7a1ca admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:48.656723 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af14db-db3b-4380-95b7-ff03a0c7a1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:48.657061 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af14db-db3b-4380-95b7-ff03a0c7a1ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:48.657813 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af14db-db3b-4380-95b7-ff03a0c7a1ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:48.659556 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af14db-db3b-4380-95b7-ff03a0c7a1ca admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:48.675541 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1366/2718] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:14:48.680174 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988834f-bc82-4736-8d0c-e29f4ea18eaa service nova] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:48.693497 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988834f-bc82-4736-8d0c-e29f4ea18eaa service nova] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:48.700117 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d44e0a-ef87-4793-8d50-23f73311d53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:48.700910 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d44e0a-ef87-4793-8d50-23f73311d53b admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:48.701372 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d44e0a-ef87-4793-8d50-23f73311d53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:48.701850 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d44e0a-ef87-4793-8d50-23f73311d53b admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:48.703027 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d44e0a-ef87-4793-8d50-23f73311d53b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:48.705235 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d44e0a-ef87-4793-8d50-23f73311d53b admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:48.718707 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1353/2719] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:14:48.723743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af14db-db3b-4380-95b7-ff03a0c7a1ca admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:48.736082 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af14db-db3b-4380-95b7-ff03a0c7a1ca admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:48.742602 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803f72c-784e-4971-bd91-cbf485eaf738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:48.743299 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803f72c-784e-4971-bd91-cbf485eaf738 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:48.743581 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803f72c-784e-4971-bd91-cbf485eaf738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:48.743893 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803f72c-784e-4971-bd91-cbf485eaf738 admin admin] PATH_INFO: `/v3/projects/0a78c17baecd40aa99120f6e02ef495e/users/8cc8ad5a65f34c088ca6af04d4cfd38a/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:48.763636 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d803f72c-784e-4971-bd91-cbf485eaf738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a78c17baecd40aa99120f6e02ef495e, user_id=8cc8ad5a65f34c088ca6af04d4cfd38a, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:48.766522 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d803f72c-784e-4971-bd91-cbf485eaf738 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:48.784853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1367/2720] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:14:48 2022] PUT /identity/v3/projects/0a78c17baecd40aa99120f6e02ef495e/users/8cc8ad5a65f34c088ca6af04d4cfd38a/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:48.797490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb688ac-ebc4-4b85-b273-5b77ec43fdd3 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:48.797779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb688ac-ebc4-4b85-b273-5b77ec43fdd3 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:48.798348 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb688ac-ebc4-4b85-b273-5b77ec43fdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:48.829602 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-1fb688ac-ebc4-4b85-b273-5b77ec43fdd3 None None] MFA Rules not processed for user `8cc8ad5a65f34c088ca6af04d4cfd38a`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:48.830943 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-1fb688ac-ebc4-4b85-b273-5b77ec43fdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:48.902773 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1354/2721] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:48.914459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803f72c-784e-4971-bd91-cbf485eaf738 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:48.916143 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d803f72c-784e-4971-bd91-cbf485eaf738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:48.971242 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=91,keystone:DELETE=3,keystone:INSERT=6 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:48.988389 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803f72c-784e-4971-bd91-cbf485eaf738 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:48.992032 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f48198-df3f-4242-89e5-1864acf30ba0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:48.992714 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f48198-df3f-4242-89e5-1864acf30ba0 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:48.992942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f48198-df3f-4242-89e5-1864acf30ba0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:48.993274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f48198-df3f-4242-89e5-1864acf30ba0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:49.004602 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f48198-df3f-4242-89e5-1864acf30ba0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:49.006070 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f48198-df3f-4242-89e5-1864acf30ba0 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:49.019092 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1368/2722] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:14:49.044157 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb688ac-ebc4-4b85-b273-5b77ec43fdd3 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:49.133621 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb688ac-ebc4-4b85-b273-5b77ec43fdd3 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:49.139031 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f07a3-0e7a-48d1-a649-9b9be3168149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:49.139685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f07a3-0e7a-48d1-a649-9b9be3168149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:49.139964 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f07a3-0e7a-48d1-a649-9b9be3168149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:49.140237 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f07a3-0e7a-48d1-a649-9b9be3168149 admin admin] PATH_INFO: `/v3/users/8cc8ad5a65f34c088ca6af04d4cfd38a` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:49.141435 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f07a3-0e7a-48d1-a649-9b9be3168149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cc8ad5a65f34c088ca6af04d4cfd38a)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:49.143534 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f07a3-0e7a-48d1-a649-9b9be3168149 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:49.205318 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-790f07a3-0e7a-48d1-a649-9b9be3168149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cc8ad5a65f34c088ca6af04d4cfd38a'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:49.206165 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-790f07a3-0e7a-48d1-a649-9b9be3168149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cc8ad5a65f34c088ca6af04d4cfd38a'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:49.207296 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-790f07a3-0e7a-48d1-a649-9b9be3168149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cc8ad5a65f34c088ca6af04d4cfd38a'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:49.217359 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-790f07a3-0e7a-48d1-a649-9b9be3168149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cc8ad5a65f34c088ca6af04d4cfd38a'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:49.232478 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-790f07a3-0e7a-48d1-a649-9b9be3168149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cc8ad5a65f34c088ca6af04d4cfd38a'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:49.233904 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:49.257043 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1355/2723] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:14:49 2022] DELETE /identity/v3/users/8cc8ad5a65f34c088ca6af04d4cfd38a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:49.262658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f99b0-f16b-4164-8f31-5e68a13477ca None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:49.262953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f99b0-f16b-4164-8f31-5e68a13477ca None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:49.263253 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f99b0-f16b-4164-8f31-5e68a13477ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:49.285647 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-948f99b0-f16b-4164-8f31-5e68a13477ca None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:49.286953 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-948f99b0-f16b-4164-8f31-5e68a13477ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:49.355574 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1369/2724] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:14:49.365488 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f07a3-0e7a-48d1-a649-9b9be3168149 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:49.366962 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-790f07a3-0e7a-48d1-a649-9b9be3168149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:49.429756 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f07a3-0e7a-48d1-a649-9b9be3168149 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:49.433947 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b7c04-b8a3-4104-9e8c-e340f7674916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:49.434625 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b7c04-b8a3-4104-9e8c-e340f7674916 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:49.435048 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b7c04-b8a3-4104-9e8c-e340f7674916 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:49.435250 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b7c04-b8a3-4104-9e8c-e340f7674916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:49.445198 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b7c04-b8a3-4104-9e8c-e340f7674916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:49.446688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b7c04-b8a3-4104-9e8c-e340f7674916 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:49.457555 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1356/2725] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:14:49.677793 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f99b0-f16b-4164-8f31-5e68a13477ca None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:49.679756 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-948f99b0-f16b-4164-8f31-5e68a13477ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:49.694424 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f99b0-f16b-4164-8f31-5e68a13477ca None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:49.701211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15319d6-34f9-496c-89f9-998142f0f44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:49.702111 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15319d6-34f9-496c-89f9-998142f0f44f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:49.702486 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15319d6-34f9-496c-89f9-998142f0f44f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:49.702711 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15319d6-34f9-496c-89f9-998142f0f44f admin admin] PATH_INFO: `/v3/users/970a36f7c78a43d29318e91670672166` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:49.703988 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15319d6-34f9-496c-89f9-998142f0f44f admin admin] RBAC: Authorizing `identity:delete_user(user_id=970a36f7c78a43d29318e91670672166)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:49.705952 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15319d6-34f9-496c-89f9-998142f0f44f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:49.775128 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a15319d6-34f9-496c-89f9-998142f0f44f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '970a36f7c78a43d29318e91670672166'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:49.785288 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a15319d6-34f9-496c-89f9-998142f0f44f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '970a36f7c78a43d29318e91670672166'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:49.786191 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a15319d6-34f9-496c-89f9-998142f0f44f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '970a36f7c78a43d29318e91670672166'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:49.789595 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b7c04-b8a3-4104-9e8c-e340f7674916 service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:49.792094 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-bf3b7c04-b8a3-4104-9e8c-e340f7674916 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:49.818109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b7c04-b8a3-4104-9e8c-e340f7674916 service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:49.828796 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a15319d6-34f9-496c-89f9-998142f0f44f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '970a36f7c78a43d29318e91670672166'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:49.829531 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a15319d6-34f9-496c-89f9-998142f0f44f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '970a36f7c78a43d29318e91670672166'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:49.836642 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdad54f-89fe-4b06-87f9-f36998370b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:49.839347 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdad54f-89fe-4b06-87f9-f36998370b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:49.840284 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdad54f-89fe-4b06-87f9-f36998370b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:49.840648 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdad54f-89fe-4b06-87f9-f36998370b65 admin admin] PATH_INFO: `/v3/projects/0a78c17baecd40aa99120f6e02ef495e` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:49.843297 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdad54f-89fe-4b06-87f9-f36998370b65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a78c17baecd40aa99120f6e02ef495e)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:49.847121 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdad54f-89fe-4b06-87f9-f36998370b65 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:49.847812 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1370/2726] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:14:49 2022] DELETE /identity/v3/users/970a36f7c78a43d29318e91670672166 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:14:49.853395 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ecf59-4b7e-4fe4-8939-3bb74111629f None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:49.854755 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ecf59-4b7e-4fe4-8939-3bb74111629f None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:49.855151 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ecf59-4b7e-4fe4-8939-3bb74111629f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:49.876580 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-068ecf59-4b7e-4fe4-8939-3bb74111629f None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:49.878153 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-068ecf59-4b7e-4fe4-8939-3bb74111629f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:49.937707 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-ccdad54f-89fe-4b06-87f9-f36998370b65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a78c17baecd40aa99120f6e02ef495e', 'request_id': 'req-ccdad54f-89fe-4b06-87f9-f36998370b65'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:49.943987 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-ccdad54f-89fe-4b06-87f9-f36998370b65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a78c17baecd40aa99120f6e02ef495e', 'request_id': 'req-ccdad54f-89fe-4b06-87f9-f36998370b65'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:49.949686 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:49.955236 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-ccdad54f-89fe-4b06-87f9-f36998370b65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a78c17baecd40aa99120f6e02ef495e', 'request_id': 'req-ccdad54f-89fe-4b06-87f9-f36998370b65'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:49.961502 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1371/2727] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:49.971779 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ecf59-4b7e-4fe4-8939-3bb74111629f None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:49.974181 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-068ecf59-4b7e-4fe4-8939-3bb74111629f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:49.979336 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-ccdad54f-89fe-4b06-87f9-f36998370b65 admin admin] The token cache is being invalidate because project 0a78c17baecd40aa99120f6e02ef495e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:14:49.980002 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-ccdad54f-89fe-4b06-87f9-f36998370b65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:49.981038 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-ccdad54f-89fe-4b06-87f9-f36998370b65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:49.983503 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1357/2728] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:14:49 2022] DELETE /identity/v3/projects/0a78c17baecd40aa99120f6e02ef495e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:49.990968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e9548-a976-4a6b-a7fb-aab9fd26b58d None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:49.991377 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e9548-a976-4a6b-a7fb-aab9fd26b58d None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:49.991865 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e9548-a976-4a6b-a7fb-aab9fd26b58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:50.020283 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-310e9548-a976-4a6b-a7fb-aab9fd26b58d None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:50.022868 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-310e9548-a976-4a6b-a7fb-aab9fd26b58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:50.050751 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ecf59-4b7e-4fe4-8939-3bb74111629f None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:50.127081 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1358/2729] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:14:50.139194 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ed9da-46ad-42c9-bd1e-790fdeceea97 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:50.139542 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ed9da-46ad-42c9-bd1e-790fdeceea97 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:50.141616 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ed9da-46ad-42c9-bd1e-790fdeceea97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:50.191543 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-ee5ed9da-46ad-42c9-bd1e-790fdeceea97 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:50.194511 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-ee5ed9da-46ad-42c9-bd1e-790fdeceea97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:50.196549 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991cc5dc-f2c4-4208-8fbe-065fb69a28a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:50.197467 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cc5dc-f2c4-4208-8fbe-065fb69a28a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:50.198271 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cc5dc-f2c4-4208-8fbe-065fb69a28a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:50.198907 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cc5dc-f2c4-4208-8fbe-065fb69a28a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:50.202561 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-991cc5dc-f2c4-4208-8fbe-065fb69a28a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:50.212799 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1359/2730] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:14:50.216043 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ed9da-46ad-42c9-bd1e-790fdeceea97 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:50.219105 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-ee5ed9da-46ad-42c9-bd1e-790fdeceea97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:50.232937 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991cc5dc-f2c4-4208-8fbe-065fb69a28a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:50.232937 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991cc5dc-f2c4-4208-8fbe-065fb69a28a1 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:50.243812 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ed9da-46ad-42c9-bd1e-790fdeceea97 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:50.249579 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1372/2731] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:14:50.251001 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991cc5dc-f2c4-4208-8fbe-065fb69a28a1 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:50.253179 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d59d7-a908-4cdd-8a42-6e7f2f393c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:50.254481 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d59d7-a908-4cdd-8a42-6e7f2f393c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:50.255055 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d59d7-a908-4cdd-8a42-6e7f2f393c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:50.257106 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d59d7-a908-4cdd-8a42-6e7f2f393c4f admin admin] PATH_INFO: `/v3/users/68401d36218d4e2899e515a77a58d40f` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:50.258135 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d59d7-a908-4cdd-8a42-6e7f2f393c4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=68401d36218d4e2899e515a77a58d40f)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:50.262654 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d59d7-a908-4cdd-8a42-6e7f2f393c4f admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:50.268196 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:50.277844 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991cc5dc-f2c4-4208-8fbe-065fb69a28a1 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:50.293635 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173add3-123f-4754-848f-0c8ed45376f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:50.295600 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173add3-123f-4754-848f-0c8ed45376f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:50.296086 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173add3-123f-4754-848f-0c8ed45376f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:50.296595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173add3-123f-4754-848f-0c8ed45376f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:50.298880 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173add3-123f-4754-848f-0c8ed45376f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:14:50.299449 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173add3-123f-4754-848f-0c8ed45376f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:50.304442 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173add3-123f-4754-848f-0c8ed45376f8 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:50.330674 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1373/2732] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:14:50.339152 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173add3-123f-4754-848f-0c8ed45376f8 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:50.361959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-504d59d7-a908-4cdd-8a42-6e7f2f393c4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68401d36218d4e2899e515a77a58d40f'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:50.363745 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-504d59d7-a908-4cdd-8a42-6e7f2f393c4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68401d36218d4e2899e515a77a58d40f'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:50.364817 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173add3-123f-4754-848f-0c8ed45376f8 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:50.365285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-504d59d7-a908-4cdd-8a42-6e7f2f393c4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68401d36218d4e2899e515a77a58d40f'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:50.375094 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea8851-c47e-4e71-983d-36ef3ba91b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:50.376286 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea8851-c47e-4e71-983d-36ef3ba91b83 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:50.376944 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea8851-c47e-4e71-983d-36ef3ba91b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:50.377474 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea8851-c47e-4e71-983d-36ef3ba91b83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:50.379064 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea8851-c47e-4e71-983d-36ef3ba91b83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:50.381594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-504d59d7-a908-4cdd-8a42-6e7f2f393c4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68401d36218d4e2899e515a77a58d40f'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:50.383243 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea8851-c47e-4e71-983d-36ef3ba91b83 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:50.408924 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-504d59d7-a908-4cdd-8a42-6e7f2f393c4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68401d36218d4e2899e515a77a58d40f'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:50.432911 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1360/2733] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:14:50 2022] DELETE /identity/v3/users/68401d36218d4e2899e515a77a58d40f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:50.438747 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2baf2-6ebf-41fe-ab4c-4e84d9f12ada None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:50.438747 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2baf2-6ebf-41fe-ab4c-4e84d9f12ada None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:50.439100 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2baf2-6ebf-41fe-ab4c-4e84d9f12ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:50.444472 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1374/2734] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:14:50 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:14:50.446568 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea8851-c47e-4e71-983d-36ef3ba91b83 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:50.449664 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b8ea8851-c47e-4e71-983d-36ef3ba91b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:50.465484 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-dfa2baf2-6ebf-41fe-ab4c-4e84d9f12ada None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:50.468249 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-dfa2baf2-6ebf-41fe-ab4c-4e84d9f12ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:50.568183 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1361/2735] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:14:50.570554 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea8851-c47e-4e71-983d-36ef3ba91b83 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:50.578428 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2baf2-6ebf-41fe-ab4c-4e84d9f12ada None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:50.580286 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65ada8-1e41-438b-bee0-472c20c6650f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:50.580727 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-dfa2baf2-6ebf-41fe-ab4c-4e84d9f12ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:50.581341 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65ada8-1e41-438b-bee0-472c20c6650f admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:50.581819 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65ada8-1e41-438b-bee0-472c20c6650f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:50.582479 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65ada8-1e41-438b-bee0-472c20c6650f admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:50.583778 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65ada8-1e41-438b-bee0-472c20c6650f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:50.588945 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65ada8-1e41-438b-bee0-472c20c6650f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:50.647914 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1375/2736] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:14:50 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:14:50.658600 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65ada8-1e41-438b-bee0-472c20c6650f admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:50.690681 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65ada8-1e41-438b-bee0-472c20c6650f admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:50.692044 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2baf2-6ebf-41fe-ab4c-4e84d9f12ada None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:50.699494 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f8741-e9eb-47d6-b581-154ae5d14ee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:50.700550 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f8741-e9eb-47d6-b581-154ae5d14ee0 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:50.700974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f8741-e9eb-47d6-b581-154ae5d14ee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:50.701386 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f8741-e9eb-47d6-b581-154ae5d14ee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:50.703237 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30193767-ec68-4753-922a-a129b98d1ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:50.705501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30193767-ec68-4753-922a-a129b98d1ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:50.706669 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30193767-ec68-4753-922a-a129b98d1ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:50.707601 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30193767-ec68-4753-922a-a129b98d1ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:50.709814 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30193767-ec68-4753-922a-a129b98d1ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:50.713991 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30193767-ec68-4753-922a-a129b98d1ee1 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:50.718458 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f8741-e9eb-47d6-b581-154ae5d14ee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:50.719990 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f8741-e9eb-47d6-b581-154ae5d14ee0 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:50.732116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1362/2737] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:14:50.733154 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1376/2738] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:14:50.737164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f8741-e9eb-47d6-b581-154ae5d14ee0 service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:50.747429 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f8741-e9eb-47d6-b581-154ae5d14ee0 service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:50.752886 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1db6e7-9948-4598-bd96-a581e3091d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:50.753518 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1db6e7-9948-4598-bd96-a581e3091d15 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:50.753799 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1db6e7-9948-4598-bd96-a581e3091d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:50.754074 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1db6e7-9948-4598-bd96-a581e3091d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:50.754826 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1db6e7-9948-4598-bd96-a581e3091d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:50.756462 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1db6e7-9948-4598-bd96-a581e3091d15 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:50.768055 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1363/2739] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:14:50.772576 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30193767-ec68-4753-922a-a129b98d1ee1 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:50.778697 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:50.785837 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30193767-ec68-4753-922a-a129b98d1ee1 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:50.793604 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada99c7-a6e8-4c26-888c-78ee6c8d8258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:50.794303 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada99c7-a6e8-4c26-888c-78ee6c8d8258 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:50.794633 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada99c7-a6e8-4c26-888c-78ee6c8d8258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:50.794909 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada99c7-a6e8-4c26-888c-78ee6c8d8258 admin admin] PATH_INFO: `/v3/projects/96eb808a6018456b834fa94526cb3403/users/2791fba0963c4919b8c513d3ccb1e7b3/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:50.815781 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada99c7-a6e8-4c26-888c-78ee6c8d8258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96eb808a6018456b834fa94526cb3403, user_id=2791fba0963c4919b8c513d3ccb1e7b3, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:50.818750 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada99c7-a6e8-4c26-888c-78ee6c8d8258 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:50.839846 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1377/2740] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:14:50 2022] PUT /identity/v3/projects/96eb808a6018456b834fa94526cb3403/users/2791fba0963c4919b8c513d3ccb1e7b3/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:14:50.851279 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dff8df-bc60-4bce-ad34-e033bab053bc None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:50.851870 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dff8df-bc60-4bce-ad34-e033bab053bc None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:50.851870 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dff8df-bc60-4bce-ad34-e033bab053bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:50.880401 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:50.887380 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-92dff8df-bc60-4bce-ad34-e033bab053bc None None] MFA Rules not processed for user `2791fba0963c4919b8c513d3ccb1e7b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:50.890000 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-92dff8df-bc60-4bce-ad34-e033bab053bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:50.983070 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1364/2741] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:51.001275 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada99c7-a6e8-4c26-888c-78ee6c8d8258 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:51.004189 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-5ada99c7-a6e8-4c26-888c-78ee6c8d8258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:51.039372 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dff8df-bc60-4bce-ad34-e033bab053bc None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:51.042821 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-92dff8df-bc60-4bce-ad34-e033bab053bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:51.107777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada99c7-a6e8-4c26-888c-78ee6c8d8258 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:51.119680 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32969356-ede0-4ff0-88e5-bac6c9b713a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:51.121169 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32969356-ede0-4ff0-88e5-bac6c9b713a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:51.121709 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32969356-ede0-4ff0-88e5-bac6c9b713a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:51.122418 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32969356-ede0-4ff0-88e5-bac6c9b713a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:51.134686 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32969356-ede0-4ff0-88e5-bac6c9b713a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:51.137095 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32969356-ede0-4ff0-88e5-bac6c9b713a3 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:51.175912 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dff8df-bc60-4bce-ad34-e033bab053bc None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:51.177878 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1378/2742] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:14:51.188278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4af00-149b-4413-b508-2efcc67df1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:51.190559 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4af00-149b-4413-b508-2efcc67df1ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:51.191312 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4af00-149b-4413-b508-2efcc67df1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:51.191984 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4af00-149b-4413-b508-2efcc67df1ad admin admin] PATH_INFO: `/v3/projects/789723ba000447ed8d668538ef255f40` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:51.194796 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4af00-149b-4413-b508-2efcc67df1ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=789723ba000447ed8d668538ef255f40)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:51.199892 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4af00-149b-4413-b508-2efcc67df1ad admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:51.292490 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-dde4af00-149b-4413-b508-2efcc67df1ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '789723ba000447ed8d668538ef255f40', 'request_id': 'req-dde4af00-149b-4413-b508-2efcc67df1ad'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:51.308464 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-dde4af00-149b-4413-b508-2efcc67df1ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '789723ba000447ed8d668538ef255f40', 'request_id': 'req-dde4af00-149b-4413-b508-2efcc67df1ad'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:51.323197 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-dde4af00-149b-4413-b508-2efcc67df1ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '789723ba000447ed8d668538ef255f40', 'request_id': 'req-dde4af00-149b-4413-b508-2efcc67df1ad'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:51.325625 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32969356-ede0-4ff0-88e5-bac6c9b713a3 service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:51.327295 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-32969356-ede0-4ff0-88e5-bac6c9b713a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:51.351758 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32969356-ede0-4ff0-88e5-bac6c9b713a3 service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:51.356236 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-dde4af00-149b-4413-b508-2efcc67df1ad admin admin] The token cache is being invalidate because project 789723ba000447ed8d668538ef255f40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:14:51.356862 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-dde4af00-149b-4413-b508-2efcc67df1ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:51.357801 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-dde4af00-149b-4413-b508-2efcc67df1ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:51.362996 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1365/2743] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:14:51 2022] DELETE /identity/v3/projects/789723ba000447ed8d668538ef255f40 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:14:51.372358 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd849828-2d26-40d8-8160-b523d5367138 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:51.372816 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd849828-2d26-40d8-8160-b523d5367138 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:51.373296 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd849828-2d26-40d8-8160-b523d5367138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:51.398929 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-bd849828-2d26-40d8-8160-b523d5367138 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:51.400166 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-bd849828-2d26-40d8-8160-b523d5367138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:51.429142 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a8858-8ead-4b54-9fe0-1132b3ac86c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:51.429749 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a8858-8ead-4b54-9fe0-1132b3ac86c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:51.430046 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a8858-8ead-4b54-9fe0-1132b3ac86c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:51.430301 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a8858-8ead-4b54-9fe0-1132b3ac86c6 admin admin] PATH_INFO: `/v3/projects/37fb402b03a44a4e8e8bd0110be4c389` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:51.431743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a8858-8ead-4b54-9fe0-1132b3ac86c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37fb402b03a44a4e8e8bd0110be4c389)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:51.433770 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a8858-8ead-4b54-9fe0-1132b3ac86c6 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:51.445926 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:51.492730 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1366/2744] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:14:51.495435 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf041a-e890-4f1f-9fd6-8e9957d8546d None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:51.495975 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf041a-e890-4f1f-9fd6-8e9957d8546d None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:51.496336 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf041a-e890-4f1f-9fd6-8e9957d8546d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:51.532441 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-a4cf041a-e890-4f1f-9fd6-8e9957d8546d None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:51.534940 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-a4cf041a-e890-4f1f-9fd6-8e9957d8546d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:51.543019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-713a8858-8ead-4b54-9fe0-1132b3ac86c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37fb402b03a44a4e8e8bd0110be4c389', 'request_id': 'req-713a8858-8ead-4b54-9fe0-1132b3ac86c6'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:51.557373 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-713a8858-8ead-4b54-9fe0-1132b3ac86c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37fb402b03a44a4e8e8bd0110be4c389', 'request_id': 'req-713a8858-8ead-4b54-9fe0-1132b3ac86c6'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:51.584915 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-713a8858-8ead-4b54-9fe0-1132b3ac86c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37fb402b03a44a4e8e8bd0110be4c389', 'request_id': 'req-713a8858-8ead-4b54-9fe0-1132b3ac86c6'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:51.611068 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-713a8858-8ead-4b54-9fe0-1132b3ac86c6 admin admin] The token cache is being invalidate because project 37fb402b03a44a4e8e8bd0110be4c389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:14:51.611390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-713a8858-8ead-4b54-9fe0-1132b3ac86c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:51.612896 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-713a8858-8ead-4b54-9fe0-1132b3ac86c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:51.616066 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1379/2745] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:14:51 2022] DELETE /identity/v3/projects/37fb402b03a44a4e8e8bd0110be4c389 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:51.617047 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a8858-8ead-4b54-9fe0-1132b3ac86c6 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:51.623451 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-713a8858-8ead-4b54-9fe0-1132b3ac86c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:51.640751 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:51.690463 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1367/2746] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:51.694197 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4c0d6-6292-46e3-9abb-3902de77e5e2 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:51.695573 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4c0d6-6292-46e3-9abb-3902de77e5e2 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:51.696553 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4c0d6-6292-46e3-9abb-3902de77e5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:51.704489 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a8858-8ead-4b54-9fe0-1132b3ac86c6 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:51.708833 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44c414-8148-4c8c-b4b3-b7995fa29741 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:51.709593 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44c414-8148-4c8c-b4b3-b7995fa29741 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:51.709884 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44c414-8148-4c8c-b4b3-b7995fa29741 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:51.710229 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44c414-8148-4c8c-b4b3-b7995fa29741 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:51.712315 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4b44c414-8148-4c8c-b4b3-b7995fa29741 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:51.730453 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-39d4c0d6-6292-46e3-9abb-3902de77e5e2 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:51.731717 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-39d4c0d6-6292-46e3-9abb-3902de77e5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:51.740557 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1368/2747] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:51.741421 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4c0d6-6292-46e3-9abb-3902de77e5e2 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:51.754189 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4c0d6-6292-46e3-9abb-3902de77e5e2 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:51.760925 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eede2cd-3aa2-4c4f-b106-9b1b5816a7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:51.761637 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eede2cd-3aa2-4c4f-b106-9b1b5816a7ca admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:51.761930 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eede2cd-3aa2-4c4f-b106-9b1b5816a7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:51.762236 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eede2cd-3aa2-4c4f-b106-9b1b5816a7ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:51.762956 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eede2cd-3aa2-4c4f-b106-9b1b5816a7ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:14:51.763262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eede2cd-3aa2-4c4f-b106-9b1b5816a7ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:51.766234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eede2cd-3aa2-4c4f-b106-9b1b5816a7ca admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:51.782426 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1369/2748] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:14:51.783964 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d1ae1-1652-4713-8b7f-b38e8352e64c None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:51.784283 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d1ae1-1652-4713-8b7f-b38e8352e64c None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:51.784563 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d1ae1-1652-4713-8b7f-b38e8352e64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:51.812742 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-642d1ae1-1652-4713-8b7f-b38e8352e64c None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:51.813994 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-642d1ae1-1652-4713-8b7f-b38e8352e64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:51.823410 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1370/2749] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:51.824149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d1ae1-1652-4713-8b7f-b38e8352e64c None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:51.835487 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d1ae1-1652-4713-8b7f-b38e8352e64c None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:51.842048 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f817e9-81e9-41ac-98f8-d972fab4f557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:51.842728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f817e9-81e9-41ac-98f8-d972fab4f557 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:51.843003 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f817e9-81e9-41ac-98f8-d972fab4f557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:51.843273 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f817e9-81e9-41ac-98f8-d972fab4f557 admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:51.843940 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f817e9-81e9-41ac-98f8-d972fab4f557 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:51.844656 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44c414-8148-4c8c-b4b3-b7995fa29741 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:51.846580 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f817e9-81e9-41ac-98f8-d972fab4f557 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:51.847488 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44c414-8148-4c8c-b4b3-b7995fa29741 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:51.870054 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1380/2750] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:14:51.871781 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44c414-8148-4c8c-b4b3-b7995fa29741 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:51.886218 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1371/2751] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:14:51 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:14:51.892394 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f817e9-81e9-41ac-98f8-d972fab4f557 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:51.899478 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44c414-8148-4c8c-b4b3-b7995fa29741 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:52.002724 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f817e9-81e9-41ac-98f8-d972fab4f557 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:52.006120 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476b605-9930-47fb-9e39-fac62b78350d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:52.007466 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476b605-9930-47fb-9e39-fac62b78350d admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:52.007957 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476b605-9930-47fb-9e39-fac62b78350d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:52.008419 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476b605-9930-47fb-9e39-fac62b78350d admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:52.011126 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476b605-9930-47fb-9e39-fac62b78350d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:14:52.011126 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476b605-9930-47fb-9e39-fac62b78350d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:52.011504 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa92ca-ee13-4e62-9423-1d276a81546a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:52.011662 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa92ca-ee13-4e62-9423-1d276a81546a admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:52.012021 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa92ca-ee13-4e62-9423-1d276a81546a admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:52.012230 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa92ca-ee13-4e62-9423-1d276a81546a admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:52.012857 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa92ca-ee13-4e62-9423-1d276a81546a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:52.013500 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476b605-9930-47fb-9e39-fac62b78350d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:52.015552 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa92ca-ee13-4e62-9423-1d276a81546a admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:52.039085 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1381/2752] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:14:52.043169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1372/2753] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:14:51 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:14:52.046914 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476b605-9930-47fb-9e39-fac62b78350d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:52.047299 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa92ca-ee13-4e62-9423-1d276a81546a admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:52.061077 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa92ca-ee13-4e62-9423-1d276a81546a admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:52.066008 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476b605-9930-47fb-9e39-fac62b78350d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:52.070075 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccf8d9-26de-4469-ad03-1816bffa128f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:52.071573 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccf8d9-26de-4469-ad03-1816bffa128f admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:52.072962 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccf8d9-26de-4469-ad03-1816bffa128f admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:52.073287 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccf8d9-26de-4469-ad03-1816bffa128f admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:52.074807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ccf8d9-26de-4469-ad03-1816bffa128f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:52.075787 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52092e-a6a8-4f58-8a18-347bf6c2c741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:52.076897 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52092e-a6a8-4f58-8a18-347bf6c2c741 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:52.077395 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52092e-a6a8-4f58-8a18-347bf6c2c741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:52.077942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52092e-a6a8-4f58-8a18-347bf6c2c741 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:52.078724 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ccf8d9-26de-4469-ad03-1816bffa128f admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:52.080161 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52092e-a6a8-4f58-8a18-347bf6c2c741 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:52.083432 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52092e-a6a8-4f58-8a18-347bf6c2c741 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:52.097079 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1373/2754] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:14:52.101372 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccf8d9-26de-4469-ad03-1816bffa128f admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:52.109136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:52.114030 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccf8d9-26de-4469-ad03-1816bffa128f admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:52.122672 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764273d0-1af6-42ce-b511-73c39d95ca4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:52.123456 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764273d0-1af6-42ce-b511-73c39d95ca4b admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:52.123751 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764273d0-1af6-42ce-b511-73c39d95ca4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:52.124001 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764273d0-1af6-42ce-b511-73c39d95ca4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:52.124714 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764273d0-1af6-42ce-b511-73c39d95ca4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:52.127194 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764273d0-1af6-42ce-b511-73c39d95ca4b admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:52.139726 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1374/2755] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:14:52.144176 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764273d0-1af6-42ce-b511-73c39d95ca4b admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:52.148811 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1382/2756] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:14:52 2022] POST /identity/v3/projects => generated 397 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:14:52.156702 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52092e-a6a8-4f58-8a18-347bf6c2c741 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:52.158082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764273d0-1af6-42ce-b511-73c39d95ca4b admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:52.220502 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:52.265620 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0cf1c-5770-4982-8722-701444e01c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:52.266726 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0cf1c-5770-4982-8722-701444e01c83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:52.267196 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0cf1c-5770-4982-8722-701444e01c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:52.267674 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0cf1c-5770-4982-8722-701444e01c83 admin admin] PATH_INFO: `/v3/projects/f8b769c6a460471ca7e9720a3389e357/users/3f0f4f521df849659c5100eb87d1d46a/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:52.294025 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0cf1c-5770-4982-8722-701444e01c83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8b769c6a460471ca7e9720a3389e357, user_id=3f0f4f521df849659c5100eb87d1d46a, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:52.294685 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52092e-a6a8-4f58-8a18-347bf6c2c741 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:52.299628 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0cf1c-5770-4982-8722-701444e01c83 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:52.303812 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e99d99-ff05-4e3d-b9ce-87c3c9a7ef00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:52.304968 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e99d99-ff05-4e3d-b9ce-87c3c9a7ef00 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:52.306021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e99d99-ff05-4e3d-b9ce-87c3c9a7ef00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:52.306021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e99d99-ff05-4e3d-b9ce-87c3c9a7ef00 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:52.308248 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e99d99-ff05-4e3d-b9ce-87c3c9a7ef00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:52.311593 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e99d99-ff05-4e3d-b9ce-87c3c9a7ef00 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:52.337113 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1375/2757] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:14:52 2022] PUT /identity/v3/projects/f8b769c6a460471ca7e9720a3389e357/users/3f0f4f521df849659c5100eb87d1d46a/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:52.342356 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c4b32-a0fd-4af5-af9d-101a908c4e53 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:52.342955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c4b32-a0fd-4af5-af9d-101a908c4e53 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:52.343343 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c4b32-a0fd-4af5-af9d-101a908c4e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:52.354541 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1383/2758] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:14:52 2022] POST /identity/v3/users => generated 299 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:14:52.360245 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e99d99-ff05-4e3d-b9ce-87c3c9a7ef00 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:52.378266 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e99d99-ff05-4e3d-b9ce-87c3c9a7ef00 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:52.397396 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-bf6c4b32-a0fd-4af5-af9d-101a908c4e53 None None] MFA Rules not processed for user `3f0f4f521df849659c5100eb87d1d46a`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:52.399488 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-bf6c4b32-a0fd-4af5-af9d-101a908c4e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:52.504328 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284b8ca-04ec-4a53-b816-a25f3dabab61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:52.506048 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284b8ca-04ec-4a53-b816-a25f3dabab61 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:52.506245 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284b8ca-04ec-4a53-b816-a25f3dabab61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:52.506846 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284b8ca-04ec-4a53-b816-a25f3dabab61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:52.508217 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284b8ca-04ec-4a53-b816-a25f3dabab61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:52.512317 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284b8ca-04ec-4a53-b816-a25f3dabab61 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:52.525932 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1376/2759] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:52.531416 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c4b32-a0fd-4af5-af9d-101a908c4e53 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:52.539867 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1384/2760] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:14:52.542013 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284b8ca-04ec-4a53-b816-a25f3dabab61 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:52.548135 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c4b32-a0fd-4af5-af9d-101a908c4e53 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:52.554848 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9addb038-478c-41e3-9a66-1c3337e521d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:52.555673 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addb038-478c-41e3-9a66-1c3337e521d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:52.556131 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addb038-478c-41e3-9a66-1c3337e521d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:52.556594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addb038-478c-41e3-9a66-1c3337e521d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:52.557371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9addb038-478c-41e3-9a66-1c3337e521d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:52.559599 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9addb038-478c-41e3-9a66-1c3337e521d0 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:52.560613 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284b8ca-04ec-4a53-b816-a25f3dabab61 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:52.568774 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0897a-8b16-44bf-ba4d-51662190d76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:52.569553 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0897a-8b16-44bf-ba4d-51662190d76e admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:52.569912 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0897a-8b16-44bf-ba4d-51662190d76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:52.570193 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0897a-8b16-44bf-ba4d-51662190d76e admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:52.571112 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0897a-8b16-44bf-ba4d-51662190d76e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:52.573708 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0897a-8b16-44bf-ba4d-51662190d76e admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:52.588475 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1385/2761] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:14:52.594438 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0897a-8b16-44bf-ba4d-51662190d76e admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:52.603833 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1377/2762] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:14:52 2022] POST /identity/v3/projects => generated 375 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:14:52.608795 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0897a-8b16-44bf-ba4d-51662190d76e admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:52.609064 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9addb038-478c-41e3-9a66-1c3337e521d0 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:52.669861 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:52.696112 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9addb038-478c-41e3-9a66-1c3337e521d0 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:52.696425 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520db89-4204-492c-927c-6a33dd475427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:52.697380 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520db89-4204-492c-927c-6a33dd475427 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:52.697664 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520db89-4204-492c-927c-6a33dd475427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:52.697937 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520db89-4204-492c-927c-6a33dd475427 admin admin] PATH_INFO: `/v3/projects/4cca320b1fcf487094328952d0c09d5e/users/cfdc4457180c4413b1b2bf3d226b226d/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:52.704464 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1576d-15e1-40c6-bfb0-aaa86dc8753b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:52.705094 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1576d-15e1-40c6-bfb0-aaa86dc8753b admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:52.705369 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1576d-15e1-40c6-bfb0-aaa86dc8753b admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:52.705650 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1576d-15e1-40c6-bfb0-aaa86dc8753b admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:52.708211 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1576d-15e1-40c6-bfb0-aaa86dc8753b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:52.710477 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1576d-15e1-40c6-bfb0-aaa86dc8753b admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:52.725325 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520db89-4204-492c-927c-6a33dd475427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cca320b1fcf487094328952d0c09d5e, user_id=cfdc4457180c4413b1b2bf3d226b226d, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:52.730994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520db89-4204-492c-927c-6a33dd475427 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:52.736061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1378/2763] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:14:52 2022] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:14:52.737371 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11436317-2b21-4ca0-a383-b4a3e8eddda5 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:52.737749 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11436317-2b21-4ca0-a383-b4a3e8eddda5 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:52.737938 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11436317-2b21-4ca0-a383-b4a3e8eddda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:52.764556 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-11436317-2b21-4ca0-a383-b4a3e8eddda5 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:52.766906 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-11436317-2b21-4ca0-a383-b4a3e8eddda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:52.778767 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1386/2764] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:14:52 2022] PUT /identity/v3/projects/4cca320b1fcf487094328952d0c09d5e/users/cfdc4457180c4413b1b2bf3d226b226d/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:52.780072 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520db89-4204-492c-927c-6a33dd475427 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:52.823172 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:52.891543 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1379/2765] 10.222.0.69 () {58 vars in 1016 bytes} [Wed Jul 27 09:14:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:52.894741 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ea66f-0659-40ef-afaf-927027657dd5 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:52.895343 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ea66f-0659-40ef-afaf-927027657dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:52.895879 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ea66f-0659-40ef-afaf-927027657dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:52.897417 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520db89-4204-492c-927c-6a33dd475427 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:52.905216 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db2b72-7924-41bc-b96f-964b69550e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:52.906208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db2b72-7924-41bc-b96f-964b69550e84 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:52.906671 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db2b72-7924-41bc-b96f-964b69550e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:52.907062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db2b72-7924-41bc-b96f-964b69550e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:52.907949 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db2b72-7924-41bc-b96f-964b69550e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:52.910537 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db2b72-7924-41bc-b96f-964b69550e84 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:52.929740 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1387/2766] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:14:52.935733 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db2b72-7924-41bc-b96f-964b69550e84 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:52.937978 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c3db2b72-7924-41bc-b96f-964b69550e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:52.960872 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-897ea66f-0659-40ef-afaf-927027657dd5 None None] MFA Rules not processed for user `cfdc4457180c4413b1b2bf3d226b226d`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:52.963235 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-897ea66f-0659-40ef-afaf-927027657dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:53.080765 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db2b72-7924-41bc-b96f-964b69550e84 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:53.089645 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07a8fb-ca5c-4a39-8dd8-b4233cb57731 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:53.090627 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07a8fb-ca5c-4a39-8dd8-b4233cb57731 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:53.091108 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07a8fb-ca5c-4a39-8dd8-b4233cb57731 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:53.091569 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07a8fb-ca5c-4a39-8dd8-b4233cb57731 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:53.105879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07a8fb-ca5c-4a39-8dd8-b4233cb57731 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:53.108773 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07a8fb-ca5c-4a39-8dd8-b4233cb57731 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:53.121776 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1380/2767] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:53.121776 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ea66f-0659-40ef-afaf-927027657dd5 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:53.152796 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ea66f-0659-40ef-afaf-927027657dd5 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:53.161420 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1388/2768] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:14:53.162355 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3632f7-d757-405f-bd56-b1595de60153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:53.163526 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07a8fb-ca5c-4a39-8dd8-b4233cb57731 service nova] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:53.163904 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3632f7-d757-405f-bd56-b1595de60153 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:53.164881 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3632f7-d757-405f-bd56-b1595de60153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:53.165308 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3632f7-d757-405f-bd56-b1595de60153 admin admin] PATH_INFO: `/v3/projects/cafc5a7e15174631ada2c5eb345bca9d/users/2b5d762e6cfc476a8a97bc6cf412e6d3/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:53.172976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-2d07a8fb-ca5c-4a39-8dd8-b4233cb57731 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:53.204419 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3632f7-d757-405f-bd56-b1595de60153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cafc5a7e15174631ada2c5eb345bca9d, user_id=2b5d762e6cfc476a8a97bc6cf412e6d3, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:53.210888 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3632f7-d757-405f-bd56-b1595de60153 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:53.270786 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1381/2769] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:14:53 2022] PUT /identity/v3/projects/cafc5a7e15174631ada2c5eb345bca9d/users/2b5d762e6cfc476a8a97bc6cf412e6d3/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:53.278006 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3632f7-d757-405f-bd56-b1595de60153 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:53.339755 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07a8fb-ca5c-4a39-8dd8-b4233cb57731 service nova] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:53.400917 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:53.432534 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3632f7-d757-405f-bd56-b1595de60153 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:53.450080 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968f22f-3917-4fbb-aa3f-04fddf21dc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:53.451152 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968f22f-3917-4fbb-aa3f-04fddf21dc70 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:53.451541 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968f22f-3917-4fbb-aa3f-04fddf21dc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:53.452259 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968f22f-3917-4fbb-aa3f-04fddf21dc70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:53.453712 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968f22f-3917-4fbb-aa3f-04fddf21dc70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:53.456373 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968f22f-3917-4fbb-aa3f-04fddf21dc70 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:53.468730 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2bf37-531f-45bf-b34b-519d1c5addad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:53.469834 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2bf37-531f-45bf-b34b-519d1c5addad service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:53.470350 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2bf37-531f-45bf-b34b-519d1c5addad service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:53.471213 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2bf37-531f-45bf-b34b-519d1c5addad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:53.478275 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1382/2770] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:14:53.479699 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968f22f-3917-4fbb-aa3f-04fddf21dc70 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:53.493593 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968f22f-3917-4fbb-aa3f-04fddf21dc70 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:53.500891 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:53.506601 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2fb2a-0205-4da1-8489-b8acf52666de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:53.507424 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2fb2a-0205-4da1-8489-b8acf52666de admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:53.507908 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2fb2a-0205-4da1-8489-b8acf52666de admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:53.508402 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2fb2a-0205-4da1-8489-b8acf52666de admin admin] PATH_INFO: `/v3/projects/cafc5a7e15174631ada2c5eb345bca9d/users/2b5d762e6cfc476a8a97bc6cf412e6d3/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:53.511503 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2fb2a-0205-4da1-8489-b8acf52666de admin admin] RBAC: Authorizing `identity:create_grant(project_id=cafc5a7e15174631ada2c5eb345bca9d, user_id=2b5d762e6cfc476a8a97bc6cf412e6d3, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:53.514535 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2fb2a-0205-4da1-8489-b8acf52666de admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:53.529384 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1383/2771] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:14:53 2022] PUT /identity/v3/projects/cafc5a7e15174631ada2c5eb345bca9d/users/2b5d762e6cfc476a8a97bc6cf412e6d3/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:53.548504 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded60a3f-2c42-45a3-8a59-ba1355e2d533 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:53.549200 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded60a3f-2c42-45a3-8a59-ba1355e2d533 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:53.549600 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded60a3f-2c42-45a3-8a59-ba1355e2d533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:53.612466 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2bf37-531f-45bf-b34b-519d1c5addad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:53.615115 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2bf37-531f-45bf-b34b-519d1c5addad service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:53.629974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-ded60a3f-2c42-45a3-8a59-ba1355e2d533 None None] MFA Rules not processed for user `2b5d762e6cfc476a8a97bc6cf412e6d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:53.633458 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-ded60a3f-2c42-45a3-8a59-ba1355e2d533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:53.636749 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1389/2772] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:14:53.815562 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1384/2773] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:14:53.869240 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2bf37-531f-45bf-b34b-519d1c5addad service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:53.889865 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2bf37-531f-45bf-b34b-519d1c5addad service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:53.973302 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108521a7-e74f-4d03-8620-13251827a95f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:53.973942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108521a7-e74f-4d03-8620-13251827a95f service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:53.974220 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108521a7-e74f-4d03-8620-13251827a95f service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:53.974522 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108521a7-e74f-4d03-8620-13251827a95f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:54.072506 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108521a7-e74f-4d03-8620-13251827a95f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:54.074353 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108521a7-e74f-4d03-8620-13251827a95f service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:54.086113 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1390/2774] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:14:54.416594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded60a3f-2c42-45a3-8a59-ba1355e2d533 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:54.419327 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-ded60a3f-2c42-45a3-8a59-ba1355e2d533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:54.573402 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded60a3f-2c42-45a3-8a59-ba1355e2d533 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:54.581957 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc25ef7-f502-4e38-a815-24f20784e04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:54.582888 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc25ef7-f502-4e38-a815-24f20784e04c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:54.583849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc25ef7-f502-4e38-a815-24f20784e04c admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:54.584381 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc25ef7-f502-4e38-a815-24f20784e04c admin admin] PATH_INFO: `/v3/users/2791fba0963c4919b8c513d3ccb1e7b3` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:54.586206 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc25ef7-f502-4e38-a815-24f20784e04c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2791fba0963c4919b8c513d3ccb1e7b3)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:54.589555 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc25ef7-f502-4e38-a815-24f20784e04c admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:54.694099 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108521a7-e74f-4d03-8620-13251827a95f service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:54.696323 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-108521a7-e74f-4d03-8620-13251827a95f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:54.708800 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-bdc25ef7-f502-4e38-a815-24f20784e04c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2791fba0963c4919b8c513d3ccb1e7b3'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:54.710227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-bdc25ef7-f502-4e38-a815-24f20784e04c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2791fba0963c4919b8c513d3ccb1e7b3'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:54.711243 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-bdc25ef7-f502-4e38-a815-24f20784e04c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2791fba0963c4919b8c513d3ccb1e7b3'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:54.714817 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:54.722767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-bdc25ef7-f502-4e38-a815-24f20784e04c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2791fba0963c4919b8c513d3ccb1e7b3'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:54.742215 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-bdc25ef7-f502-4e38-a815-24f20784e04c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2791fba0963c4919b8c513d3ccb1e7b3'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:54.759968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1385/2775] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:14:54 2022] DELETE /identity/v3/users/2791fba0963c4919b8c513d3ccb1e7b3 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:54.764627 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0c1e9-07e1-4d38-a69f-9ca5e1838b91 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:54.765036 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0c1e9-07e1-4d38-a69f-9ca5e1838b91 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:54.765206 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0c1e9-07e1-4d38-a69f-9ca5e1838b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:54.788109 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-bdb0c1e9-07e1-4d38-a69f-9ca5e1838b91 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:54.789761 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-bdb0c1e9-07e1-4d38-a69f-9ca5e1838b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:54.821178 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108521a7-e74f-4d03-8620-13251827a95f service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:54.858897 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:54.892172 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1386/2776] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:54.904366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0c1e9-07e1-4d38-a69f-9ca5e1838b91 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:54.906170 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-bdb0c1e9-07e1-4d38-a69f-9ca5e1838b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:54.918521 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f876b-5bf0-44ae-886d-48a3682b42ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:54.919542 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f876b-5bf0-44ae-886d-48a3682b42ef service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:54.919957 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f876b-5bf0-44ae-886d-48a3682b42ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:54.920430 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f876b-5bf0-44ae-886d-48a3682b42ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:54.923665 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-244f876b-5bf0-44ae-886d-48a3682b42ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:54.975097 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0c1e9-07e1-4d38-a69f-9ca5e1838b91 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:54.980006 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af632fe-542e-4bf2-9bd4-919bb46a8853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:54.980649 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af632fe-542e-4bf2-9bd4-919bb46a8853 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:54.980953 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af632fe-542e-4bf2-9bd4-919bb46a8853 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:54.981226 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af632fe-542e-4bf2-9bd4-919bb46a8853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:54.996076 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af632fe-542e-4bf2-9bd4-919bb46a8853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:54.997765 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af632fe-542e-4bf2-9bd4-919bb46a8853 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:55.016253 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1387/2777] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:14:55.059148 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f876b-5bf0-44ae-886d-48a3682b42ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:55.062065 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f876b-5bf0-44ae-886d-48a3682b42ef service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:55.085706 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1391/2778] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:14:55.480488 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af632fe-542e-4bf2-9bd4-919bb46a8853 service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:55.482418 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-6af632fe-542e-4bf2-9bd4-919bb46a8853 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:55.503146 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af632fe-542e-4bf2-9bd4-919bb46a8853 service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:55.509082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737eba3-628a-41b6-947e-2250653c7c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:55.509823 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737eba3-628a-41b6-947e-2250653c7c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:55.510114 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737eba3-628a-41b6-947e-2250653c7c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:55.510462 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737eba3-628a-41b6-947e-2250653c7c25 admin admin] PATH_INFO: `/v3/projects/96eb808a6018456b834fa94526cb3403` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:55.511784 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737eba3-628a-41b6-947e-2250653c7c25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96eb808a6018456b834fa94526cb3403)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:55.513832 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737eba3-628a-41b6-947e-2250653c7c25 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:55.597286 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-8737eba3-628a-41b6-947e-2250653c7c25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96eb808a6018456b834fa94526cb3403', 'request_id': 'req-8737eba3-628a-41b6-947e-2250653c7c25'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:55.608496 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-8737eba3-628a-41b6-947e-2250653c7c25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96eb808a6018456b834fa94526cb3403', 'request_id': 'req-8737eba3-628a-41b6-947e-2250653c7c25'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:55.620849 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-8737eba3-628a-41b6-947e-2250653c7c25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96eb808a6018456b834fa94526cb3403', 'request_id': 'req-8737eba3-628a-41b6-947e-2250653c7c25'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:55.623112 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:55.646529 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-8737eba3-628a-41b6-947e-2250653c7c25 admin admin] The token cache is being invalidate because project 96eb808a6018456b834fa94526cb3403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:14:55.647151 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-8737eba3-628a-41b6-947e-2250653c7c25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:55.648137 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-8737eba3-628a-41b6-947e-2250653c7c25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:55.652114 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1388/2779] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:14:55 2022] DELETE /identity/v3/projects/96eb808a6018456b834fa94526cb3403 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:55.659041 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d2213-24e6-4a04-b431-92ff6ab207a8 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:55.659855 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d2213-24e6-4a04-b431-92ff6ab207a8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:55.660701 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d2213-24e6-4a04-b431-92ff6ab207a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:55.694641 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-c15d2213-24e6-4a04-b431-92ff6ab207a8 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:55.697073 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c15d2213-24e6-4a04-b431-92ff6ab207a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:55.789147 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1392/2780] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:55.802222 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcd709-1432-46a1-be9a-0f7ac47b32b6 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:55.802594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcd709-1432-46a1-be9a-0f7ac47b32b6 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:55.802770 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcd709-1432-46a1-be9a-0f7ac47b32b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:55.843472 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-11bcd709-1432-46a1-be9a-0f7ac47b32b6 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:55.845616 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-11bcd709-1432-46a1-be9a-0f7ac47b32b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:55.862400 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1389/2781] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:55.871310 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d2213-24e6-4a04-b431-92ff6ab207a8 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:55.900150 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d2213-24e6-4a04-b431-92ff6ab207a8 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:55.912866 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b50808-8cfa-4708-8d2a-77e7f46b3bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:55.914052 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b50808-8cfa-4708-8d2a-77e7f46b3bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:55.914976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b50808-8cfa-4708-8d2a-77e7f46b3bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:55.915617 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b50808-8cfa-4708-8d2a-77e7f46b3bb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:55.917003 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b50808-8cfa-4708-8d2a-77e7f46b3bb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:14:55.917568 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b50808-8cfa-4708-8d2a-77e7f46b3bb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:55.919969 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b50808-8cfa-4708-8d2a-77e7f46b3bb1 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:55.940921 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1393/2782] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:14:55.945798 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bcd709-1432-46a1-be9a-0f7ac47b32b6 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:55.965446 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bcd709-1432-46a1-be9a-0f7ac47b32b6 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:55.973412 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc18678-94b8-4ece-b1af-e135164c7d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:55.974542 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc18678-94b8-4ece-b1af-e135164c7d70 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:55.975024 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc18678-94b8-4ece-b1af-e135164c7d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:55.975544 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc18678-94b8-4ece-b1af-e135164c7d70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:55.976711 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc18678-94b8-4ece-b1af-e135164c7d70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:55.981412 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc18678-94b8-4ece-b1af-e135164c7d70 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:56.028140 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1390/2783] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:14:55 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:14:56.033555 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b50808-8cfa-4708-8d2a-77e7f46b3bb1 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:56.046476 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b50808-8cfa-4708-8d2a-77e7f46b3bb1 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:56.110430 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:56.128897 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426ad45-b3d3-48b2-8678-ad2605d986cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:56.129846 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426ad45-b3d3-48b2-8678-ad2605d986cb admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:56.130378 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426ad45-b3d3-48b2-8678-ad2605d986cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:56.130881 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426ad45-b3d3-48b2-8678-ad2605d986cb admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:56.132044 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426ad45-b3d3-48b2-8678-ad2605d986cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:56.136340 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426ad45-b3d3-48b2-8678-ad2605d986cb admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:56.161282 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1394/2784] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:14:56 2022] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:14:56.166901 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc18678-94b8-4ece-b1af-e135164c7d70 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:56.178701 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc18678-94b8-4ece-b1af-e135164c7d70 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:56.185639 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac03c17-c407-4a17-be33-e679220b52fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:56.186611 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac03c17-c407-4a17-be33-e679220b52fd admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:56.186894 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac03c17-c407-4a17-be33-e679220b52fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:56.187169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac03c17-c407-4a17-be33-e679220b52fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:56.188432 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac03c17-c407-4a17-be33-e679220b52fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:56.190492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac03c17-c407-4a17-be33-e679220b52fd admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:56.206296 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1391/2785] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:14:56.210671 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426ad45-b3d3-48b2-8678-ad2605d986cb admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:56.222226 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426ad45-b3d3-48b2-8678-ad2605d986cb admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:56.228256 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2607649-ca30-44cb-8cdf-d20708196e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:56.228957 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2607649-ca30-44cb-8cdf-d20708196e1d admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:56.229245 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2607649-ca30-44cb-8cdf-d20708196e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:56.229551 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2607649-ca30-44cb-8cdf-d20708196e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:56.230398 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2607649-ca30-44cb-8cdf-d20708196e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:56.232110 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2607649-ca30-44cb-8cdf-d20708196e1d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:56.245005 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1395/2786] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:14:56.250608 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac03c17-c407-4a17-be33-e679220b52fd admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:56.262844 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac03c17-c407-4a17-be33-e679220b52fd admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:56.268004 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec26aa-0a74-43e2-9cb4-7e32bf110885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:56.268777 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec26aa-0a74-43e2-9cb4-7e32bf110885 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:56.269062 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec26aa-0a74-43e2-9cb4-7e32bf110885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:56.269342 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec26aa-0a74-43e2-9cb4-7e32bf110885 admin admin] PATH_INFO: `/v3/projects/0f105bb9e18c4600894fc64123ced323/users/a372edc9a3d04b3ea2abe513bb249eaa/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:56.288319 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec26aa-0a74-43e2-9cb4-7e32bf110885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f105bb9e18c4600894fc64123ced323, user_id=a372edc9a3d04b3ea2abe513bb249eaa, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:56.291949 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec26aa-0a74-43e2-9cb4-7e32bf110885 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:56.309477 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1392/2787] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:14:56 2022] PUT /identity/v3/projects/0f105bb9e18c4600894fc64123ced323/users/a372edc9a3d04b3ea2abe513bb249eaa/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:56.315618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03f5f8-7749-48bb-a039-a429874430bf None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:56.315960 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03f5f8-7749-48bb-a039-a429874430bf None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:56.316263 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03f5f8-7749-48bb-a039-a429874430bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:56.353021 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-cb03f5f8-7749-48bb-a039-a429874430bf None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:56.355269 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-cb03f5f8-7749-48bb-a039-a429874430bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:56.567592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1396/2788] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:14:56.577388 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec26aa-0a74-43e2-9cb4-7e32bf110885 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:56.579284 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-24ec26aa-0a74-43e2-9cb4-7e32bf110885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:56.644695 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec26aa-0a74-43e2-9cb4-7e32bf110885 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:56.648270 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f031d-3229-4d29-bee1-32b930cd78e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:56.648887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f031d-3229-4d29-bee1-32b930cd78e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:56.649706 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f031d-3229-4d29-bee1-32b930cd78e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:56.650061 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f031d-3229-4d29-bee1-32b930cd78e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:56.659383 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f031d-3229-4d29-bee1-32b930cd78e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:56.660833 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f031d-3229-4d29-bee1-32b930cd78e3 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:56.671525 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1393/2789] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:14:56.968515 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9f093-591f-4fb7-b567-b087fcd8a2c8 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:56.968515 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9f093-591f-4fb7-b567-b087fcd8a2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:56.968515 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9f093-591f-4fb7-b567-b087fcd8a2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:57.007751 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f031d-3229-4d29-bee1-32b930cd78e3 service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:57.009086 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-82a9f093-591f-4fb7-b567-b087fcd8a2c8 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:57.010122 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-1f3f031d-3229-4d29-bee1-32b930cd78e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:57.011187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-82a9f093-591f-4fb7-b567-b087fcd8a2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:57.031813 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f031d-3229-4d29-bee1-32b930cd78e3 service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:57.032165 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1397/2790] 10.222.0.69 () {58 vars in 1016 bytes} [Wed Jul 27 09:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:57.036918 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e6eb2-ca30-4fcc-b2c9-f56c5338f8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:57.037695 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e6eb2-ca30-4fcc-b2c9-f56c5338f8ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:57.037976 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e6eb2-ca30-4fcc-b2c9-f56c5338f8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:57.038248 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e6eb2-ca30-4fcc-b2c9-f56c5338f8ae admin admin] PATH_INFO: `/v3/users/3f0f4f521df849659c5100eb87d1d46a` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:57.040238 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e6eb2-ca30-4fcc-b2c9-f56c5338f8ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f0f4f521df849659c5100eb87d1d46a)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:57.042247 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e6eb2-ca30-4fcc-b2c9-f56c5338f8ae admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:57.053535 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9f093-591f-4fb7-b567-b087fcd8a2c8 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:57.058045 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-82a9f093-591f-4fb7-b567-b087fcd8a2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:57.149812 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-193e6eb2-ca30-4fcc-b2c9-f56c5338f8ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f0f4f521df849659c5100eb87d1d46a'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:57.151426 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-193e6eb2-ca30-4fcc-b2c9-f56c5338f8ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f0f4f521df849659c5100eb87d1d46a'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:57.154035 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-193e6eb2-ca30-4fcc-b2c9-f56c5338f8ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f0f4f521df849659c5100eb87d1d46a'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:57.169412 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-193e6eb2-ca30-4fcc-b2c9-f56c5338f8ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f0f4f521df849659c5100eb87d1d46a'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:57.200261 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-193e6eb2-ca30-4fcc-b2c9-f56c5338f8ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f0f4f521df849659c5100eb87d1d46a'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:57.231064 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9f093-591f-4fb7-b567-b087fcd8a2c8 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:57.237703 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea021a31-d2c6-416b-adc5-8e4114032340 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:57.238716 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea021a31-d2c6-416b-adc5-8e4114032340 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:57.238990 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea021a31-d2c6-416b-adc5-8e4114032340 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:57.239258 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea021a31-d2c6-416b-adc5-8e4114032340 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:57.241246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ea021a31-d2c6-416b-adc5-8e4114032340 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:57.245657 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1394/2791] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:14:57 2022] DELETE /identity/v3/users/3f0f4f521df849659c5100eb87d1d46a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:57.252126 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f0fa0-8fab-4509-bee6-3379136a8c17 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:57.252411 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f0fa0-8fab-4509-bee6-3379136a8c17 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:57.252681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f0fa0-8fab-4509-bee6-3379136a8c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:57.266033 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea021a31-d2c6-416b-adc5-8e4114032340 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:57.268639 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea021a31-d2c6-416b-adc5-8e4114032340 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:57.272435 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:57.291551 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-5c8f0fa0-8fab-4509-bee6-3379136a8c17 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:57.293428 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-5c8f0fa0-8fab-4509-bee6-3379136a8c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:57.296994 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1398/2792] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:14:57.387764 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1395/2793] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:57.398289 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea021a31-d2c6-416b-adc5-8e4114032340 service nova] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:57.402066 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ea021a31-d2c6-416b-adc5-8e4114032340 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:57.417348 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea021a31-d2c6-416b-adc5-8e4114032340 service nova] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:57.479764 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a772751-a220-4eae-a39d-5fe53f85ad2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:57.480590 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a772751-a220-4eae-a39d-5fe53f85ad2f service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:57.480872 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a772751-a220-4eae-a39d-5fe53f85ad2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:57.481231 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a772751-a220-4eae-a39d-5fe53f85ad2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:57.488641 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:57.493455 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a772751-a220-4eae-a39d-5fe53f85ad2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:57.495274 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a772751-a220-4eae-a39d-5fe53f85ad2f service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:57.509076 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1399/2794] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:14:57.621419 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a631753-0d15-4182-a67d-ec0f2bfe5191 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:57.622411 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a631753-0d15-4182-a67d-ec0f2bfe5191 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:57.622876 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a631753-0d15-4182-a67d-ec0f2bfe5191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:57.654452 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-5a631753-0d15-4182-a67d-ec0f2bfe5191 None None] MFA Rules not processed for user `a372edc9a3d04b3ea2abe513bb249eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:57.657041 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-5a631753-0d15-4182-a67d-ec0f2bfe5191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:57.812983 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1396/2795] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:57.826719 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a772751-a220-4eae-a39d-5fe53f85ad2f service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:57.828704 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-7a772751-a220-4eae-a39d-5fe53f85ad2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:57.898801 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a772751-a220-4eae-a39d-5fe53f85ad2f service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:57.903126 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2f751-650c-4979-a4a6-7e3df33b1290 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:57.903847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2f751-650c-4979-a4a6-7e3df33b1290 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:57.904134 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2f751-650c-4979-a4a6-7e3df33b1290 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:57.904465 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2f751-650c-4979-a4a6-7e3df33b1290 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:57.917016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2f751-650c-4979-a4a6-7e3df33b1290 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:57.918757 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2f751-650c-4979-a4a6-7e3df33b1290 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:57.928964 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a631753-0d15-4182-a67d-ec0f2bfe5191 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:57.930076 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1400/2796] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:14:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:14:57.930965 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-5a631753-0d15-4182-a67d-ec0f2bfe5191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:57.946940 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a631753-0d15-4182-a67d-ec0f2bfe5191 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:57.953212 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3452cf-c7fd-4dd5-b355-34e0c5f94484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:57.954034 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3452cf-c7fd-4dd5-b355-34e0c5f94484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:57.954406 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3452cf-c7fd-4dd5-b355-34e0c5f94484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:57.954679 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3452cf-c7fd-4dd5-b355-34e0c5f94484 admin admin] PATH_INFO: `/v3/projects/f8b769c6a460471ca7e9720a3389e357` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:57.955916 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3452cf-c7fd-4dd5-b355-34e0c5f94484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8b769c6a460471ca7e9720a3389e357)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:57.957974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3452cf-c7fd-4dd5-b355-34e0c5f94484 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:58.025787 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-ba3452cf-c7fd-4dd5-b355-34e0c5f94484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8b769c6a460471ca7e9720a3389e357', 'request_id': 'req-ba3452cf-c7fd-4dd5-b355-34e0c5f94484'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:58.032835 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-ba3452cf-c7fd-4dd5-b355-34e0c5f94484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8b769c6a460471ca7e9720a3389e357', 'request_id': 'req-ba3452cf-c7fd-4dd5-b355-34e0c5f94484'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:58.043855 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-ba3452cf-c7fd-4dd5-b355-34e0c5f94484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8b769c6a460471ca7e9720a3389e357', 'request_id': 'req-ba3452cf-c7fd-4dd5-b355-34e0c5f94484'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:58.059652 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-ba3452cf-c7fd-4dd5-b355-34e0c5f94484 admin admin] The token cache is being invalidate because project f8b769c6a460471ca7e9720a3389e357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:14:58.060082 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-ba3452cf-c7fd-4dd5-b355-34e0c5f94484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:58.060854 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-ba3452cf-c7fd-4dd5-b355-34e0c5f94484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:58.062806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1397/2797] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:14:57 2022] DELETE /identity/v3/projects/f8b769c6a460471ca7e9720a3389e357 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:58.070043 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2f751-650c-4979-a4a6-7e3df33b1290 service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:58.082199 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2f751-650c-4979-a4a6-7e3df33b1290 service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:58.172587 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a6156-a306-4c55-89e0-2607642cd95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:58.173255 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a6156-a306-4c55-89e0-2607642cd95d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:58.173536 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a6156-a306-4c55-89e0-2607642cd95d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:58.173838 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a6156-a306-4c55-89e0-2607642cd95d admin admin] PATH_INFO: `/v3/users/2b5d762e6cfc476a8a97bc6cf412e6d3` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:58.175177 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a6156-a306-4c55-89e0-2607642cd95d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b5d762e6cfc476a8a97bc6cf412e6d3)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:58.177168 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a6156-a306-4c55-89e0-2607642cd95d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:58.253556 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-349a6156-a306-4c55-89e0-2607642cd95d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b5d762e6cfc476a8a97bc6cf412e6d3'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:58.268697 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-349a6156-a306-4c55-89e0-2607642cd95d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b5d762e6cfc476a8a97bc6cf412e6d3'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:58.270459 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-349a6156-a306-4c55-89e0-2607642cd95d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b5d762e6cfc476a8a97bc6cf412e6d3'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:58.304637 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-349a6156-a306-4c55-89e0-2607642cd95d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b5d762e6cfc476a8a97bc6cf412e6d3'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:58.307267 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-349a6156-a306-4c55-89e0-2607642cd95d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b5d762e6cfc476a8a97bc6cf412e6d3'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:58.350481 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1401/2798] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:14:58 2022] DELETE /identity/v3/users/2b5d762e6cfc476a8a97bc6cf412e6d3 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:14:58.769004 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3452cf-c7fd-4dd5-b355-34e0c5f94484 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:58.771885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-ba3452cf-c7fd-4dd5-b355-34e0c5f94484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:58.808860 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3452cf-c7fd-4dd5-b355-34e0c5f94484 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:58.826292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:58.896449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d55a8-889a-4944-ad8b-34b2e470f777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:58.897129 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d55a8-889a-4944-ad8b-34b2e470f777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:58.897407 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d55a8-889a-4944-ad8b-34b2e470f777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:58.897681 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d55a8-889a-4944-ad8b-34b2e470f777 admin admin] PATH_INFO: `/v3/projects/cafc5a7e15174631ada2c5eb345bca9d` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:58.899600 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d55a8-889a-4944-ad8b-34b2e470f777 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cafc5a7e15174631ada2c5eb345bca9d)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:58.901838 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d55a8-889a-4944-ad8b-34b2e470f777 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:58.965044 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-356d55a8-889a-4944-ad8b-34b2e470f777 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cafc5a7e15174631ada2c5eb345bca9d', 'request_id': 'req-356d55a8-889a-4944-ad8b-34b2e470f777'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:58.974040 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-356d55a8-889a-4944-ad8b-34b2e470f777 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cafc5a7e15174631ada2c5eb345bca9d', 'request_id': 'req-356d55a8-889a-4944-ad8b-34b2e470f777'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:58.989205 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-356d55a8-889a-4944-ad8b-34b2e470f777 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cafc5a7e15174631ada2c5eb345bca9d', 'request_id': 'req-356d55a8-889a-4944-ad8b-34b2e470f777'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:59.013638 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-356d55a8-889a-4944-ad8b-34b2e470f777 admin admin] The token cache is being invalidate because project cafc5a7e15174631ada2c5eb345bca9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:14:59.014732 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-356d55a8-889a-4944-ad8b-34b2e470f777 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:59.017405 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-356d55a8-889a-4944-ad8b-34b2e470f777 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:59.025843 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1398/2799] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:14:58 2022] DELETE /identity/v3/projects/cafc5a7e15174631ada2c5eb345bca9d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:59.028164 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b4284-6a71-45b4-b2e7-2372a4b78f27 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:59.028498 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b4284-6a71-45b4-b2e7-2372a4b78f27 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:59.028780 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b4284-6a71-45b4-b2e7-2372a4b78f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:59.058908 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-e00b4284-6a71-45b4-b2e7-2372a4b78f27 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:59.060268 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e00b4284-6a71-45b4-b2e7-2372a4b78f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:59.074580 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:59.148300 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1402/2800] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:14:59.156780 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2626f3-8c95-4b36-8df2-24bcbac538ba None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:59.157144 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2626f3-8c95-4b36-8df2-24bcbac538ba None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:59.157468 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2626f3-8c95-4b36-8df2-24bcbac538ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:59.179281 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-9f2626f3-8c95-4b36-8df2-24bcbac538ba None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:59.181023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-9f2626f3-8c95-4b36-8df2-24bcbac538ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:59.189486 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1399/2801] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:14:59.194219 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b4284-6a71-45b4-b2e7-2372a4b78f27 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:59.205105 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b4284-6a71-45b4-b2e7-2372a4b78f27 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:59.209917 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382aabb1-f078-40b7-9867-537227c97b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:59.210586 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382aabb1-f078-40b7-9867-537227c97b2f admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:59.211372 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382aabb1-f078-40b7-9867-537227c97b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:59.211819 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382aabb1-f078-40b7-9867-537227c97b2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:59.212612 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382aabb1-f078-40b7-9867-537227c97b2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:14:59.213230 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382aabb1-f078-40b7-9867-537227c97b2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:59.214908 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382aabb1-f078-40b7-9867-537227c97b2f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:59.229064 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1403/2802] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:14:59.233894 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2626f3-8c95-4b36-8df2-24bcbac538ba None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:59.244054 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2626f3-8c95-4b36-8df2-24bcbac538ba None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:59.248985 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843335c-1129-4872-9632-586aa705f99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:59.249621 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843335c-1129-4872-9632-586aa705f99b admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:59.249898 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843335c-1129-4872-9632-586aa705f99b admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:59.250166 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843335c-1129-4872-9632-586aa705f99b admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:59.250883 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843335c-1129-4872-9632-586aa705f99b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:59.252863 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843335c-1129-4872-9632-586aa705f99b admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:59.300637 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1400/2803] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:14:59 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:14:59.308377 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382aabb1-f078-40b7-9867-537227c97b2f admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:59.322077 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382aabb1-f078-40b7-9867-537227c97b2f admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:59.390444 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2283492-bd0a-41c1-9e25-4399c2e63d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:59.391193 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2283492-bd0a-41c1-9e25-4399c2e63d67 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:59.391562 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2283492-bd0a-41c1-9e25-4399c2e63d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:59.392013 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2283492-bd0a-41c1-9e25-4399c2e63d67 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:59.392784 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2283492-bd0a-41c1-9e25-4399c2e63d67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:59.395552 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2283492-bd0a-41c1-9e25-4399c2e63d67 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:59.422352 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1404/2804] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:14:59 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:14:59.427767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843335c-1129-4872-9632-586aa705f99b admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:59.442908 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843335c-1129-4872-9632-586aa705f99b admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:59.450462 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d02618-1094-4029-94f9-405686f91f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:59.451545 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d02618-1094-4029-94f9-405686f91f2d admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:59.451985 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d02618-1094-4029-94f9-405686f91f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:59.452356 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d02618-1094-4029-94f9-405686f91f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:59.453290 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d02618-1094-4029-94f9-405686f91f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:59.455362 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d02618-1094-4029-94f9-405686f91f2d admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:59.471050 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1401/2805] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:14:59.479183 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2283492-bd0a-41c1-9e25-4399c2e63d67 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:59.493080 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2283492-bd0a-41c1-9e25-4399c2e63d67 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:59.494085 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb8bca-6652-4902-ade1-8df3146567e9 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:59.494409 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb8bca-6652-4902-ade1-8df3146567e9 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:59.494685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb8bca-6652-4902-ade1-8df3146567e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:59.500315 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2d5f5-8bb5-4b5d-bbee-a6375f891c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:59.501266 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2d5f5-8bb5-4b5d-bbee-a6375f891c09 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:59.501743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2d5f5-8bb5-4b5d-bbee-a6375f891c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:59.502208 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2d5f5-8bb5-4b5d-bbee-a6375f891c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:59.503155 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2d5f5-8bb5-4b5d-bbee-a6375f891c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:59.505474 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2d5f5-8bb5-4b5d-bbee-a6375f891c09 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:59.524007 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-4dbb8bca-6652-4902-ade1-8df3146567e9 None None] MFA Rules not processed for user `a372edc9a3d04b3ea2abe513bb249eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:59.524883 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1405/2806] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:14:59.526634 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-4dbb8bca-6652-4902-ade1-8df3146567e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:59.529485 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2d5f5-8bb5-4b5d-bbee-a6375f891c09 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:59.552010 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2d5f5-8bb5-4b5d-bbee-a6375f891c09 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:59.560930 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ad356-5da5-4f3e-83d5-2430ae6168d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:59.562086 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ad356-5da5-4f3e-83d5-2430ae6168d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:59.562641 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ad356-5da5-4f3e-83d5-2430ae6168d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:59.563201 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ad356-5da5-4f3e-83d5-2430ae6168d3 admin admin] PATH_INFO: `/v3/projects/1caf1707f9984093850139f91bd3cc39/users/0dbaa2144cee4c24a3aea0811c2ec805/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:59.588998 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ad356-5da5-4f3e-83d5-2430ae6168d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1caf1707f9984093850139f91bd3cc39, user_id=0dbaa2144cee4c24a3aea0811c2ec805, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:59.593811 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ad356-5da5-4f3e-83d5-2430ae6168d3 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:59.616379 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1406/2807] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:14:59 2022] PUT /identity/v3/projects/1caf1707f9984093850139f91bd3cc39/users/0dbaa2144cee4c24a3aea0811c2ec805/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:59.617952 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ad356-5da5-4f3e-83d5-2430ae6168d3 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:59.619827 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d84ad356-5da5-4f3e-83d5-2430ae6168d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:59.636393 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1402/2808] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:59.636393 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05dd5c-e9ab-4ff4-98e3-69fd95603614 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:59.636393 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05dd5c-e9ab-4ff4-98e3-69fd95603614 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:59.636393 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05dd5c-e9ab-4ff4-98e3-69fd95603614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:59.679372 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:59.682029 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-8c05dd5c-e9ab-4ff4-98e3-69fd95603614 None None] MFA Rules not processed for user `0dbaa2144cee4c24a3aea0811c2ec805`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:59.683568 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-8c05dd5c-e9ab-4ff4-98e3-69fd95603614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:14:59.731431 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:14:59.737099 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ad356-5da5-4f3e-83d5-2430ae6168d3 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:59.745900 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093182a-8e91-429e-86f7-86f8747c8d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:59.747683 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093182a-8e91-429e-86f7-86f8747c8d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:59.748189 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093182a-8e91-429e-86f7-86f8747c8d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:59.749148 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093182a-8e91-429e-86f7-86f8747c8d67 admin admin] PATH_INFO: `/v3/users/cfdc4457180c4413b1b2bf3d226b226d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:59.751338 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093182a-8e91-429e-86f7-86f8747c8d67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfdc4457180c4413b1b2bf3d226b226d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:59.755018 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093182a-8e91-429e-86f7-86f8747c8d67 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:59.787769 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1403/2809] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:14:59.793717 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05dd5c-e9ab-4ff4-98e3-69fd95603614 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:59.812854 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05dd5c-e9ab-4ff4-98e3-69fd95603614 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:14:59.820114 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dcede9-fd8e-4aed-ab59-ec172fc31220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:14:59.821470 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcede9-fd8e-4aed-ab59-ec172fc31220 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:59.822031 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcede9-fd8e-4aed-ab59-ec172fc31220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:59.822500 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcede9-fd8e-4aed-ab59-ec172fc31220 admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:59.823656 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dcede9-fd8e-4aed-ab59-ec172fc31220 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:14:59.827472 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dcede9-fd8e-4aed-ab59-ec172fc31220 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:14:59.864854 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-7093182a-8e91-429e-86f7-86f8747c8d67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfdc4457180c4413b1b2bf3d226b226d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:59.873964 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1404/2810] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:14:59 2022] POST /identity/v3/projects => generated 377 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:14:59.880713 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-7093182a-8e91-429e-86f7-86f8747c8d67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfdc4457180c4413b1b2bf3d226b226d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:59.881846 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-7093182a-8e91-429e-86f7-86f8747c8d67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfdc4457180c4413b1b2bf3d226b226d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:59.882979 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dcede9-fd8e-4aed-ab59-ec172fc31220 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:14:59.906122 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-7093182a-8e91-429e-86f7-86f8747c8d67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfdc4457180c4413b1b2bf3d226b226d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:59.909501 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-7093182a-8e91-429e-86f7-86f8747c8d67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfdc4457180c4413b1b2bf3d226b226d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:14:59.944095 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1407/2811] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:14:59 2022] DELETE /identity/v3/users/cfdc4457180c4413b1b2bf3d226b226d => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:14:59.949450 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bda40f-8feb-402f-8181-8cf2c85d2cc6 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:14:59.950801 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bda40f-8feb-402f-8181-8cf2c85d2cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:14:59.951250 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bda40f-8feb-402f-8181-8cf2c85d2cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:14:59.973740 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-b9bda40f-8feb-402f-8181-8cf2c85d2cc6 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:14:59.975024 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b9bda40f-8feb-402f-8181-8cf2c85d2cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:00.013473 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dcede9-fd8e-4aed-ab59-ec172fc31220 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:00.082679 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1408/2812] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:14:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:15:00.082679 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bda40f-8feb-402f-8181-8cf2c85d2cc6 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:00.082679 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b9bda40f-8feb-402f-8181-8cf2c85d2cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:00.097497 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920729c2-63d2-4b1c-a501-a8485c25d1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:00.098746 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920729c2-63d2-4b1c-a501-a8485c25d1e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:00.099164 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920729c2-63d2-4b1c-a501-a8485c25d1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:00.099569 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920729c2-63d2-4b1c-a501-a8485c25d1e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:00.100531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920729c2-63d2-4b1c-a501-a8485c25d1e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:00.104169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920729c2-63d2-4b1c-a501-a8485c25d1e1 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:00.137017 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1405/2813] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:14:59 2022] POST /identity/v3/users => generated 289 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:15:00.137761 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920729c2-63d2-4b1c-a501-a8485c25d1e1 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:00.139532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-920729c2-63d2-4b1c-a501-a8485c25d1e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:00.162795 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bda40f-8feb-402f-8181-8cf2c85d2cc6 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:00.169197 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ee8d6-967f-4b66-a79c-55f2178e49c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:00.169975 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ee8d6-967f-4b66-a79c-55f2178e49c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:00.171287 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ee8d6-967f-4b66-a79c-55f2178e49c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:00.171847 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ee8d6-967f-4b66-a79c-55f2178e49c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:00.174533 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:15:00.176016 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ad2ee8d6-967f-4b66-a79c-55f2178e49c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:00.192336 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ee8d6-967f-4b66-a79c-55f2178e49c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:00.198584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ee8d6-967f-4b66-a79c-55f2178e49c7 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:00.213664 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1409/2814] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:15:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:15:00.215270 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ee8d6-967f-4b66-a79c-55f2178e49c7 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:00.218794 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ad2ee8d6-967f-4b66-a79c-55f2178e49c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:00.254394 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ee8d6-967f-4b66-a79c-55f2178e49c7 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:00.265598 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd2cb6-aa71-468d-ae48-c33b53defff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:00.265872 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920729c2-63d2-4b1c-a501-a8485c25d1e1 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:00.266470 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd2cb6-aa71-468d-ae48-c33b53defff7 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:00.266879 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd2cb6-aa71-468d-ae48-c33b53defff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:00.267281 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd2cb6-aa71-468d-ae48-c33b53defff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:00.268052 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd2cb6-aa71-468d-ae48-c33b53defff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:00.269917 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd2cb6-aa71-468d-ae48-c33b53defff7 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:00.270890 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c29218-e6cc-4b1b-ad5c-bde440bbeb46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:00.271867 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c29218-e6cc-4b1b-ad5c-bde440bbeb46 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:00.272149 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c29218-e6cc-4b1b-ad5c-bde440bbeb46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:00.272424 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c29218-e6cc-4b1b-ad5c-bde440bbeb46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:00.285057 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c29218-e6cc-4b1b-ad5c-bde440bbeb46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:00.285656 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1410/2815] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:15:00.289263 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c29218-e6cc-4b1b-ad5c-bde440bbeb46 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:00.291409 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e5375-f4f5-4bad-8932-04d78564c0e9 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:00.291961 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e5375-f4f5-4bad-8932-04d78564c0e9 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:00.292462 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e5375-f4f5-4bad-8932-04d78564c0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:00.299902 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1406/2816] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:15:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:15:00.301089 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c29218-e6cc-4b1b-ad5c-bde440bbeb46 service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:00.314647 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c29218-e6cc-4b1b-ad5c-bde440bbeb46 service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:00.315620 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f86e5375-f4f5-4bad-8932-04d78564c0e9 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:15:00.317233 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f86e5375-f4f5-4bad-8932-04d78564c0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:00.323757 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295141e-c311-4b5b-90fc-d9b6c4a74c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:00.325314 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295141e-c311-4b5b-90fc-d9b6c4a74c70 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:00.325605 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295141e-c311-4b5b-90fc-d9b6c4a74c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:00.325885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295141e-c311-4b5b-90fc-d9b6c4a74c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:00.326718 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295141e-c311-4b5b-90fc-d9b6c4a74c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:00.328462 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295141e-c311-4b5b-90fc-d9b6c4a74c70 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:00.329177 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1411/2817] 10.222.0.69 () {58 vars in 1016 bytes} [Wed Jul 27 09:15:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:15:00.346156 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1407/2818] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:15:00.348432 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e5375-f4f5-4bad-8932-04d78564c0e9 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:00.357486 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:15:00.363604 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e5375-f4f5-4bad-8932-04d78564c0e9 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:00.371134 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e69f20-e5eb-45b1-929f-e733ddadd6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:00.372406 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e69f20-e5eb-45b1-929f-e733ddadd6cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:00.372762 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e69f20-e5eb-45b1-929f-e733ddadd6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:00.373104 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e69f20-e5eb-45b1-929f-e733ddadd6cf admin admin] PATH_INFO: `/v3/projects/4feb588a187c4698b31979ea4b220fee/users/b4cc2571525e46bea795398830847a74/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:00.393246 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e69f20-e5eb-45b1-929f-e733ddadd6cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4feb588a187c4698b31979ea4b220fee, user_id=b4cc2571525e46bea795398830847a74, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:00.396182 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e69f20-e5eb-45b1-929f-e733ddadd6cf admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:00.433195 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295141e-c311-4b5b-90fc-d9b6c4a74c70 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:00.436916 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-3295141e-c311-4b5b-90fc-d9b6c4a74c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:00.438600 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1412/2819] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:15:00 2022] PUT /identity/v3/projects/4feb588a187c4698b31979ea4b220fee/users/b4cc2571525e46bea795398830847a74/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:15:00.451713 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa19f79-bbd0-430e-a68f-4b1512092aa8 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:00.452152 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa19f79-bbd0-430e-a68f-4b1512092aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:00.452515 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa19f79-bbd0-430e-a68f-4b1512092aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:00.491699 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-1aa19f79-bbd0-430e-a68f-4b1512092aa8 None None] MFA Rules not processed for user `b4cc2571525e46bea795398830847a74`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:15:00.494003 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1aa19f79-bbd0-430e-a68f-4b1512092aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:00.565335 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295141e-c311-4b5b-90fc-d9b6c4a74c70 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:00.612912 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1413/2820] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:15:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:15:00.619036 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa19f79-bbd0-430e-a68f-4b1512092aa8 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:00.674226 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7ea34-ae9f-4db8-a483-2451f1c8a08e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:00.675058 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7ea34-ae9f-4db8-a483-2451f1c8a08e service nova] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:00.675449 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7ea34-ae9f-4db8-a483-2451f1c8a08e service nova] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:00.675850 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7ea34-ae9f-4db8-a483-2451f1c8a08e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:00.761967 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa19f79-bbd0-430e-a68f-4b1512092aa8 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:00.767219 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:15:00.771816 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b4bcd-0e0b-49a0-9d28-9d1ef9ac732d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:00.772520 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b4bcd-0e0b-49a0-9d28-9d1ef9ac732d admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:00.774107 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b4bcd-0e0b-49a0-9d28-9d1ef9ac732d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:00.774891 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b4bcd-0e0b-49a0-9d28-9d1ef9ac732d admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:00.775604 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b4bcd-0e0b-49a0-9d28-9d1ef9ac732d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:00.777772 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b4bcd-0e0b-49a0-9d28-9d1ef9ac732d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:00.793850 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7ea34-ae9f-4db8-a483-2451f1c8a08e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:00.797565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7ea34-ae9f-4db8-a483-2451f1c8a08e service nova] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:00.811423 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1414/2821] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:15:00 2022] POST /identity/v3/projects => generated 377 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:15:00.812592 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b4bcd-0e0b-49a0-9d28-9d1ef9ac732d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:00.814438 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-547b4bcd-0e0b-49a0-9d28-9d1ef9ac732d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:00.818533 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1408/2822] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:15:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:15:00.819753 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7ea34-ae9f-4db8-a483-2451f1c8a08e service nova] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:00.847950 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7ea34-ae9f-4db8-a483-2451f1c8a08e service nova] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:00.935554 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:15:00.982889 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b4bcd-0e0b-49a0-9d28-9d1ef9ac732d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:00.993365 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb7e71-be84-4d8d-8b9a-17f2adc70e63 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d69004d02f9426b86e07907a553e523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:00.994544 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb7e71-be84-4d8d-8b9a-17f2adc70e63 service placement] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:00.995013 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb7e71-be84-4d8d-8b9a-17f2adc70e63 service placement] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:00.995491 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb7e71-be84-4d8d-8b9a-17f2adc70e63 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:00.999282 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e3bb7e71-be84-4d8d-8b9a-17f2adc70e63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:01.001716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fcb53-5bc9-462c-9aa0-cc677fe4d973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:01.002631 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fcb53-5bc9-462c-9aa0-cc677fe4d973 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:01.003252 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fcb53-5bc9-462c-9aa0-cc677fe4d973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:01.003682 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fcb53-5bc9-462c-9aa0-cc677fe4d973 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:01.004532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637fcb53-5bc9-462c-9aa0-cc677fe4d973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:01.006995 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637fcb53-5bc9-462c-9aa0-cc677fe4d973 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:01.022402 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb7e71-be84-4d8d-8b9a-17f2adc70e63 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:01.027330 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb7e71-be84-4d8d-8b9a-17f2adc70e63 service placement] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:01.048133 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1409/2824] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:15:00 2022] POST /identity/v3/users => generated 295 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:15:01.049538 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fcb53-5bc9-462c-9aa0-cc677fe4d973 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:01.050140 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1415/2824] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:15:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:15:01.051857 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb7e71-be84-4d8d-8b9a-17f2adc70e63 service placement] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:01.052122 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-637fcb53-5bc9-462c-9aa0-cc677fe4d973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:01.066659 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fcb53-5bc9-462c-9aa0-cc677fe4d973 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:01.071071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb7e71-be84-4d8d-8b9a-17f2adc70e63 service placement] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:01.074585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cac1fd-389c-439b-a93b-beaa7051930e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:01.075689 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cac1fd-389c-439b-a93b-beaa7051930e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:01.075972 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cac1fd-389c-439b-a93b-beaa7051930e admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:01.076250 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cac1fd-389c-439b-a93b-beaa7051930e admin admin] PATH_INFO: `/v3/projects/4cca320b1fcf487094328952d0c09d5e` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:01.077968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cac1fd-389c-439b-a93b-beaa7051930e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cca320b1fcf487094328952d0c09d5e)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:01.080135 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cac1fd-389c-439b-a93b-beaa7051930e admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:01.080789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be5092-feec-46dd-8298-8dc149007170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:01.081637 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be5092-feec-46dd-8298-8dc149007170 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:01.081989 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be5092-feec-46dd-8298-8dc149007170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:01.082511 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be5092-feec-46dd-8298-8dc149007170 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:01.083612 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be5092-feec-46dd-8298-8dc149007170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:01.086912 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be5092-feec-46dd-8298-8dc149007170 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:01.105044 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1416/2825] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:15:01.110019 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be5092-feec-46dd-8298-8dc149007170 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:01.126748 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be5092-feec-46dd-8298-8dc149007170 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:01.134028 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112c3d8-9810-4349-ab69-5e4b19f96338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:01.135078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112c3d8-9810-4349-ab69-5e4b19f96338 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:01.135520 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112c3d8-9810-4349-ab69-5e4b19f96338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:01.137055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112c3d8-9810-4349-ab69-5e4b19f96338 admin admin] PATH_INFO: `/v3/projects/d6607acef82f45129798c9bdd72018bb/users/1ac8c06b3e554b58852e82ed7ec57ee2/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:01.157068 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112c3d8-9810-4349-ab69-5e4b19f96338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6607acef82f45129798c9bdd72018bb, user_id=1ac8c06b3e554b58852e82ed7ec57ee2, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:01.160589 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112c3d8-9810-4349-ab69-5e4b19f96338 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:01.185493 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1417/2826] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:15:01 2022] PUT /identity/v3/projects/d6607acef82f45129798c9bdd72018bb/users/1ac8c06b3e554b58852e82ed7ec57ee2/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:15:01.191556 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112c3d8-9810-4349-ab69-5e4b19f96338 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:01.201307 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-57cac1fd-389c-439b-a93b-beaa7051930e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cca320b1fcf487094328952d0c09d5e', 'request_id': 'req-57cac1fd-389c-439b-a93b-beaa7051930e'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:01.210944 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-57cac1fd-389c-439b-a93b-beaa7051930e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cca320b1fcf487094328952d0c09d5e', 'request_id': 'req-57cac1fd-389c-439b-a93b-beaa7051930e'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:01.223169 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-57cac1fd-389c-439b-a93b-beaa7051930e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cca320b1fcf487094328952d0c09d5e', 'request_id': 'req-57cac1fd-389c-439b-a93b-beaa7051930e'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:01.246570 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-57cac1fd-389c-439b-a93b-beaa7051930e admin admin] The token cache is being invalidate because project 4cca320b1fcf487094328952d0c09d5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:15:01.247085 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-57cac1fd-389c-439b-a93b-beaa7051930e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:01.248598 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-57cac1fd-389c-439b-a93b-beaa7051930e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:01.251730 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1410/2827] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:15:01 2022] DELETE /identity/v3/projects/4cca320b1fcf487094328952d0c09d5e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:15:01.294997 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112c3d8-9810-4349-ab69-5e4b19f96338 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:01.301570 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb46966-c746-4606-babd-901a5c0678fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:01.301989 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb46966-c746-4606-babd-901a5c0678fe admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:01.302435 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb46966-c746-4606-babd-901a5c0678fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:01.302825 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb46966-c746-4606-babd-901a5c0678fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:01.303698 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb46966-c746-4606-babd-901a5c0678fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:01.306751 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb46966-c746-4606-babd-901a5c0678fe admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:01.321663 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1418/2828] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 09:15:01.327927 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cac1fd-389c-439b-a93b-beaa7051930e admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:01.330374 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-57cac1fd-389c-439b-a93b-beaa7051930e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:01.418999 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:15:01.437706 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cac1fd-389c-439b-a93b-beaa7051930e admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:01.457043 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25f108-756f-4a6f-b06a-74b6eeb7fc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:01.457043 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25f108-756f-4a6f-b06a-74b6eeb7fc6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:01.457043 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25f108-756f-4a6f-b06a-74b6eeb7fc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:01.457043 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25f108-756f-4a6f-b06a-74b6eeb7fc6e admin admin] PATH_INFO: `/v3/projects/d6607acef82f45129798c9bdd72018bb/users/1ac8c06b3e554b58852e82ed7ec57ee2/roles/20bc872844094480b9dca67a25b69e84` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:01.457819 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25f108-756f-4a6f-b06a-74b6eeb7fc6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6607acef82f45129798c9bdd72018bb, user_id=1ac8c06b3e554b58852e82ed7ec57ee2, role_id=20bc872844094480b9dca67a25b69e84)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:01.461030 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25f108-756f-4a6f-b06a-74b6eeb7fc6e admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:01.479006 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1411/2829] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:15:01 2022] PUT /identity/v3/projects/d6607acef82f45129798c9bdd72018bb/users/1ac8c06b3e554b58852e82ed7ec57ee2/roles/20bc872844094480b9dca67a25b69e84 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:15:01.491573 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb39e79-8fac-4e5e-a5e4-7ee53baecb82 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:01.492606 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb39e79-8fac-4e5e-a5e4-7ee53baecb82 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:01.492882 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb39e79-8fac-4e5e-a5e4-7ee53baecb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:01.533281 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-6fb39e79-8fac-4e5e-a5e4-7ee53baecb82 None None] MFA Rules not processed for user `1ac8c06b3e554b58852e82ed7ec57ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:15:01.534564 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6fb39e79-8fac-4e5e-a5e4-7ee53baecb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:01.698296 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1419/2830] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:15:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:15:01.719475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25f108-756f-4a6f-b06a-74b6eeb7fc6e admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:01.724108 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-1d25f108-756f-4a6f-b06a-74b6eeb7fc6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:01.839290 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25f108-756f-4a6f-b06a-74b6eeb7fc6e admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:01.843472 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b1935-0f2e-4b6c-8850-8d28fa0296ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:01.844498 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b1935-0f2e-4b6c-8850-8d28fa0296ec service cinder] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:01.844779 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b1935-0f2e-4b6c-8850-8d28fa0296ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:01.845059 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b1935-0f2e-4b6c-8850-8d28fa0296ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:01.847694 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-4f8b1935-0f2e-4b6c-8850-8d28fa0296ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:01.930835 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b1935-0f2e-4b6c-8850-8d28fa0296ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:01.935034 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b1935-0f2e-4b6c-8850-8d28fa0296ec service cinder] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:01.953937 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1412/2831] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:15:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:15:03.708211 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb39e79-8fac-4e5e-a5e4-7ee53baecb82 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:03.720076 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb39e79-8fac-4e5e-a5e4-7ee53baecb82 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:03.724341 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc95f3b-db80-4bef-9f55-cb85b37bec27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:03.725015 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc95f3b-db80-4bef-9f55-cb85b37bec27 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:03.725293 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc95f3b-db80-4bef-9f55-cb85b37bec27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:03.726298 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc95f3b-db80-4bef-9f55-cb85b37bec27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:03.728285 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-2bc95f3b-db80-4bef-9f55-cb85b37bec27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:03.774820 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:15:03.841577 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc95f3b-db80-4bef-9f55-cb85b37bec27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:03.844467 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc95f3b-db80-4bef-9f55-cb85b37bec27 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:03.862419 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1420/2832] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:15:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:15:04.597400 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae30f1-6756-46a1-a1e8-891579c78dd2 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:04.598215 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae30f1-6756-46a1-a1e8-891579c78dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:04.599180 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae30f1-6756-46a1-a1e8-891579c78dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:04.643317 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-44ae30f1-6756-46a1-a1e8-891579c78dd2 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:15:04.654214 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-44ae30f1-6756-46a1-a1e8-891579c78dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:04.714796 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc95f3b-db80-4bef-9f55-cb85b37bec27 service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:04.728413 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc95f3b-db80-4bef-9f55-cb85b37bec27 service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:04.734905 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479fafb-d373-43ee-a1e2-5e9780a4b014 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:04.735904 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479fafb-d373-43ee-a1e2-5e9780a4b014 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:04.736360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479fafb-d373-43ee-a1e2-5e9780a4b014 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:04.736807 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479fafb-d373-43ee-a1e2-5e9780a4b014 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:04.785436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479fafb-d373-43ee-a1e2-5e9780a4b014 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:04.810521 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479fafb-d373-43ee-a1e2-5e9780a4b014 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:04.851690 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1413/2833] 10.222.0.69 () {58 vars in 1016 bytes} [Wed Jul 27 09:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:15:04.853048 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1421/2834] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:15:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:15:04.899734 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae30f1-6756-46a1-a1e8-891579c78dd2 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:04.901630 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-44ae30f1-6756-46a1-a1e8-891579c78dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:04.977425 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:15:05.027504 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae30f1-6756-46a1-a1e8-891579c78dd2 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:05.052069 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97c533-2f9f-44bd-bb1b-559e3c00177c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:05.053640 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97c533-2f9f-44bd-bb1b-559e3c00177c service nova] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:05.054655 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97c533-2f9f-44bd-bb1b-559e3c00177c service nova] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:05.055498 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97c533-2f9f-44bd-bb1b-559e3c00177c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:05.072511 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a97c533-2f9f-44bd-bb1b-559e3c00177c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:05.074591 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a97c533-2f9f-44bd-bb1b-559e3c00177c service nova] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:05.092891 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1414/2835] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:15:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:15:09.530954 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479fafb-d373-43ee-a1e2-5e9780a4b014 service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:09.545168 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479fafb-d373-43ee-a1e2-5e9780a4b014 service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:09.551299 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b1416-0eb4-43dc-a721-35ec66958ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:09.552898 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b1416-0eb4-43dc-a721-35ec66958ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:09.553330 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b1416-0eb4-43dc-a721-35ec66958ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:09.553839 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b1416-0eb4-43dc-a721-35ec66958ac3 admin admin] PATH_INFO: `/v3/users/0dbaa2144cee4c24a3aea0811c2ec805` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:09.555256 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b1416-0eb4-43dc-a721-35ec66958ac3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dbaa2144cee4c24a3aea0811c2ec805)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:09.557224 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b1416-0eb4-43dc-a721-35ec66958ac3 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:09.631816 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b42b1416-0eb4-43dc-a721-35ec66958ac3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dbaa2144cee4c24a3aea0811c2ec805'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:09.642197 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b42b1416-0eb4-43dc-a721-35ec66958ac3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dbaa2144cee4c24a3aea0811c2ec805'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:09.643579 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b42b1416-0eb4-43dc-a721-35ec66958ac3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dbaa2144cee4c24a3aea0811c2ec805'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:09.665074 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b42b1416-0eb4-43dc-a721-35ec66958ac3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dbaa2144cee4c24a3aea0811c2ec805'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:09.666201 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b42b1416-0eb4-43dc-a721-35ec66958ac3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dbaa2144cee4c24a3aea0811c2ec805'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:09.689469 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1422/2836] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:15:09 2022] DELETE /identity/v3/users/0dbaa2144cee4c24a3aea0811c2ec805 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:15:09.695521 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d604f-95f6-484f-a724-d23ada893b16 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:09.696134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d604f-95f6-484f-a724-d23ada893b16 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:09.696134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d604f-95f6-484f-a724-d23ada893b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:09.728331 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-785d604f-95f6-484f-a724-d23ada893b16 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:15:09.731342 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-785d604f-95f6-484f-a724-d23ada893b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:09.737639 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b1416-0eb4-43dc-a721-35ec66958ac3 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:09.741024 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b42b1416-0eb4-43dc-a721-35ec66958ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:09.884649 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1415/2837] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:15:09.915586 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d604f-95f6-484f-a724-d23ada893b16 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:09.932693 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b1416-0eb4-43dc-a721-35ec66958ac3 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:09.940942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4be36f-4914-45bc-9b47-ae98aabd1cf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:09.940942 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4be36f-4914-45bc-9b47-ae98aabd1cf6 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:09.941729 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4be36f-4914-45bc-9b47-ae98aabd1cf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:09.942394 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4be36f-4914-45bc-9b47-ae98aabd1cf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:09.946586 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-3d4be36f-4914-45bc-9b47-ae98aabd1cf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:09.950452 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d604f-95f6-484f-a724-d23ada893b16 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:09.957167 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0fbc1-4ef3-4142-8f4d-5ee18a3078fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:09.960454 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0fbc1-4ef3-4142-8f4d-5ee18a3078fe service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:09.963497 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0fbc1-4ef3-4142-8f4d-5ee18a3078fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:09.963497 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0fbc1-4ef3-4142-8f4d-5ee18a3078fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:09.968292 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4be36f-4914-45bc-9b47-ae98aabd1cf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:09.971854 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4be36f-4914-45bc-9b47-ae98aabd1cf6 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:09.983136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e0fbc1-4ef3-4142-8f4d-5ee18a3078fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:09.986104 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e0fbc1-4ef3-4142-8f4d-5ee18a3078fe service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:09.991702 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1423/2838] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:15:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:15:10.007680 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1416/2839] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:15:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:15:10.419790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4be36f-4914-45bc-9b47-ae98aabd1cf6 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:10.429181 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-3d4be36f-4914-45bc-9b47-ae98aabd1cf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:10.475406 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4be36f-4914-45bc-9b47-ae98aabd1cf6 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:10.481778 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42908d-048f-430d-a158-6948372b3c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:10.482504 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42908d-048f-430d-a158-6948372b3c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:10.482789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42908d-048f-430d-a158-6948372b3c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:10.483193 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42908d-048f-430d-a158-6948372b3c1b admin admin] PATH_INFO: `/v3/projects/1caf1707f9984093850139f91bd3cc39` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:10.484566 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42908d-048f-430d-a158-6948372b3c1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1caf1707f9984093850139f91bd3cc39)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:10.487149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42908d-048f-430d-a158-6948372b3c1b admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:10.520306 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:15:10.551650 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-ae42908d-048f-430d-a158-6948372b3c1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1caf1707f9984093850139f91bd3cc39', 'request_id': 'req-ae42908d-048f-430d-a158-6948372b3c1b'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:10.569064 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-ae42908d-048f-430d-a158-6948372b3c1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1caf1707f9984093850139f91bd3cc39', 'request_id': 'req-ae42908d-048f-430d-a158-6948372b3c1b'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:10.600245 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-ae42908d-048f-430d-a158-6948372b3c1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1caf1707f9984093850139f91bd3cc39', 'request_id': 'req-ae42908d-048f-430d-a158-6948372b3c1b'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:10.650921 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-ae42908d-048f-430d-a158-6948372b3c1b admin admin] The token cache is being invalidate because project 1caf1707f9984093850139f91bd3cc39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:15:10.653686 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-ae42908d-048f-430d-a158-6948372b3c1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:10.656245 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-ae42908d-048f-430d-a158-6948372b3c1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:10.663900 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1424/2840] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:15:10 2022] DELETE /identity/v3/projects/1caf1707f9984093850139f91bd3cc39 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:15:10.668866 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0fbc1-4ef3-4142-8f4d-5ee18a3078fe service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:10.686255 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0fbc1-4ef3-4142-8f4d-5ee18a3078fe service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:10.858279 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00121d93-adbd-446a-b131-527b0c3166f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:10.858279 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00121d93-adbd-446a-b131-527b0c3166f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:10.858279 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00121d93-adbd-446a-b131-527b0c3166f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:10.858279 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00121d93-adbd-446a-b131-527b0c3166f4 admin admin] PATH_INFO: `/v3/users/b4cc2571525e46bea795398830847a74` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:10.867875 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00121d93-adbd-446a-b131-527b0c3166f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4cc2571525e46bea795398830847a74)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:10.872139 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00121d93-adbd-446a-b131-527b0c3166f4 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:10.994094 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-00121d93-adbd-446a-b131-527b0c3166f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4cc2571525e46bea795398830847a74'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:10.994903 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-00121d93-adbd-446a-b131-527b0c3166f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4cc2571525e46bea795398830847a74'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:10.995543 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-00121d93-adbd-446a-b131-527b0c3166f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4cc2571525e46bea795398830847a74'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:11.006731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-00121d93-adbd-446a-b131-527b0c3166f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4cc2571525e46bea795398830847a74'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:11.009976 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:15:11.031795 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-00121d93-adbd-446a-b131-527b0c3166f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4cc2571525e46bea795398830847a74'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:11.057329 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1417/2841] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:15:10 2022] DELETE /identity/v3/users/b4cc2571525e46bea795398830847a74 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:15:11.470789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42908d-048f-430d-a158-6948372b3c1b admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:11.472541 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ae42908d-048f-430d-a158-6948372b3c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:11.488692 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42908d-048f-430d-a158-6948372b3c1b admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:11.585840 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e46e58-1f76-4daf-ad55-9a5b98504b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:11.587010 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e46e58-1f76-4daf-ad55-9a5b98504b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:11.587517 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e46e58-1f76-4daf-ad55-9a5b98504b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:11.588014 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e46e58-1f76-4daf-ad55-9a5b98504b76 admin admin] PATH_INFO: `/v3/projects/4feb588a187c4698b31979ea4b220fee` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:11.592080 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e46e58-1f76-4daf-ad55-9a5b98504b76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4feb588a187c4698b31979ea4b220fee)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:11.596394 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e46e58-1f76-4daf-ad55-9a5b98504b76 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:11.689517 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-39e46e58-1f76-4daf-ad55-9a5b98504b76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4feb588a187c4698b31979ea4b220fee', 'request_id': 'req-39e46e58-1f76-4daf-ad55-9a5b98504b76'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:11.697775 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-39e46e58-1f76-4daf-ad55-9a5b98504b76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4feb588a187c4698b31979ea4b220fee', 'request_id': 'req-39e46e58-1f76-4daf-ad55-9a5b98504b76'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:11.704454 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-39e46e58-1f76-4daf-ad55-9a5b98504b76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4feb588a187c4698b31979ea4b220fee', 'request_id': 'req-39e46e58-1f76-4daf-ad55-9a5b98504b76'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:11.728825 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-39e46e58-1f76-4daf-ad55-9a5b98504b76 admin admin] The token cache is being invalidate because project 4feb588a187c4698b31979ea4b220fee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:15:11.729376 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-39e46e58-1f76-4daf-ad55-9a5b98504b76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:11.733089 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-39e46e58-1f76-4daf-ad55-9a5b98504b76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:11.738148 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1425/2842] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:15:11 2022] DELETE /identity/v3/projects/4feb588a187c4698b31979ea4b220fee => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:15:11.742427 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00121d93-adbd-446a-b131-527b0c3166f4 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:11.744060 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-00121d93-adbd-446a-b131-527b0c3166f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:11.761207 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00121d93-adbd-446a-b131-527b0c3166f4 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:11.875507 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fba595-dfce-4e43-a09b-0d19e676a670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:11.877778 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fba595-dfce-4e43-a09b-0d19e676a670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:11.878285 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fba595-dfce-4e43-a09b-0d19e676a670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:11.878830 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fba595-dfce-4e43-a09b-0d19e676a670 admin admin] PATH_INFO: `/v3/users/1ac8c06b3e554b58852e82ed7ec57ee2` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:11.881552 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fba595-dfce-4e43-a09b-0d19e676a670 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ac8c06b3e554b58852e82ed7ec57ee2)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:11.888103 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fba595-dfce-4e43-a09b-0d19e676a670 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:11.990922 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-87fba595-dfce-4e43-a09b-0d19e676a670 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ac8c06b3e554b58852e82ed7ec57ee2'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:11.991956 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-87fba595-dfce-4e43-a09b-0d19e676a670 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ac8c06b3e554b58852e82ed7ec57ee2'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:11.992801 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-87fba595-dfce-4e43-a09b-0d19e676a670 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ac8c06b3e554b58852e82ed7ec57ee2'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:12.008612 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-87fba595-dfce-4e43-a09b-0d19e676a670 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ac8c06b3e554b58852e82ed7ec57ee2'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:12.043653 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-87fba595-dfce-4e43-a09b-0d19e676a670 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ac8c06b3e554b58852e82ed7ec57ee2'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:12.088256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1418/2843] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:15:11 2022] DELETE /identity/v3/users/1ac8c06b3e554b58852e82ed7ec57ee2 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:15:12.552492 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e46e58-1f76-4daf-ad55-9a5b98504b76 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:12.555069 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-39e46e58-1f76-4daf-ad55-9a5b98504b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:12.579938 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e46e58-1f76-4daf-ad55-9a5b98504b76 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:12.630401 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:15:12.654406 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58236775-74f6-4de2-8aa4-dead07b9357e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:12.655339 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58236775-74f6-4de2-8aa4-dead07b9357e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:12.655623 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58236775-74f6-4de2-8aa4-dead07b9357e admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:12.655899 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58236775-74f6-4de2-8aa4-dead07b9357e admin admin] PATH_INFO: `/v3/projects/d6607acef82f45129798c9bdd72018bb` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:12.657156 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58236775-74f6-4de2-8aa4-dead07b9357e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6607acef82f45129798c9bdd72018bb)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:12.659178 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58236775-74f6-4de2-8aa4-dead07b9357e admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:12.718025 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-58236775-74f6-4de2-8aa4-dead07b9357e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6607acef82f45129798c9bdd72018bb', 'request_id': 'req-58236775-74f6-4de2-8aa4-dead07b9357e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:12.725735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-58236775-74f6-4de2-8aa4-dead07b9357e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6607acef82f45129798c9bdd72018bb', 'request_id': 'req-58236775-74f6-4de2-8aa4-dead07b9357e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:12.732887 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-58236775-74f6-4de2-8aa4-dead07b9357e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6607acef82f45129798c9bdd72018bb', 'request_id': 'req-58236775-74f6-4de2-8aa4-dead07b9357e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:12.749360 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-58236775-74f6-4de2-8aa4-dead07b9357e admin admin] The token cache is being invalidate because project d6607acef82f45129798c9bdd72018bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:15:12.749689 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-58236775-74f6-4de2-8aa4-dead07b9357e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:12.750400 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-58236775-74f6-4de2-8aa4-dead07b9357e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:12.752071 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1426/2844] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:15:12 2022] DELETE /identity/v3/projects/d6607acef82f45129798c9bdd72018bb => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:15:12.760717 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b4c1a-01cd-4527-8c79-458ed505b783 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:12.760999 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b4c1a-01cd-4527-8c79-458ed505b783 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:12.761273 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b4c1a-01cd-4527-8c79-458ed505b783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:12.790840 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-da1b4c1a-01cd-4527-8c79-458ed505b783 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:15:12.792233 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-da1b4c1a-01cd-4527-8c79-458ed505b783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:12.848145 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:15:12.864653 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1419/2845] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:15:12.873435 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383c736-6bdd-4a62-b4b8-e2b46ab4ce20 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:12.873702 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383c736-6bdd-4a62-b4b8-e2b46ab4ce20 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:12.873984 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383c736-6bdd-4a62-b4b8-e2b46ab4ce20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:12.894684 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-9383c736-6bdd-4a62-b4b8-e2b46ab4ce20 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:15:12.896486 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9383c736-6bdd-4a62-b4b8-e2b46ab4ce20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:12.904741 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1427/2846] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:15:12.909392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b4c1a-01cd-4527-8c79-458ed505b783 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:12.920879 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b4c1a-01cd-4527-8c79-458ed505b783 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:12.926242 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26595a5-1479-432b-8435-b0cbed260924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:12.927544 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26595a5-1479-432b-8435-b0cbed260924 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:12.927897 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26595a5-1479-432b-8435-b0cbed260924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:12.928211 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26595a5-1479-432b-8435-b0cbed260924 admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:12.928970 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26595a5-1479-432b-8435-b0cbed260924 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:15:12.929278 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26595a5-1479-432b-8435-b0cbed260924 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:12.930926 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26595a5-1479-432b-8435-b0cbed260924 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:12.947361 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1420/2847] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:15:12.952596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383c736-6bdd-4a62-b4b8-e2b46ab4ce20 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:12.963400 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383c736-6bdd-4a62-b4b8-e2b46ab4ce20 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:12.968801 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe672f3-2973-4cd0-8fc3-47d662af1538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:12.969649 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe672f3-2973-4cd0-8fc3-47d662af1538 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:12.969995 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe672f3-2973-4cd0-8fc3-47d662af1538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:12.970273 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe672f3-2973-4cd0-8fc3-47d662af1538 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:12.971344 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe672f3-2973-4cd0-8fc3-47d662af1538 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:12.974595 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe672f3-2973-4cd0-8fc3-47d662af1538 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:13.005826 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1428/2848] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:15:12 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:15:13.010991 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26595a5-1479-432b-8435-b0cbed260924 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:13.026513 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26595a5-1479-432b-8435-b0cbed260924 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:13.118565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f849744-8f7f-4b94-a022-f3a45cd63995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:13.119493 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f849744-8f7f-4b94-a022-f3a45cd63995 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:13.122461 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f849744-8f7f-4b94-a022-f3a45cd63995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:13.122699 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f849744-8f7f-4b94-a022-f3a45cd63995 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:13.123299 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f849744-8f7f-4b94-a022-f3a45cd63995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:13.125417 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f849744-8f7f-4b94-a022-f3a45cd63995 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:13.161356 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1421/2849] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:15:13 2022] POST /identity/v3/users => generated 285 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:15:13.165803 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe672f3-2973-4cd0-8fc3-47d662af1538 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:13.178946 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe672f3-2973-4cd0-8fc3-47d662af1538 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:13.184011 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce841f-30b1-4cda-9097-ba56d58c8337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:13.184646 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce841f-30b1-4cda-9097-ba56d58c8337 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:13.184987 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce841f-30b1-4cda-9097-ba56d58c8337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:13.185267 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce841f-30b1-4cda-9097-ba56d58c8337 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:13.186081 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce841f-30b1-4cda-9097-ba56d58c8337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:13.188395 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce841f-30b1-4cda-9097-ba56d58c8337 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:13.202647 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1429/2850] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:15:13.207710 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f849744-8f7f-4b94-a022-f3a45cd63995 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:13.224666 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f849744-8f7f-4b94-a022-f3a45cd63995 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:13.231781 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef36f1-3297-4de3-99c9-e0fd8ece20ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:13.232771 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef36f1-3297-4de3-99c9-e0fd8ece20ad admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:13.233260 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef36f1-3297-4de3-99c9-e0fd8ece20ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:13.233727 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef36f1-3297-4de3-99c9-e0fd8ece20ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:13.235043 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef36f1-3297-4de3-99c9-e0fd8ece20ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:13.237396 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef36f1-3297-4de3-99c9-e0fd8ece20ad admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:13.257744 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1422/2851] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:15:13.262261 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce841f-30b1-4cda-9097-ba56d58c8337 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:13.274609 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce841f-30b1-4cda-9097-ba56d58c8337 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:13.280332 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc59c6-83d0-422c-9cb7-cfdfe23da020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:13.281685 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc59c6-83d0-422c-9cb7-cfdfe23da020 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:13.282036 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc59c6-83d0-422c-9cb7-cfdfe23da020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:13.282410 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc59c6-83d0-422c-9cb7-cfdfe23da020 admin admin] PATH_INFO: `/v3/projects/0a057a133347433098538602f8a6cc67/users/7aaa1bb899204f229097303c25534347/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:13.302478 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc59c6-83d0-422c-9cb7-cfdfe23da020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a057a133347433098538602f8a6cc67, user_id=7aaa1bb899204f229097303c25534347, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:13.305585 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc59c6-83d0-422c-9cb7-cfdfe23da020 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:13.322795 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1430/2852] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:15:13 2022] PUT /identity/v3/projects/0a057a133347433098538602f8a6cc67/users/7aaa1bb899204f229097303c25534347/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:15:13.343645 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2a213-cca6-452f-92a1-d0ca11d4bc44 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:13.343807 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2a213-cca6-452f-92a1-d0ca11d4bc44 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:13.344309 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2a213-cca6-452f-92a1-d0ca11d4bc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:13.398827 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-6bc2a213-cca6-452f-92a1-d0ca11d4bc44 None None] MFA Rules not processed for user `7aaa1bb899204f229097303c25534347`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:15:13.401083 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-6bc2a213-cca6-452f-92a1-d0ca11d4bc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:13.503555 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1423/2853] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:15:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:15:13.517457 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc59c6-83d0-422c-9cb7-cfdfe23da020 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:13.519277 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-0adc59c6-83d0-422c-9cb7-cfdfe23da020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:13.612956 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:15:13.617137 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc59c6-83d0-422c-9cb7-cfdfe23da020 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:13.625259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf489af-e74d-4181-b2ce-e9c4ff8f3bd5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713805e0f1174a01987014319075ec03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:13.625949 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf489af-e74d-4181-b2ce-e9c4ff8f3bd5 service glance] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:13.627083 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf489af-e74d-4181-b2ce-e9c4ff8f3bd5 service glance] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:13.627342 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf489af-e74d-4181-b2ce-e9c4ff8f3bd5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:13.642380 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf489af-e74d-4181-b2ce-e9c4ff8f3bd5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:13.644540 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf489af-e74d-4181-b2ce-e9c4ff8f3bd5 service glance] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:13.657385 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1431/2854] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:15:13 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:15:17.701713 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2a213-cca6-452f-92a1-d0ca11d4bc44 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:17.703416 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-6bc2a213-cca6-452f-92a1-d0ca11d4bc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:17.795683 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:15:17.832919 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2a213-cca6-452f-92a1-d0ca11d4bc44 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:17.841831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211a1e5-a310-4ca5-9157-a7aaa0270763 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30bc55c6a1348bb961f0d010422da87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:17.842708 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211a1e5-a310-4ca5-9157-a7aaa0270763 service nova] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:17.842993 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211a1e5-a310-4ca5-9157-a7aaa0270763 service nova] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:17.843300 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211a1e5-a310-4ca5-9157-a7aaa0270763 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:17.846622 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-8211a1e5-a310-4ca5-9157-a7aaa0270763 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:17.861022 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211a1e5-a310-4ca5-9157-a7aaa0270763 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:17.863281 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211a1e5-a310-4ca5-9157-a7aaa0270763 service nova] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:17.877665 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1424/2855] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:15:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:15:23.651919 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:15:26.527536 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39b9d9-ac74-4049-a3d3-0b6082984dbe None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:26.528205 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39b9d9-ac74-4049-a3d3-0b6082984dbe None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:26.528335 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39b9d9-ac74-4049-a3d3-0b6082984dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:26.561053 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-6a39b9d9-ac74-4049-a3d3-0b6082984dbe None None] MFA Rules not processed for user `a372edc9a3d04b3ea2abe513bb249eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:15:26.562297 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6a39b9d9-ac74-4049-a3d3-0b6082984dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:26.626757 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1432/2856] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:15:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:15:26.885685 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211a1e5-a310-4ca5-9157-a7aaa0270763 service nova] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:26.887361 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-8211a1e5-a310-4ca5-9157-a7aaa0270763 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:26.953600 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211a1e5-a310-4ca5-9157-a7aaa0270763 service nova] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:26.958194 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9459cd-7465-44dc-882d-75c3a16d2afe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:26.958976 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9459cd-7465-44dc-882d-75c3a16d2afe service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:26.959280 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9459cd-7465-44dc-882d-75c3a16d2afe service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:26.959563 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9459cd-7465-44dc-882d-75c3a16d2afe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:26.961671 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-7f9459cd-7465-44dc-882d-75c3a16d2afe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:26.973806 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9459cd-7465-44dc-882d-75c3a16d2afe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:26.975408 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9459cd-7465-44dc-882d-75c3a16d2afe service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:26.991026 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1425/2857] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:15:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:15:36.619799 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=25 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:15:36.981110 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=38 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:15:43.898368 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39b9d9-ac74-4049-a3d3-0b6082984dbe None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:43.903272 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6a39b9d9-ac74-4049-a3d3-0b6082984dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:43.998560 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39b9d9-ac74-4049-a3d3-0b6082984dbe None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:44.004540 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31522286-1d52-43d6-a077-068f4a099ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:44.005436 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31522286-1d52-43d6-a077-068f4a099ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:44.005881 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31522286-1d52-43d6-a077-068f4a099ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:44.006223 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31522286-1d52-43d6-a077-068f4a099ca2 admin admin] PATH_INFO: `/v3/users/df249aada9644365b79f24283d8e3407` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:44.007916 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31522286-1d52-43d6-a077-068f4a099ca2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df249aada9644365b79f24283d8e3407)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:44.010943 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31522286-1d52-43d6-a077-068f4a099ca2 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:44.092137 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-31522286-1d52-43d6-a077-068f4a099ca2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df249aada9644365b79f24283d8e3407'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:44.110284 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-31522286-1d52-43d6-a077-068f4a099ca2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df249aada9644365b79f24283d8e3407'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:44.111609 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-31522286-1d52-43d6-a077-068f4a099ca2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df249aada9644365b79f24283d8e3407'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:44.144226 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-31522286-1d52-43d6-a077-068f4a099ca2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df249aada9644365b79f24283d8e3407'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:44.145448 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-31522286-1d52-43d6-a077-068f4a099ca2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df249aada9644365b79f24283d8e3407'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:44.179573 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1433/2858] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:15:43 2022] DELETE /identity/v3/users/df249aada9644365b79f24283d8e3407 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:15:44.472262 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9459cd-7465-44dc-882d-75c3a16d2afe service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:44.499017 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9459cd-7465-44dc-882d-75c3a16d2afe service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:44.572537 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312f2e3-3f58-46a4-ab8f-68d910b9fb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:44.573357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312f2e3-3f58-46a4-ab8f-68d910b9fb93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:44.573745 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312f2e3-3f58-46a4-ab8f-68d910b9fb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:44.574116 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312f2e3-3f58-46a4-ab8f-68d910b9fb93 admin admin] PATH_INFO: `/v3/projects/ed417c359d064c678a34df323e743478` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:44.575566 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312f2e3-3f58-46a4-ab8f-68d910b9fb93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed417c359d064c678a34df323e743478)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:44.577745 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312f2e3-3f58-46a4-ab8f-68d910b9fb93 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:44.637675 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-8312f2e3-3f58-46a4-ab8f-68d910b9fb93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed417c359d064c678a34df323e743478', 'request_id': 'req-8312f2e3-3f58-46a4-ab8f-68d910b9fb93'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:44.645564 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-8312f2e3-3f58-46a4-ab8f-68d910b9fb93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed417c359d064c678a34df323e743478', 'request_id': 'req-8312f2e3-3f58-46a4-ab8f-68d910b9fb93'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:44.655495 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-8312f2e3-3f58-46a4-ab8f-68d910b9fb93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed417c359d064c678a34df323e743478', 'request_id': 'req-8312f2e3-3f58-46a4-ab8f-68d910b9fb93'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:44.670220 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-8312f2e3-3f58-46a4-ab8f-68d910b9fb93 admin admin] The token cache is being invalidate because project ed417c359d064c678a34df323e743478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:15:44.670583 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-8312f2e3-3f58-46a4-ab8f-68d910b9fb93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:44.671273 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-8312f2e3-3f58-46a4-ab8f-68d910b9fb93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:44.672913 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1426/2859] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:15:44 2022] DELETE /identity/v3/projects/ed417c359d064c678a34df323e743478 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:15:45.431545 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd850e-187d-4163-9042-d130b709997f None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:45.432396 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd850e-187d-4163-9042-d130b709997f None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:45.432396 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd850e-187d-4163-9042-d130b709997f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:45.500187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-51fd850e-187d-4163-9042-d130b709997f None None] MFA Rules not processed for user `c607472800fc49d5a75c5e6acb33f2a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:15:45.501589 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-51fd850e-187d-4163-9042-d130b709997f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:45.566407 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:15:45.589672 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1434/2860] 10.222.0.65 () {58 vars in 1009 bytes} [Wed Jul 27 09:15:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:15:45.645388 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312f2e3-3f58-46a4-ab8f-68d910b9fb93 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:45.646981 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-8312f2e3-3f58-46a4-ab8f-68d910b9fb93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:45.762531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312f2e3-3f58-46a4-ab8f-68d910b9fb93 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:45.768700 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e26e6-f31c-45ce-8a0d-3fe4baa44064 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158ea5c9dd5142eebd903d5f732997ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:45.769344 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e26e6-f31c-45ce-8a0d-3fe4baa44064 service swift] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:45.769624 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e26e6-f31c-45ce-8a0d-3fe4baa44064 service swift] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:45.769897 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e26e6-f31c-45ce-8a0d-3fe4baa44064 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:45.780428 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e26e6-f31c-45ce-8a0d-3fe4baa44064 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:45.782419 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e26e6-f31c-45ce-8a0d-3fe4baa44064 service swift] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:45.788043 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:15:45.793892 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1427/2861] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 09:15:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 09:15:46.143371 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd850e-187d-4163-9042-d130b709997f None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:46.150356 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-51fd850e-187d-4163-9042-d130b709997f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:46.265156 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd850e-187d-4163-9042-d130b709997f None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:46.273101 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d6d58-7cec-4705-8a86-bb1ea514d79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:46.274443 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d6d58-7cec-4705-8a86-bb1ea514d79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:46.274844 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d6d58-7cec-4705-8a86-bb1ea514d79e admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:46.275169 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d6d58-7cec-4705-8a86-bb1ea514d79e admin admin] PATH_INFO: `/v3/users/7aaa1bb899204f229097303c25534347` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:46.276662 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d6d58-7cec-4705-8a86-bb1ea514d79e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aaa1bb899204f229097303c25534347)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:46.279477 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d6d58-7cec-4705-8a86-bb1ea514d79e admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:46.370792 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-6f9d6d58-7cec-4705-8a86-bb1ea514d79e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aaa1bb899204f229097303c25534347'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:46.391976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-6f9d6d58-7cec-4705-8a86-bb1ea514d79e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aaa1bb899204f229097303c25534347'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:46.394570 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-6f9d6d58-7cec-4705-8a86-bb1ea514d79e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aaa1bb899204f229097303c25534347'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:46.423538 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-6f9d6d58-7cec-4705-8a86-bb1ea514d79e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aaa1bb899204f229097303c25534347'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:46.424596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-6f9d6d58-7cec-4705-8a86-bb1ea514d79e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aaa1bb899204f229097303c25534347'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:46.449416 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1435/2862] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:15:46 2022] DELETE /identity/v3/users/7aaa1bb899204f229097303c25534347 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:15:46.457542 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea64bf2-93c9-4bd2-94bd-c3bf583433d5 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:46.457917 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea64bf2-93c9-4bd2-94bd-c3bf583433d5 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:46.458201 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea64bf2-93c9-4bd2-94bd-c3bf583433d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:46.490531 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-3ea64bf2-93c9-4bd2-94bd-c3bf583433d5 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:15:46.493137 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-3ea64bf2-93c9-4bd2-94bd-c3bf583433d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:46.603831 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1428/2863] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:15:46.619226 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d6d58-7cec-4705-8a86-bb1ea514d79e admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:46.622404 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6f9d6d58-7cec-4705-8a86-bb1ea514d79e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:46.771162 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d6d58-7cec-4705-8a86-bb1ea514d79e admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:46.783405 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82757023-035c-480d-b698-c776762a6813 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:46.784098 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82757023-035c-480d-b698-c776762a6813 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:46.784387 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82757023-035c-480d-b698-c776762a6813 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:46.784661 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82757023-035c-480d-b698-c776762a6813 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:46.796285 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82757023-035c-480d-b698-c776762a6813 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:46.797760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82757023-035c-480d-b698-c776762a6813 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:46.809778 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1436/2864] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:15:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:15:47.313968 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea64bf2-93c9-4bd2-94bd-c3bf583433d5 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:47.317596 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-3ea64bf2-93c9-4bd2-94bd-c3bf583433d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:47.366366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea64bf2-93c9-4bd2-94bd-c3bf583433d5 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:47.390009 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bcbc52-79a7-45ae-9081-2c7dec675927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:47.391114 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcbc52-79a7-45ae-9081-2c7dec675927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:47.391600 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcbc52-79a7-45ae-9081-2c7dec675927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:47.392081 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bcbc52-79a7-45ae-9081-2c7dec675927 admin admin] PATH_INFO: `/v3/projects/0a057a133347433098538602f8a6cc67` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:47.393865 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bcbc52-79a7-45ae-9081-2c7dec675927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a057a133347433098538602f8a6cc67)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:47.396105 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bcbc52-79a7-45ae-9081-2c7dec675927 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:47.486796 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-11bcbc52-79a7-45ae-9081-2c7dec675927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a057a133347433098538602f8a6cc67', 'request_id': 'req-11bcbc52-79a7-45ae-9081-2c7dec675927'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:47.504714 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-11bcbc52-79a7-45ae-9081-2c7dec675927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a057a133347433098538602f8a6cc67', 'request_id': 'req-11bcbc52-79a7-45ae-9081-2c7dec675927'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:47.519161 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-11bcbc52-79a7-45ae-9081-2c7dec675927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a057a133347433098538602f8a6cc67', 'request_id': 'req-11bcbc52-79a7-45ae-9081-2c7dec675927'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:47.544477 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-11bcbc52-79a7-45ae-9081-2c7dec675927 admin admin] The token cache is being invalidate because project 0a057a133347433098538602f8a6cc67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:15:47.545376 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-11bcbc52-79a7-45ae-9081-2c7dec675927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:47.546775 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-11bcbc52-79a7-45ae-9081-2c7dec675927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:15:47.549783 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1429/2865] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:15:47 2022] DELETE /identity/v3/projects/0a057a133347433098538602f8a6cc67 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:15:47.557117 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417254bf-89a4-40d8-9cf9-378381218ac7 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:47.557916 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417254bf-89a4-40d8-9cf9-378381218ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:47.557916 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417254bf-89a4-40d8-9cf9-378381218ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:47.590544 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-417254bf-89a4-40d8-9cf9-378381218ac7 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:15:47.592900 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-417254bf-89a4-40d8-9cf9-378381218ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:47.604114 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:15:47.686545 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1437/2866] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:15:47.698860 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dac43-e058-4ca6-aef7-81f77aa81b36 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:47.699325 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dac43-e058-4ca6-aef7-81f77aa81b36 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:47.699728 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dac43-e058-4ca6-aef7-81f77aa81b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:47.734925 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-2c5dac43-e058-4ca6-aef7-81f77aa81b36 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:15:47.736467 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-2c5dac43-e058-4ca6-aef7-81f77aa81b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:47.746784 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1430/2867] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:15:47.758047 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417254bf-89a4-40d8-9cf9-378381218ac7 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:47.786271 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417254bf-89a4-40d8-9cf9-378381218ac7 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:47.795499 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13455cc1-6241-4776-bf28-09abc30e1f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:47.796375 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13455cc1-6241-4776-bf28-09abc30e1f08 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:47.796777 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13455cc1-6241-4776-bf28-09abc30e1f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:47.797163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13455cc1-6241-4776-bf28-09abc30e1f08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:47.798362 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13455cc1-6241-4776-bf28-09abc30e1f08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:15:47.798923 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13455cc1-6241-4776-bf28-09abc30e1f08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:47.801391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13455cc1-6241-4776-bf28-09abc30e1f08 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:47.825197 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1438/2868] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:15:47.831919 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5dac43-e058-4ca6-aef7-81f77aa81b36 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:47.844907 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5dac43-e058-4ca6-aef7-81f77aa81b36 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:47.850781 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80471cda-18b8-4611-8c16-f6ff39848c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:47.851735 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80471cda-18b8-4611-8c16-f6ff39848c4e admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:47.852233 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80471cda-18b8-4611-8c16-f6ff39848c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:47.852508 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80471cda-18b8-4611-8c16-f6ff39848c4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:47.853311 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80471cda-18b8-4611-8c16-f6ff39848c4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:47.855457 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80471cda-18b8-4611-8c16-f6ff39848c4e admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:47.898375 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1431/2869] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:15:47 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:15:47.904578 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13455cc1-6241-4776-bf28-09abc30e1f08 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:47.916489 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13455cc1-6241-4776-bf28-09abc30e1f08 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:48.016696 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b721b6-2b46-4e48-b900-198877028669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:48.017711 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b721b6-2b46-4e48-b900-198877028669 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:48.018044 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b721b6-2b46-4e48-b900-198877028669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:48.018428 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b721b6-2b46-4e48-b900-198877028669 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:48.019287 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b721b6-2b46-4e48-b900-198877028669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:48.021882 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b721b6-2b46-4e48-b900-198877028669 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:48.066897 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1439/2870] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:15:47 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:15:48.070309 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80471cda-18b8-4611-8c16-f6ff39848c4e admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:48.100684 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80471cda-18b8-4611-8c16-f6ff39848c4e admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:48.123292 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89eb51-e67d-491c-bac2-718c441fe7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:48.124472 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89eb51-e67d-491c-bac2-718c441fe7cf admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:48.124740 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89eb51-e67d-491c-bac2-718c441fe7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:48.125191 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89eb51-e67d-491c-bac2-718c441fe7cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:48.126556 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89eb51-e67d-491c-bac2-718c441fe7cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:48.129702 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89eb51-e67d-491c-bac2-718c441fe7cf admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:48.161884 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1432/2871] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:15:48.163165 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b721b6-2b46-4e48-b900-198877028669 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:48.189710 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b721b6-2b46-4e48-b900-198877028669 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:48.200699 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7a906-f6cf-4120-a575-323de42c2196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:48.202444 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7a906-f6cf-4120-a575-323de42c2196 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:48.203007 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7a906-f6cf-4120-a575-323de42c2196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:48.203808 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7a906-f6cf-4120-a575-323de42c2196 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:48.205001 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7a906-f6cf-4120-a575-323de42c2196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:48.208390 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7a906-f6cf-4120-a575-323de42c2196 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:48.229394 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1440/2872] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:15:48.236129 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89eb51-e67d-491c-bac2-718c441fe7cf admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:48.256260 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89eb51-e67d-491c-bac2-718c441fe7cf admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:48.264570 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5247a-3bd5-4827-9a2e-6ee36be81427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:48.266269 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5247a-3bd5-4827-9a2e-6ee36be81427 admin admin] REQUEST_METHOD: `PUT` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:48.267200 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5247a-3bd5-4827-9a2e-6ee36be81427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:48.268557 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5247a-3bd5-4827-9a2e-6ee36be81427 admin admin] PATH_INFO: `/v3/projects/b820f03e50574541a29f4337fc491aea/users/713ca20fb552439a8cc341f16e07c5c0/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:48.289723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5247a-3bd5-4827-9a2e-6ee36be81427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b820f03e50574541a29f4337fc491aea, user_id=713ca20fb552439a8cc341f16e07c5c0, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:48.293377 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5247a-3bd5-4827-9a2e-6ee36be81427 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:48.320257 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1433/2873] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:15:48 2022] PUT /identity/v3/projects/b820f03e50574541a29f4337fc491aea/users/713ca20fb552439a8cc341f16e07c5c0/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:15:48.336584 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b18901-5e38-479d-8faa-a50214c98e7c None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:48.337096 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b18901-5e38-479d-8faa-a50214c98e7c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:48.337554 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b18901-5e38-479d-8faa-a50214c98e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:48.389712 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-57b18901-5e38-479d-8faa-a50214c98e7c None None] MFA Rules not processed for user `713ca20fb552439a8cc341f16e07c5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:15:48.391346 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-57b18901-5e38-479d-8faa-a50214c98e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:48.492300 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1441/2874] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:15:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:15:48.505879 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5247a-3bd5-4827-9a2e-6ee36be81427 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:15:48.508478 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-19b5247a-3bd5-4827-9a2e-6ee36be81427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:15:48.557923 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:15:48.610639 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5247a-3bd5-4827-9a2e-6ee36be81427 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:15:48.614595 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ac9f2-973a-46d0-a6cc-18d7bc9522b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '713805e0f1174a01987014319075ec03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:15:48.615252 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ac9f2-973a-46d0-a6cc-18d7bc9522b3 service glance] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:15:48.615532 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ac9f2-973a-46d0-a6cc-18d7bc9522b3 service glance] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:15:48.615805 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ac9f2-973a-46d0-a6cc-18d7bc9522b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:15:48.626415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ac9f2-973a-46d0-a6cc-18d7bc9522b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:15:48.627930 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ac9f2-973a-46d0-a6cc-18d7bc9522b3 service glance] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:15:48.643122 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1434/2875] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:15:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:15:58.484334 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:15:58.636484 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=17 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:16:07.969382 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1043de-5514-43a4-a155-7d0e1a4ae287 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:07.970093 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1043de-5514-43a4-a155-7d0e1a4ae287 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:07.970447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1043de-5514-43a4-a155-7d0e1a4ae287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:08.001038 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-5a1043de-5514-43a4-a155-7d0e1a4ae287 None None] MFA Rules not processed for user `c607472800fc49d5a75c5e6acb33f2a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:16:08.002241 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-5a1043de-5514-43a4-a155-7d0e1a4ae287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:16:08.084831 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1442/2876] 10.222.0.65 () {58 vars in 967 bytes} [Wed Jul 27 09:16:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:16:08.103607 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ac9f2-973a-46d0-a6cc-18d7bc9522b3 service glance] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:16:08.105970 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-d58ac9f2-973a-46d0-a6cc-18d7bc9522b3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:16:08.213235 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ac9f2-973a-46d0-a6cc-18d7bc9522b3 service glance] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:16:08.218501 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51473b2c-35b3-4328-a713-7e01d1862458 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158ea5c9dd5142eebd903d5f732997ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:16:08.219822 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51473b2c-35b3-4328-a713-7e01d1862458 service swift] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:08.220102 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51473b2c-35b3-4328-a713-7e01d1862458 service swift] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:08.220373 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51473b2c-35b3-4328-a713-7e01d1862458 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:08.230770 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51473b2c-35b3-4328-a713-7e01d1862458 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:16:08.232496 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51473b2c-35b3-4328-a713-7e01d1862458 service swift] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:16:08.242666 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1435/2877] 10.222.0.65 () {60 vars in 1384 bytes} [Wed Jul 27 09:16:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 09:16:10.565095 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1043de-5514-43a4-a155-7d0e1a4ae287 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:16:10.567170 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-5a1043de-5514-43a4-a155-7d0e1a4ae287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:16:10.643473 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51473b2c-35b3-4328-a713-7e01d1862458 service swift] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:16:10.645373 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-51473b2c-35b3-4328-a713-7e01d1862458 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:16:10.693115 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1043de-5514-43a4-a155-7d0e1a4ae287 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:16:10.700184 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16182e-5eeb-4b8e-8bb5-bda11a15df3e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d69004d02f9426b86e07907a553e523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:16:10.701500 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16182e-5eeb-4b8e-8bb5-bda11a15df3e service placement] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:10.701985 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16182e-5eeb-4b8e-8bb5-bda11a15df3e service placement] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:10.702487 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16182e-5eeb-4b8e-8bb5-bda11a15df3e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:10.705008 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-8a16182e-5eeb-4b8e-8bb5-bda11a15df3e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:16:10.726677 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16182e-5eeb-4b8e-8bb5-bda11a15df3e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:16:10.730883 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16182e-5eeb-4b8e-8bb5-bda11a15df3e service placement] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:16:10.743397 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51473b2c-35b3-4328-a713-7e01d1862458 service swift] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:16:10.748767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65ceca-2ad0-49bb-82f7-8dc7ff9810e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:16:10.749256 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1443/2878] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:16:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:16:10.749511 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65ceca-2ad0-49bb-82f7-8dc7ff9810e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:10.749796 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65ceca-2ad0-49bb-82f7-8dc7ff9810e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:10.750071 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65ceca-2ad0-49bb-82f7-8dc7ff9810e9 admin admin] PATH_INFO: `/v3/users/a372edc9a3d04b3ea2abe513bb249eaa` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:10.751427 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65ceca-2ad0-49bb-82f7-8dc7ff9810e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a372edc9a3d04b3ea2abe513bb249eaa)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:16:10.753432 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65ceca-2ad0-49bb-82f7-8dc7ff9810e9 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:16:10.824165 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-5d65ceca-2ad0-49bb-82f7-8dc7ff9810e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a372edc9a3d04b3ea2abe513bb249eaa'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:10.824879 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-5d65ceca-2ad0-49bb-82f7-8dc7ff9810e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a372edc9a3d04b3ea2abe513bb249eaa'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:10.825513 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-5d65ceca-2ad0-49bb-82f7-8dc7ff9810e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a372edc9a3d04b3ea2abe513bb249eaa'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:10.835795 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-5d65ceca-2ad0-49bb-82f7-8dc7ff9810e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a372edc9a3d04b3ea2abe513bb249eaa'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:10.854560 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-5d65ceca-2ad0-49bb-82f7-8dc7ff9810e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a372edc9a3d04b3ea2abe513bb249eaa'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:10.870847 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1436/2879] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:16:10 2022] DELETE /identity/v3/users/a372edc9a3d04b3ea2abe513bb249eaa => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:16:11.088012 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16182e-5eeb-4b8e-8bb5-bda11a15df3e service placement] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:16:11.106697 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16182e-5eeb-4b8e-8bb5-bda11a15df3e service placement] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:16:11.182234 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6159898-7053-42b2-9164-ad6c5d4c4be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:16:11.183109 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6159898-7053-42b2-9164-ad6c5d4c4be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:11.183398 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6159898-7053-42b2-9164-ad6c5d4c4be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:11.183676 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6159898-7053-42b2-9164-ad6c5d4c4be2 admin admin] PATH_INFO: `/v3/projects/0f105bb9e18c4600894fc64123ced323` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:11.184934 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6159898-7053-42b2-9164-ad6c5d4c4be2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f105bb9e18c4600894fc64123ced323)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:16:11.186966 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6159898-7053-42b2-9164-ad6c5d4c4be2 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:16:11.246494 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:16:11.260222 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b6159898-7053-42b2-9164-ad6c5d4c4be2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f105bb9e18c4600894fc64123ced323', 'request_id': 'req-b6159898-7053-42b2-9164-ad6c5d4c4be2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:11.268355 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b6159898-7053-42b2-9164-ad6c5d4c4be2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f105bb9e18c4600894fc64123ced323', 'request_id': 'req-b6159898-7053-42b2-9164-ad6c5d4c4be2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:11.275962 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b6159898-7053-42b2-9164-ad6c5d4c4be2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f105bb9e18c4600894fc64123ced323', 'request_id': 'req-b6159898-7053-42b2-9164-ad6c5d4c4be2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:11.291625 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b6159898-7053-42b2-9164-ad6c5d4c4be2 admin admin] The token cache is being invalidate because project 0f105bb9e18c4600894fc64123ced323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:16:11.291971 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b6159898-7053-42b2-9164-ad6c5d4c4be2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:11.292752 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b6159898-7053-42b2-9164-ad6c5d4c4be2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:11.294548 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1444/2880] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:16:11 2022] DELETE /identity/v3/projects/0f105bb9e18c4600894fc64123ced323 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:16:11.300041 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eeb44c-424b-4fcb-86f0-3bc148c31778 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:11.300383 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eeb44c-424b-4fcb-86f0-3bc148c31778 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:11.300674 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eeb44c-424b-4fcb-86f0-3bc148c31778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:11.322921 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-06eeb44c-424b-4fcb-86f0-3bc148c31778 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:16:11.324181 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-06eeb44c-424b-4fcb-86f0-3bc148c31778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:16:11.331556 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:16:11.409118 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1437/2881] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:16:11.417689 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b68c4a-a83b-41bd-bfe9-b5f2e467f6e0 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:11.417976 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b68c4a-a83b-41bd-bfe9-b5f2e467f6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:11.418241 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b68c4a-a83b-41bd-bfe9-b5f2e467f6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:11.441098 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-86b68c4a-a83b-41bd-bfe9-b5f2e467f6e0 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:16:11.442557 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-86b68c4a-a83b-41bd-bfe9-b5f2e467f6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:16:11.453329 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1445/2882] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:16:11.458058 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eeb44c-424b-4fcb-86f0-3bc148c31778 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:16:11.469663 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eeb44c-424b-4fcb-86f0-3bc148c31778 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:16:11.474442 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b6dbd-34f9-40ec-b354-e4545e9886d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:16:11.475080 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b6dbd-34f9-40ec-b354-e4545e9886d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:11.475359 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b6dbd-34f9-40ec-b354-e4545e9886d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:11.475631 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b6dbd-34f9-40ec-b354-e4545e9886d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:11.476430 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b6dbd-34f9-40ec-b354-e4545e9886d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:16:11.476900 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b6dbd-34f9-40ec-b354-e4545e9886d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:16:11.479311 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b6dbd-34f9-40ec-b354-e4545e9886d7 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:16:11.492416 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1438/2883] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 09:16:11.500186 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b68c4a-a83b-41bd-bfe9-b5f2e467f6e0 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:16:11.517079 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b68c4a-a83b-41bd-bfe9-b5f2e467f6e0 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:16:11.525449 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ac79a-af84-4688-90e8-58b856445ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:16:11.526568 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ac79a-af84-4688-90e8-58b856445ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:11.527057 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ac79a-af84-4688-90e8-58b856445ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:11.527564 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ac79a-af84-4688-90e8-58b856445ee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:11.528773 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ac79a-af84-4688-90e8-58b856445ee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:16:11.532505 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ac79a-af84-4688-90e8-58b856445ee5 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:16:11.581102 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1446/2884] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:16:11 2022] POST /identity/v3/projects => generated 385 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:16:11.587508 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b6dbd-34f9-40ec-b354-e4545e9886d7 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:16:11.606970 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b6dbd-34f9-40ec-b354-e4545e9886d7 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:16:11.698647 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943fbf0-2329-42d0-afe2-5b7eadfc7d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:16:11.699522 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943fbf0-2329-42d0-afe2-5b7eadfc7d27 admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:11.699665 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943fbf0-2329-42d0-afe2-5b7eadfc7d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:11.699804 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943fbf0-2329-42d0-afe2-5b7eadfc7d27 admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:11.700756 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943fbf0-2329-42d0-afe2-5b7eadfc7d27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:16:11.702856 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943fbf0-2329-42d0-afe2-5b7eadfc7d27 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:16:11.728366 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1439/2885] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:16:11 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:16:11.735062 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ac79a-af84-4688-90e8-58b856445ee5 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:16:11.753535 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ac79a-af84-4688-90e8-58b856445ee5 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:16:11.762566 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab21614-182a-4a19-9ec0-62d7b07e3558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:16:11.763659 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab21614-182a-4a19-9ec0-62d7b07e3558 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:11.764207 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab21614-182a-4a19-9ec0-62d7b07e3558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:11.764713 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab21614-182a-4a19-9ec0-62d7b07e3558 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:11.766057 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab21614-182a-4a19-9ec0-62d7b07e3558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:16:11.769394 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab21614-182a-4a19-9ec0-62d7b07e3558 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:16:11.791104 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1447/2886] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:16:11.797021 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943fbf0-2329-42d0-afe2-5b7eadfc7d27 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:16:11.809535 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943fbf0-2329-42d0-afe2-5b7eadfc7d27 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:16:11.815892 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05537c36-7e98-4b81-af88-a011d0130889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:16:11.816592 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05537c36-7e98-4b81-af88-a011d0130889 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:11.816913 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05537c36-7e98-4b81-af88-a011d0130889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:11.817227 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05537c36-7e98-4b81-af88-a011d0130889 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:11.818000 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05537c36-7e98-4b81-af88-a011d0130889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:16:11.819784 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05537c36-7e98-4b81-af88-a011d0130889 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:16:11.832709 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1440/2887] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:16:11.837983 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab21614-182a-4a19-9ec0-62d7b07e3558 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:16:11.848983 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab21614-182a-4a19-9ec0-62d7b07e3558 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:16:11.855091 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fd86d-8be4-43d3-9525-57966cb89118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:16:11.855867 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fd86d-8be4-43d3-9525-57966cb89118 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:11.856166 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fd86d-8be4-43d3-9525-57966cb89118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:11.856441 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fd86d-8be4-43d3-9525-57966cb89118 admin admin] PATH_INFO: `/v3/projects/5eabd3d6b9604f00912d119eb648b820/users/505764f6a10e4dbb8dd83fd9ca5db6cb/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:11.874034 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7fd86d-8be4-43d3-9525-57966cb89118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eabd3d6b9604f00912d119eb648b820, user_id=505764f6a10e4dbb8dd83fd9ca5db6cb, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:16:11.876760 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7fd86d-8be4-43d3-9525-57966cb89118 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:16:11.893308 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1448/2888] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:16:11 2022] PUT /identity/v3/projects/5eabd3d6b9604f00912d119eb648b820/users/505764f6a10e4dbb8dd83fd9ca5db6cb/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:16:11.907216 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b0df9-2ec4-4d4b-9b81-91220bc77464 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:11.907647 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b0df9-2ec4-4d4b-9b81-91220bc77464 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:11.908023 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b0df9-2ec4-4d4b-9b81-91220bc77464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:11.942142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-ef9b0df9-2ec4-4d4b-9b81-91220bc77464 None None] MFA Rules not processed for user `505764f6a10e4dbb8dd83fd9ca5db6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:16:11.943857 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-ef9b0df9-2ec4-4d4b-9b81-91220bc77464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:16:12.028230 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1441/2889] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:16:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:16:12.041294 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fd86d-8be4-43d3-9525-57966cb89118 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:16:12.043422 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9e7fd86d-8be4-43d3-9525-57966cb89118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:16:12.115563 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fd86d-8be4-43d3-9525-57966cb89118 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:16:12.120758 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf06ec-e3f4-4a26-a9a9-5de36888c1f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:16:12.121466 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf06ec-e3f4-4a26-a9a9-5de36888c1f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:12.121788 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf06ec-e3f4-4a26-a9a9-5de36888c1f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:12.122103 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf06ec-e3f4-4a26-a9a9-5de36888c1f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:12.132423 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf06ec-e3f4-4a26-a9a9-5de36888c1f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:16:12.134036 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf06ec-e3f4-4a26-a9a9-5de36888c1f6 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:16:12.144608 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1449/2890] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:16:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:16:14.943085 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b0df9-2ec4-4d4b-9b81-91220bc77464 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:16:14.950458 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:16:15.034470 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b0df9-2ec4-4d4b-9b81-91220bc77464 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:16:15.044716 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb42364-99ec-4177-bd9a-e583cf2d6685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:16:15.045993 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb42364-99ec-4177-bd9a-e583cf2d6685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:15.046644 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb42364-99ec-4177-bd9a-e583cf2d6685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:15.047134 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb42364-99ec-4177-bd9a-e583cf2d6685 admin admin] PATH_INFO: `/v3/users/505764f6a10e4dbb8dd83fd9ca5db6cb` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:15.049981 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb42364-99ec-4177-bd9a-e583cf2d6685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=505764f6a10e4dbb8dd83fd9ca5db6cb)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:16:15.054110 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb42364-99ec-4177-bd9a-e583cf2d6685 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:16:15.140705 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-4eb42364-99ec-4177-bd9a-e583cf2d6685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '505764f6a10e4dbb8dd83fd9ca5db6cb'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:15.141674 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-4eb42364-99ec-4177-bd9a-e583cf2d6685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '505764f6a10e4dbb8dd83fd9ca5db6cb'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:15.142705 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-4eb42364-99ec-4177-bd9a-e583cf2d6685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '505764f6a10e4dbb8dd83fd9ca5db6cb'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:15.154203 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-4eb42364-99ec-4177-bd9a-e583cf2d6685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '505764f6a10e4dbb8dd83fd9ca5db6cb'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:15.177825 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-4eb42364-99ec-4177-bd9a-e583cf2d6685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '505764f6a10e4dbb8dd83fd9ca5db6cb'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:15.199222 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1442/2891] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:16:14 2022] DELETE /identity/v3/users/505764f6a10e4dbb8dd83fd9ca5db6cb => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:16:15.206898 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701c9d4-7b62-46a1-9a51-7270adb137c0 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:15.207608 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701c9d4-7b62-46a1-9a51-7270adb137c0 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:15.207608 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701c9d4-7b62-46a1-9a51-7270adb137c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:15.250911 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-1701c9d4-7b62-46a1-9a51-7270adb137c0 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:16:15.253206 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1701c9d4-7b62-46a1-9a51-7270adb137c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:16:15.350727 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1450/2892] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:16:15.366100 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb42364-99ec-4177-bd9a-e583cf2d6685 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:16:15.368118 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-4eb42364-99ec-4177-bd9a-e583cf2d6685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:16:15.439776 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb42364-99ec-4177-bd9a-e583cf2d6685 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:16:15.446234 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75977d-3004-42d9-b247-76ac19a27ded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:16:15.447341 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75977d-3004-42d9-b247-76ac19a27ded service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:15.447777 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75977d-3004-42d9-b247-76ac19a27ded service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:15.448151 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75977d-3004-42d9-b247-76ac19a27ded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:15.459823 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75977d-3004-42d9-b247-76ac19a27ded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:16:15.462256 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75977d-3004-42d9-b247-76ac19a27ded service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:16:15.473873 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1443/2893] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:16:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:16:15.844254 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701c9d4-7b62-46a1-9a51-7270adb137c0 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:16:15.846634 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1701c9d4-7b62-46a1-9a51-7270adb137c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:16:15.863311 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:16:15.872741 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701c9d4-7b62-46a1-9a51-7270adb137c0 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:16:15.885157 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a24508-214d-4112-b802-e845916aa46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:16:15.886287 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a24508-214d-4112-b802-e845916aa46f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:15.886624 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a24508-214d-4112-b802-e845916aa46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:15.886940 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a24508-214d-4112-b802-e845916aa46f admin admin] PATH_INFO: `/v3/projects/5eabd3d6b9604f00912d119eb648b820` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:15.888275 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a24508-214d-4112-b802-e845916aa46f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eabd3d6b9604f00912d119eb648b820)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:16:15.890259 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a24508-214d-4112-b802-e845916aa46f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:16:15.952391 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c6a24508-214d-4112-b802-e845916aa46f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eabd3d6b9604f00912d119eb648b820', 'request_id': 'req-c6a24508-214d-4112-b802-e845916aa46f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:15.959520 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c6a24508-214d-4112-b802-e845916aa46f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eabd3d6b9604f00912d119eb648b820', 'request_id': 'req-c6a24508-214d-4112-b802-e845916aa46f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:15.968017 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c6a24508-214d-4112-b802-e845916aa46f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eabd3d6b9604f00912d119eb648b820', 'request_id': 'req-c6a24508-214d-4112-b802-e845916aa46f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:15.984919 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c6a24508-214d-4112-b802-e845916aa46f admin admin] The token cache is being invalidate because project 5eabd3d6b9604f00912d119eb648b820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:16:15.985300 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c6a24508-214d-4112-b802-e845916aa46f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:15.986048 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c6a24508-214d-4112-b802-e845916aa46f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:15.987927 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1451/2894] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:16:15 2022] DELETE /identity/v3/projects/5eabd3d6b9604f00912d119eb648b820 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:16:22.406210 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75977d-3004-42d9-b247-76ac19a27ded service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:16:22.407789 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-2d75977d-3004-42d9-b247-76ac19a27ded service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:16:22.423605 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75977d-3004-42d9-b247-76ac19a27ded service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:16:22.457759 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:16:22.499538 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfae83-5cc2-442c-88e6-1ebb747d2837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:16:22.500193 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfae83-5cc2-442c-88e6-1ebb747d2837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:22.500474 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfae83-5cc2-442c-88e6-1ebb747d2837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:22.500745 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfae83-5cc2-442c-88e6-1ebb747d2837 admin admin] PATH_INFO: `/v3/users/713ca20fb552439a8cc341f16e07c5c0` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:22.501976 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfae83-5cc2-442c-88e6-1ebb747d2837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=713ca20fb552439a8cc341f16e07c5c0)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:16:22.503983 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfae83-5cc2-442c-88e6-1ebb747d2837 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:16:22.561438 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-11bfae83-5cc2-442c-88e6-1ebb747d2837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '713ca20fb552439a8cc341f16e07c5c0'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:22.562136 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-11bfae83-5cc2-442c-88e6-1ebb747d2837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '713ca20fb552439a8cc341f16e07c5c0'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:22.562803 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-11bfae83-5cc2-442c-88e6-1ebb747d2837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '713ca20fb552439a8cc341f16e07c5c0'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:22.571938 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-11bfae83-5cc2-442c-88e6-1ebb747d2837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '713ca20fb552439a8cc341f16e07c5c0'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:22.587215 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-11bfae83-5cc2-442c-88e6-1ebb747d2837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '713ca20fb552439a8cc341f16e07c5c0'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:22.601556 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1444/2895] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:16:22 2022] DELETE /identity/v3/users/713ca20fb552439a8cc341f16e07c5c0 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:16:22.606896 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798d325-0f40-4183-9647-9c982b403894 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:22.607483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798d325-0f40-4183-9647-9c982b403894 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:22.607483 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798d325-0f40-4183-9647-9c982b403894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:22.628525 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f798d325-0f40-4183-9647-9c982b403894 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:16:22.629853 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f798d325-0f40-4183-9647-9c982b403894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:16:22.708471 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1452/2896] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:16:22.720695 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfae83-5cc2-442c-88e6-1ebb747d2837 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:16:22.723114 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-11bfae83-5cc2-442c-88e6-1ebb747d2837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:16:22.823523 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfae83-5cc2-442c-88e6-1ebb747d2837 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:16:22.827557 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90662b1-8092-401a-b226-cb041ae14abc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:16:22.828206 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90662b1-8092-401a-b226-cb041ae14abc service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:22.828489 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90662b1-8092-401a-b226-cb041ae14abc service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:22.828767 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90662b1-8092-401a-b226-cb041ae14abc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:22.840427 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90662b1-8092-401a-b226-cb041ae14abc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:16:22.841959 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90662b1-8092-401a-b226-cb041ae14abc service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:16:22.854054 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1445/2897] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:16:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:16:23.293626 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798d325-0f40-4183-9647-9c982b403894 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:16:23.295409 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f798d325-0f40-4183-9647-9c982b403894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:16:23.318092 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798d325-0f40-4183-9647-9c982b403894 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:16:23.331326 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c545e-5017-420d-b729-ffa8888a85e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:16:23.332932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c545e-5017-420d-b729-ffa8888a85e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:23.332932 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c545e-5017-420d-b729-ffa8888a85e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:23.333302 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c545e-5017-420d-b729-ffa8888a85e2 admin admin] PATH_INFO: `/v3/projects/b820f03e50574541a29f4337fc491aea` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:23.335606 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c545e-5017-420d-b729-ffa8888a85e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b820f03e50574541a29f4337fc491aea)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:16:23.338757 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c545e-5017-420d-b729-ffa8888a85e2 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:16:23.398078 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-744c545e-5017-420d-b729-ffa8888a85e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b820f03e50574541a29f4337fc491aea', 'request_id': 'req-744c545e-5017-420d-b729-ffa8888a85e2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:23.405572 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-744c545e-5017-420d-b729-ffa8888a85e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b820f03e50574541a29f4337fc491aea', 'request_id': 'req-744c545e-5017-420d-b729-ffa8888a85e2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:23.413444 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-744c545e-5017-420d-b729-ffa8888a85e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b820f03e50574541a29f4337fc491aea', 'request_id': 'req-744c545e-5017-420d-b729-ffa8888a85e2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:23.433776 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-744c545e-5017-420d-b729-ffa8888a85e2 admin admin] The token cache is being invalidate because project b820f03e50574541a29f4337fc491aea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:16:23.434295 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-744c545e-5017-420d-b729-ffa8888a85e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:23.435471 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-744c545e-5017-420d-b729-ffa8888a85e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:23.438161 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1453/2898] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:16:23 2022] DELETE /identity/v3/projects/b820f03e50574541a29f4337fc491aea => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:16:23.444734 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fa09a-01e9-4a5a-b840-eb6ef4a070df None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:23.445383 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fa09a-01e9-4a5a-b840-eb6ef4a070df None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:23.445383 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fa09a-01e9-4a5a-b840-eb6ef4a070df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:23.468836 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-0e1fa09a-01e9-4a5a-b840-eb6ef4a070df None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:16:23.470173 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-0e1fa09a-01e9-4a5a-b840-eb6ef4a070df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:16:23.523704 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:16:23.545092 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1446/2899] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:16:23.553673 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746e96e-ac86-4096-97de-edf1a0a8c3cd None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:23.554037 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746e96e-ac86-4096-97de-edf1a0a8c3cd None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:23.554418 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746e96e-ac86-4096-97de-edf1a0a8c3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:23.578986 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-3746e96e-ac86-4096-97de-edf1a0a8c3cd None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:16:23.580249 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-3746e96e-ac86-4096-97de-edf1a0a8c3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:16:23.591482 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1454/2900] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:16:23.597594 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fa09a-01e9-4a5a-b840-eb6ef4a070df None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:16:23.609362 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fa09a-01e9-4a5a-b840-eb6ef4a070df None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:16:23.614513 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f42f0-70e3-4e61-8536-13c4189851f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:16:23.615340 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f42f0-70e3-4e61-8536-13c4189851f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:23.616297 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f42f0-70e3-4e61-8536-13c4189851f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:23.616675 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f42f0-70e3-4e61-8536-13c4189851f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:23.617548 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f42f0-70e3-4e61-8536-13c4189851f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 09:16:23.618066 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f42f0-70e3-4e61-8536-13c4189851f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:16:23.620171 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f42f0-70e3-4e61-8536-13c4189851f4 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:16:23.635495 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1447/2901] 10.222.0.65 () {58 vars in 1153 bytes} [Wed Jul 27 09:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 09:16:23.640708 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746e96e-ac86-4096-97de-edf1a0a8c3cd None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:16:23.648001 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:16:23.653086 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746e96e-ac86-4096-97de-edf1a0a8c3cd None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:16:23.661195 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2aed4-9dcf-4a16-9c4d-245f0ba2ee19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:16:23.662789 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2aed4-9dcf-4a16-9c4d-245f0ba2ee19 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:23.663187 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2aed4-9dcf-4a16-9c4d-245f0ba2ee19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:23.663756 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2aed4-9dcf-4a16-9c4d-245f0ba2ee19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:23.664963 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2aed4-9dcf-4a16-9c4d-245f0ba2ee19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:16:23.667258 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2aed4-9dcf-4a16-9c4d-245f0ba2ee19 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:16:23.699564 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1455/2902] 10.222.0.65 () {60 vars in 1153 bytes} [Wed Jul 27 09:16:23 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 09:16:23.704887 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f42f0-70e3-4e61-8536-13c4189851f4 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:16:23.716518 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f42f0-70e3-4e61-8536-13c4189851f4 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:16:23.785862 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37073f-7faf-4420-8afb-a82f02a4bcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:16:23.786710 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37073f-7faf-4420-8afb-a82f02a4bcbb admin admin] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:23.787067 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37073f-7faf-4420-8afb-a82f02a4bcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:23.787598 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37073f-7faf-4420-8afb-a82f02a4bcbb admin admin] PATH_INFO: `/v3/users` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:23.788450 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37073f-7faf-4420-8afb-a82f02a4bcbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:16:23.790544 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37073f-7faf-4420-8afb-a82f02a4bcbb admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:16:23.817165 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1448/2903] 10.222.0.65 () {60 vars in 1144 bytes} [Wed Jul 27 09:16:23 2022] POST /identity/v3/users => generated 286 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 09:16:23.822488 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2aed4-9dcf-4a16-9c4d-245f0ba2ee19 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:16:23.836593 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2aed4-9dcf-4a16-9c4d-245f0ba2ee19 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:16:23.845149 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0672b15-baf6-407a-8a73-0bf3270e0cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:16:23.846282 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0672b15-baf6-407a-8a73-0bf3270e0cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:23.846727 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0672b15-baf6-407a-8a73-0bf3270e0cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:23.847163 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0672b15-baf6-407a-8a73-0bf3270e0cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:23.848155 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0672b15-baf6-407a-8a73-0bf3270e0cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:16:23.851013 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0672b15-baf6-407a-8a73-0bf3270e0cd2 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:16:23.866495 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1456/2904] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:16:23.870250 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37073f-7faf-4420-8afb-a82f02a4bcbb admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:16:23.882585 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37073f-7faf-4420-8afb-a82f02a4bcbb admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:16:23.888176 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a289a8-7d99-4309-8b12-ea098be3cc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:16:23.889005 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a289a8-7d99-4309-8b12-ea098be3cc96 admin admin] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:23.889470 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a289a8-7d99-4309-8b12-ea098be3cc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:23.889825 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a289a8-7d99-4309-8b12-ea098be3cc96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:23.890722 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a289a8-7d99-4309-8b12-ea098be3cc96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:16:23.892622 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a289a8-7d99-4309-8b12-ea098be3cc96 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:16:23.907622 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1449/2905] 10.222.0.65 () {58 vars in 1122 bytes} [Wed Jul 27 09:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 09:16:23.912915 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0672b15-baf6-407a-8a73-0bf3270e0cd2 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:16:23.924724 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0672b15-baf6-407a-8a73-0bf3270e0cd2 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:16:23.930223 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac6eb7-6cfa-41d7-adc6-ec37a2526823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:16:23.931029 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac6eb7-6cfa-41d7-adc6-ec37a2526823 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:23.931373 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac6eb7-6cfa-41d7-adc6-ec37a2526823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:23.931730 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac6eb7-6cfa-41d7-adc6-ec37a2526823 admin admin] PATH_INFO: `/v3/projects/99f3bedb20da448db48eec6e68d45d0e/users/a9ee9424677047528b03e48965937990/roles/87d42817a302438b93da02bfed3f6781` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:23.953190 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac6eb7-6cfa-41d7-adc6-ec37a2526823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99f3bedb20da448db48eec6e68d45d0e, user_id=a9ee9424677047528b03e48965937990, role_id=87d42817a302438b93da02bfed3f6781)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:16:23.956429 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac6eb7-6cfa-41d7-adc6-ec37a2526823 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:16:23.973126 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1457/2906] 10.222.0.65 () {60 vars in 1483 bytes} [Wed Jul 27 09:16:23 2022] PUT /identity/v3/projects/99f3bedb20da448db48eec6e68d45d0e/users/a9ee9424677047528b03e48965937990/roles/87d42817a302438b93da02bfed3f6781 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:16:23.984688 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68240c5-8551-4e18-8974-f2bc74d6b5d7 None None] REQUEST_METHOD: `POST` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:23.985018 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68240c5-8551-4e18-8974-f2bc74d6b5d7 None None] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:23.985229 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68240c5-8551-4e18-8974-f2bc74d6b5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:24.019492 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.auth.core [None req-c68240c5-8551-4e18-8974-f2bc74d6b5d7 None None] MFA Rules not processed for user `a9ee9424677047528b03e48965937990`. Rule list: `[]` (Enabled: `True`). {{(pid=80153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:16:24.020747 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-c68240c5-8551-4e18-8974-f2bc74d6b5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:16:24.098150 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1450/2907] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:16:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 09:16:24.111505 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac6eb7-6cfa-41d7-adc6-ec37a2526823 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:16:24.113658 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-37ac6eb7-6cfa-41d7-adc6-ec37a2526823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:16:24.185326 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac6eb7-6cfa-41d7-adc6-ec37a2526823 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:16:24.189216 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af151ccc-14af-44d3-844e-2f7c12a5f3a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72763a52df364a4a8a660ec1be4aba79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:16:24.189857 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af151ccc-14af-44d3-844e-2f7c12a5f3a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:24.190142 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af151ccc-14af-44d3-844e-2f7c12a5f3a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:24.190447 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af151ccc-14af-44d3-844e-2f7c12a5f3a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:24.201035 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af151ccc-14af-44d3-844e-2f7c12a5f3a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:16:24.202630 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af151ccc-14af-44d3-844e-2f7c12a5f3a0 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:16:24.214484 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1458/2908] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:16:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:16:24.243584 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68240c5-8551-4e18-8974-f2bc74d6b5d7 None None] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:16:24.300210 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:16:24.322392 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68240c5-8551-4e18-8974-f2bc74d6b5d7 None None] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:16:24.327920 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db16a91-1695-4777-94f6-9aa44d006050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:16:24.328583 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db16a91-1695-4777-94f6-9aa44d006050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:24.328859 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db16a91-1695-4777-94f6-9aa44d006050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:24.329128 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db16a91-1695-4777-94f6-9aa44d006050 admin admin] PATH_INFO: `/v3/users/a9ee9424677047528b03e48965937990` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:24.330441 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db16a91-1695-4777-94f6-9aa44d006050 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9ee9424677047528b03e48965937990)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:16:24.332405 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db16a91-1695-4777-94f6-9aa44d006050 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:16:24.401110 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-9db16a91-1695-4777-94f6-9aa44d006050 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9ee9424677047528b03e48965937990'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:24.401773 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-9db16a91-1695-4777-94f6-9aa44d006050 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9ee9424677047528b03e48965937990'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:24.402415 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-9db16a91-1695-4777-94f6-9aa44d006050 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9ee9424677047528b03e48965937990'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:24.411723 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-9db16a91-1695-4777-94f6-9aa44d006050 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9ee9424677047528b03e48965937990'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:24.428843 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-9db16a91-1695-4777-94f6-9aa44d006050 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9ee9424677047528b03e48965937990'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:24.444633 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1451/2909] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:16:24 2022] DELETE /identity/v3/users/a9ee9424677047528b03e48965937990 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:16:24.452130 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b964661-3298-481c-aa6d-2b7892bc0fa0 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:24.452572 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b964661-3298-481c-aa6d-2b7892bc0fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:24.453018 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b964661-3298-481c-aa6d-2b7892bc0fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:24.476811 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-2b964661-3298-481c-aa6d-2b7892bc0fa0 None None] MFA Rules not processed for user `3e18e0dcebec4953bb7ade2050d92c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 09:16:24.478055 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-2b964661-3298-481c-aa6d-2b7892bc0fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:16:24.549597 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1459/2910] 10.222.0.65 () {58 vars in 958 bytes} [Wed Jul 27 09:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 09:16:24.562050 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db16a91-1695-4777-94f6-9aa44d006050 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:16:24.563637 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-9db16a91-1695-4777-94f6-9aa44d006050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:16:24.640812 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db16a91-1695-4777-94f6-9aa44d006050 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:16:24.645050 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3679a-a8b0-4304-9691-e9eb9409e1e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:16:24.645840 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3679a-a8b0-4304-9691-e9eb9409e1e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:24.646183 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3679a-a8b0-4304-9691-e9eb9409e1e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:24.647219 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3679a-a8b0-4304-9691-e9eb9409e1e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:24.659184 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c3679a-a8b0-4304-9691-e9eb9409e1e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:16:24.660731 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c3679a-a8b0-4304-9691-e9eb9409e1e9 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:16:24.673088 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1452/2911] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:16:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:16:25.053673 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b964661-3298-481c-aa6d-2b7892bc0fa0 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:16:25.055850 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-2b964661-3298-481c-aa6d-2b7892bc0fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:16:25.069954 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b964661-3298-481c-aa6d-2b7892bc0fa0 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:16:25.075985 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab1b48-1e09-455c-95d2-3e29d00a2031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:16:25.076656 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab1b48-1e09-455c-95d2-3e29d00a2031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:16:25.076964 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab1b48-1e09-455c-95d2-3e29d00a2031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:16:25.077226 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab1b48-1e09-455c-95d2-3e29d00a2031 admin admin] PATH_INFO: `/v3/projects/99f3bedb20da448db48eec6e68d45d0e` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:16:25.078540 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab1b48-1e09-455c-95d2-3e29d00a2031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99f3bedb20da448db48eec6e68d45d0e)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:16:25.080507 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab1b48-1e09-455c-95d2-3e29d00a2031 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:16:25.145833 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:16:25.151768 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-fbab1b48-1e09-455c-95d2-3e29d00a2031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99f3bedb20da448db48eec6e68d45d0e', 'request_id': 'req-fbab1b48-1e09-455c-95d2-3e29d00a2031'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:25.164441 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-fbab1b48-1e09-455c-95d2-3e29d00a2031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99f3bedb20da448db48eec6e68d45d0e', 'request_id': 'req-fbab1b48-1e09-455c-95d2-3e29d00a2031'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:25.171404 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-fbab1b48-1e09-455c-95d2-3e29d00a2031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99f3bedb20da448db48eec6e68d45d0e', 'request_id': 'req-fbab1b48-1e09-455c-95d2-3e29d00a2031'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:25.187264 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-fbab1b48-1e09-455c-95d2-3e29d00a2031 admin admin] The token cache is being invalidate because project 99f3bedb20da448db48eec6e68d45d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:16:25.187735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-fbab1b48-1e09-455c-95d2-3e29d00a2031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:25.188604 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-fbab1b48-1e09-455c-95d2-3e29d00a2031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:16:25.190298 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1460/2912] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:16:25 2022] DELETE /identity/v3/projects/99f3bedb20da448db48eec6e68d45d0e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:16:34.668142 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=59,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:16:35.183353 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:17:15.302931 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3679a-a8b0-4304-9691-e9eb9409e1e9 service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:17:15.304710 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-18c3679a-a8b0-4304-9691-e9eb9409e1e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:17:15.317648 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3679a-a8b0-4304-9691-e9eb9409e1e9 service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:17:15.379357 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490fc64e-1401-4d68-afe7-9444b0a86391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:17:15.379913 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fc64e-1401-4d68-afe7-9444b0a86391 service neutron] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:17:15.380199 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fc64e-1401-4d68-afe7-9444b0a86391 service neutron] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:17:15.380476 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fc64e-1401-4d68-afe7-9444b0a86391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:17:15.382519 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-490fc64e-1401-4d68-afe7-9444b0a86391 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:17:15.459850 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490fc64e-1401-4d68-afe7-9444b0a86391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:17:15.461469 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490fc64e-1401-4d68-afe7-9444b0a86391 service neutron] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:17:15.473475 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1453/2913] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:17:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 09:17:20.804558 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab1b48-1e09-455c-95d2-3e29d00a2031 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:17:20.808453 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fbab1b48-1e09-455c-95d2-3e29d00a2031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:17:20.826628 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab1b48-1e09-455c-95d2-3e29d00a2031 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:17:20.831291 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fcc70-8df3-4772-a22e-f55768987671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b018ac10ad804c6cbbe7fdcc1cec61e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:17:20.832094 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fcc70-8df3-4772-a22e-f55768987671 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:17:20.832537 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fcc70-8df3-4772-a22e-f55768987671 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:17:20.832877 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fcc70-8df3-4772-a22e-f55768987671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:17:20.835525 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fe5fcc70-8df3-4772-a22e-f55768987671 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:17:20.932743 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5fcc70-8df3-4772-a22e-f55768987671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:17:20.936284 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5fcc70-8df3-4772-a22e-f55768987671 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:17:20.957644 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1461/2914] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:17:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:17:25.058103 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490fc64e-1401-4d68-afe7-9444b0a86391 service neutron] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:17:25.059876 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-490fc64e-1401-4d68-afe7-9444b0a86391 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:17:25.173224 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490fc64e-1401-4d68-afe7-9444b0a86391 service neutron] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:17:25.182404 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9c454-ddad-4ac0-a9e6-37ffd581b832 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d69004d02f9426b86e07907a553e523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:17:25.183458 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9c454-ddad-4ac0-a9e6-37ffd581b832 service placement] REQUEST_METHOD: `GET` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:17:25.184647 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9c454-ddad-4ac0-a9e6-37ffd581b832 service placement] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:17:25.184974 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9c454-ddad-4ac0-a9e6-37ffd581b832 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:17:25.188554 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-81e9c454-ddad-4ac0-a9e6-37ffd581b832 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:17:25.210404 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9c454-ddad-4ac0-a9e6-37ffd581b832 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:17:25.213457 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9c454-ddad-4ac0-a9e6-37ffd581b832 service placement] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:17:25.233043 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1454/2915] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:17:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:17:29.288857 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fcc70-8df3-4772-a22e-f55768987671 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:17:29.290930 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fe5fcc70-8df3-4772-a22e-f55768987671 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:17:29.307887 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fcc70-8df3-4772-a22e-f55768987671 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:17:29.315735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036cb6a-d32d-435b-aed5-a0cdd8de26dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:17:29.316735 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036cb6a-d32d-435b-aed5-a0cdd8de26dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:17:29.317247 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036cb6a-d32d-435b-aed5-a0cdd8de26dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:17:29.317858 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036cb6a-d32d-435b-aed5-a0cdd8de26dc admin admin] PATH_INFO: `/v3/users/81a7cc8bd9ef48e6b97213cd71e4ca36` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:17:29.319799 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036cb6a-d32d-435b-aed5-a0cdd8de26dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=81a7cc8bd9ef48e6b97213cd71e4ca36)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:17:29.323043 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036cb6a-d32d-435b-aed5-a0cdd8de26dc admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:17:29.398558 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e036cb6a-d32d-435b-aed5-a0cdd8de26dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81a7cc8bd9ef48e6b97213cd71e4ca36'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:17:29.407804 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e036cb6a-d32d-435b-aed5-a0cdd8de26dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81a7cc8bd9ef48e6b97213cd71e4ca36'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:17:29.408596 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e036cb6a-d32d-435b-aed5-a0cdd8de26dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81a7cc8bd9ef48e6b97213cd71e4ca36'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:17:29.424987 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e036cb6a-d32d-435b-aed5-a0cdd8de26dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81a7cc8bd9ef48e6b97213cd71e4ca36'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:17:29.426193 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e036cb6a-d32d-435b-aed5-a0cdd8de26dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81a7cc8bd9ef48e6b97213cd71e4ca36'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:17:29.446369 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1462/2916] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:17:29 2022] DELETE /identity/v3/users/81a7cc8bd9ef48e6b97213cd71e4ca36 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:17:29.934761 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9c454-ddad-4ac0-a9e6-37ffd581b832 service placement] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:17:29.947019 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9c454-ddad-4ac0-a9e6-37ffd581b832 service placement] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:17:30.020370 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=100 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:17:30.051233 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e1f01-1f00-4d86-879a-797a1a836831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:17:30.053031 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e1f01-1f00-4d86-879a-797a1a836831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:17:30.053539 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e1f01-1f00-4d86-879a-797a1a836831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:17:30.054131 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e1f01-1f00-4d86-879a-797a1a836831 admin admin] PATH_INFO: `/v3/projects/114b08acd1eb43e985762921b090a37a` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:17:30.056455 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e1f01-1f00-4d86-879a-797a1a836831 admin admin] RBAC: Authorizing `identity:delete_project(project_id=114b08acd1eb43e985762921b090a37a)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:17:30.060885 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e1f01-1f00-4d86-879a-797a1a836831 admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:17:30.138039 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-0a9e1f01-1f00-4d86-879a-797a1a836831 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '114b08acd1eb43e985762921b090a37a', 'request_id': 'req-0a9e1f01-1f00-4d86-879a-797a1a836831'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:17:30.144556 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-0a9e1f01-1f00-4d86-879a-797a1a836831 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '114b08acd1eb43e985762921b090a37a', 'request_id': 'req-0a9e1f01-1f00-4d86-879a-797a1a836831'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:17:30.152955 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-0a9e1f01-1f00-4d86-879a-797a1a836831 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '114b08acd1eb43e985762921b090a37a', 'request_id': 'req-0a9e1f01-1f00-4d86-879a-797a1a836831'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:17:30.166074 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-0a9e1f01-1f00-4d86-879a-797a1a836831 admin admin] The token cache is being invalidate because project 114b08acd1eb43e985762921b090a37a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:17:30.166520 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-0a9e1f01-1f00-4d86-879a-797a1a836831 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:17:30.167071 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-0a9e1f01-1f00-4d86-879a-797a1a836831 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:17:30.168842 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1455/2917] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:17:29 2022] DELETE /identity/v3/projects/114b08acd1eb43e985762921b090a37a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 09:17:30.173235 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036cb6a-d32d-435b-aed5-a0cdd8de26dc admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:17:30.174838 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e036cb6a-d32d-435b-aed5-a0cdd8de26dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:17:30.189137 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036cb6a-d32d-435b-aed5-a0cdd8de26dc admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:17:30.255536 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53785da-f813-4eb1-8a1d-916f3b80102f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:17:30.256298 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53785da-f813-4eb1-8a1d-916f3b80102f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:17:30.256642 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53785da-f813-4eb1-8a1d-916f3b80102f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:17:30.256960 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53785da-f813-4eb1-8a1d-916f3b80102f admin admin] PATH_INFO: `/v3/users/1c5df1ae39f846c5a186c5f03dcb151e` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:17:30.258361 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53785da-f813-4eb1-8a1d-916f3b80102f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c5df1ae39f846c5a186c5f03dcb151e)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:17:30.260401 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53785da-f813-4eb1-8a1d-916f3b80102f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:17:30.267870 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:17:30.321827 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e53785da-f813-4eb1-8a1d-916f3b80102f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c5df1ae39f846c5a186c5f03dcb151e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:17:30.331744 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e53785da-f813-4eb1-8a1d-916f3b80102f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c5df1ae39f846c5a186c5f03dcb151e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:17:30.332531 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e53785da-f813-4eb1-8a1d-916f3b80102f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c5df1ae39f846c5a186c5f03dcb151e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:17:30.347843 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e53785da-f813-4eb1-8a1d-916f3b80102f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c5df1ae39f846c5a186c5f03dcb151e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:17:30.348618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e53785da-f813-4eb1-8a1d-916f3b80102f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c5df1ae39f846c5a186c5f03dcb151e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:17:30.368618 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1463/2918] 10.222.0.65 () {58 vars in 1224 bytes} [Wed Jul 27 09:17:30 2022] DELETE /identity/v3/users/1c5df1ae39f846c5a186c5f03dcb151e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:17:30.596131 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e1f01-1f00-4d86-879a-797a1a836831 admin admin] Authenticating user token {{(pid=80153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:17:30.598210 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.fernet_utils [None req-0a9e1f01-1f00-4d86-879a-797a1a836831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:17:30.615204 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e1f01-1f00-4d86-879a-797a1a836831 admin admin] Validating token access rules against request {{(pid=80153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:17:30.720964 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6515a31-b2d8-4356-8e28-b8ba2d0dc96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e18e0dcebec4953bb7ade2050d92c39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47adb2f515cc47f1ba5c310cfe03d1d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:17:30.722083 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6515a31-b2d8-4356-8e28-b8ba2d0dc96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:17:30.722622 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6515a31-b2d8-4356-8e28-b8ba2d0dc96e admin admin] SCRIPT_NAME: `/identity` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:17:30.723121 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6515a31-b2d8-4356-8e28-b8ba2d0dc96e admin admin] PATH_INFO: `/v3/projects/590e1fb5884744d687ff1a5bacc51b04` {{(pid=80153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:17:30.725350 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6515a31-b2d8-4356-8e28-b8ba2d0dc96e admin admin] RBAC: Authorizing `identity:delete_project(project_id=590e1fb5884744d687ff1a5bacc51b04)` {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:17:30.729195 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6515a31-b2d8-4356-8e28-b8ba2d0dc96e admin admin] RBAC: Authorization granted {{(pid=80153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:17:30.818627 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-d6515a31-b2d8-4356-8e28-b8ba2d0dc96e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '590e1fb5884744d687ff1a5bacc51b04', 'request_id': 'req-d6515a31-b2d8-4356-8e28-b8ba2d0dc96e'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:17:30.826565 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-d6515a31-b2d8-4356-8e28-b8ba2d0dc96e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '590e1fb5884744d687ff1a5bacc51b04', 'request_id': 'req-d6515a31-b2d8-4356-8e28-b8ba2d0dc96e'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:17:30.834964 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-d6515a31-b2d8-4356-8e28-b8ba2d0dc96e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '590e1fb5884744d687ff1a5bacc51b04', 'request_id': 'req-d6515a31-b2d8-4356-8e28-b8ba2d0dc96e'} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:17:30.848598 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-d6515a31-b2d8-4356-8e28-b8ba2d0dc96e admin admin] The token cache is being invalidate because project 590e1fb5884744d687ff1a5bacc51b04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 09:17:30.848852 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-d6515a31-b2d8-4356-8e28-b8ba2d0dc96e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:17:30.849470 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG keystone.notifications [None req-d6515a31-b2d8-4356-8e28-b8ba2d0dc96e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 09:17:30.851226 dv-cinder-797608-64-smb devstack@keystone.service[80153]: [pid: 80153|app: 0|req: 1456/2919] 10.222.0.65 () {58 vars in 1233 bytes} [Wed Jul 27 09:17:30 2022] DELETE /identity/v3/projects/590e1fb5884744d687ff1a5bacc51b04 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 09:17:40.361746 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:17:40.845150 dv-cinder-797608-64-smb devstack@keystone.service[80153]: DEBUG dbcounter [-] [80153] Writing DB stats keystone:SELECT=82,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 09:18:36.064647 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53785da-f813-4eb1-8a1d-916f3b80102f admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 09:18:36.067317 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e53785da-f813-4eb1-8a1d-916f3b80102f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:18:36.189550 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53785da-f813-4eb1-8a1d-916f3b80102f admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 09:18:36.272522 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb4e17-bd4b-4975-bee0-14bd5f8ab9d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d69004d02f9426b86e07907a553e523', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f77fdd017ea4a9b9b49f6e87ba7f267', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 09:18:36.273052 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb4e17-bd4b-4975-bee0-14bd5f8ab9d5 service placement] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 09:18:36.273454 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb4e17-bd4b-4975-bee0-14bd5f8ab9d5 service placement] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 09:18:36.273766 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb4e17-bd4b-4975-bee0-14bd5f8ab9d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 09:18:36.275964 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-70eb4e17-bd4b-4975-bee0-14bd5f8ab9d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 09:18:36.289939 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb4e17-bd4b-4975-bee0-14bd5f8ab9d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 09:18:36.291882 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb4e17-bd4b-4975-bee0-14bd5f8ab9d5 service placement] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 09:18:36.305790 dv-cinder-797608-64-smb devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1464/2920] 10.222.0.65 () {60 vars in 1365 bytes} [Wed Jul 27 09:18:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 09:18:46.299710 dv-cinder-797608-64-smb devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=58 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}